00:00:00.002 Started by upstream project "autotest-per-patch" build number 121343 00:00:00.002 originally caused by: 00:00:00.002 Started by user sys_sgci 00:00:00.079 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.080 The recommended git tool is: git 00:00:00.080 using credential 00000000-0000-0000-0000-000000000002 00:00:00.083 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.139 Fetching changes from the remote Git repository 00:00:00.141 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.184 Using shallow fetch with depth 1 00:00:00.184 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.184 > git --version # timeout=10 00:00:00.233 > git --version # 'git version 2.39.2' 00:00:00.233 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.234 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.234 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:04.342 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:04.355 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:04.368 Checking out Revision f964f6d3463483adf05cc5c086f2abd292e05f1d (FETCH_HEAD) 00:00:04.368 > git config core.sparsecheckout # timeout=10 00:00:04.380 > git read-tree -mu HEAD # timeout=10 00:00:04.397 > git checkout -f f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=5 00:00:04.421 Commit message: "ansible/roles/custom_facts: Drop nvme features" 00:00:04.421 > git rev-list --no-walk f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=10 00:00:04.544 [Pipeline] Start of Pipeline 00:00:04.557 [Pipeline] library 00:00:04.558 Loading library shm_lib@master 00:00:04.558 Library shm_lib@master is cached. Copying from home. 00:00:04.575 [Pipeline] node 00:00:04.584 Running on GP6 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:04.587 [Pipeline] { 00:00:04.599 [Pipeline] catchError 00:00:04.601 [Pipeline] { 00:00:04.617 [Pipeline] wrap 00:00:04.630 [Pipeline] { 00:00:04.639 [Pipeline] stage 00:00:04.641 [Pipeline] { (Prologue) 00:00:04.845 [Pipeline] sh 00:00:05.131 + logger -p user.info -t JENKINS-CI 00:00:05.150 [Pipeline] echo 00:00:05.151 Node: GP6 00:00:05.159 [Pipeline] sh 00:00:05.454 [Pipeline] setCustomBuildProperty 00:00:05.465 [Pipeline] echo 00:00:05.466 Cleanup processes 00:00:05.469 [Pipeline] sh 00:00:05.749 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.749 1245406 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.763 [Pipeline] sh 00:00:06.044 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.044 ++ grep -v 'sudo pgrep' 00:00:06.044 ++ awk '{print $1}' 00:00:06.044 + sudo kill -9 00:00:06.044 + true 00:00:06.058 [Pipeline] cleanWs 00:00:06.067 [WS-CLEANUP] Deleting project workspace... 00:00:06.067 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.072 [WS-CLEANUP] done 00:00:06.076 [Pipeline] setCustomBuildProperty 00:00:06.086 [Pipeline] sh 00:00:06.369 + sudo git config --global --replace-all safe.directory '*' 00:00:06.428 [Pipeline] nodesByLabel 00:00:06.430 Found a total of 1 nodes with the 'sorcerer' label 00:00:06.439 [Pipeline] httpRequest 00:00:06.444 HttpMethod: GET 00:00:06.444 URL: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:06.451 Sending request to url: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:06.478 Response Code: HTTP/1.1 200 OK 00:00:06.478 Success: Status code 200 is in the accepted range: 200,404 00:00:06.479 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:27.642 [Pipeline] sh 00:00:27.929 + tar --no-same-owner -xf jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:27.949 [Pipeline] httpRequest 00:00:27.954 HttpMethod: GET 00:00:27.955 URL: http://10.211.164.96/packages/spdk_33914772a949bf1422eaab22fe3dddf3f369b3b5.tar.gz 00:00:27.956 Sending request to url: http://10.211.164.96/packages/spdk_33914772a949bf1422eaab22fe3dddf3f369b3b5.tar.gz 00:00:27.976 Response Code: HTTP/1.1 200 OK 00:00:27.977 Success: Status code 200 is in the accepted range: 200,404 00:00:27.978 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_33914772a949bf1422eaab22fe3dddf3f369b3b5.tar.gz 00:01:07.543 [Pipeline] sh 00:01:07.831 + tar --no-same-owner -xf spdk_33914772a949bf1422eaab22fe3dddf3f369b3b5.tar.gz 00:01:10.428 [Pipeline] sh 00:01:10.714 + git -C spdk log --oneline -n5 00:01:10.714 33914772a test/scheduler: Enable load_balancing test back 00:01:10.714 bb5958672 test/scheduler: Stop using cgroups 00:01:10.714 fbfcf916e test/scheduler: Drop SILENT_CGROUP_DEBUG 00:01:10.714 e24984b2d test/scheduler: Make sure stderr is not O_TRUNCated in move_proc() 00:01:10.714 8571999d8 test/scheduler: Stop moving all processes between cgroups 00:01:10.727 [Pipeline] } 00:01:10.745 [Pipeline] // stage 00:01:10.754 [Pipeline] stage 00:01:10.756 [Pipeline] { (Prepare) 00:01:10.776 [Pipeline] writeFile 00:01:10.795 [Pipeline] sh 00:01:11.084 + logger -p user.info -t JENKINS-CI 00:01:11.097 [Pipeline] sh 00:01:11.380 + logger -p user.info -t JENKINS-CI 00:01:11.392 [Pipeline] sh 00:01:11.675 + cat autorun-spdk.conf 00:01:11.675 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:11.675 SPDK_TEST_NVMF=1 00:01:11.675 SPDK_TEST_NVME_CLI=1 00:01:11.675 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:11.675 SPDK_TEST_NVMF_NICS=e810 00:01:11.675 SPDK_TEST_VFIOUSER=1 00:01:11.675 SPDK_RUN_UBSAN=1 00:01:11.675 NET_TYPE=phy 00:01:11.682 RUN_NIGHTLY=0 00:01:11.687 [Pipeline] readFile 00:01:11.711 [Pipeline] withEnv 00:01:11.712 [Pipeline] { 00:01:11.724 [Pipeline] sh 00:01:12.004 + set -ex 00:01:12.004 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:12.004 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:12.004 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:12.004 ++ SPDK_TEST_NVMF=1 00:01:12.004 ++ SPDK_TEST_NVME_CLI=1 00:01:12.004 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:12.004 ++ SPDK_TEST_NVMF_NICS=e810 00:01:12.004 ++ SPDK_TEST_VFIOUSER=1 00:01:12.004 ++ SPDK_RUN_UBSAN=1 00:01:12.004 ++ NET_TYPE=phy 00:01:12.004 ++ RUN_NIGHTLY=0 00:01:12.004 + case $SPDK_TEST_NVMF_NICS in 00:01:12.004 + DRIVERS=ice 00:01:12.004 + [[ tcp == \r\d\m\a ]] 00:01:12.004 + [[ -n ice ]] 00:01:12.004 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:12.004 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:12.004 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:12.004 rmmod: ERROR: Module irdma is not currently loaded 00:01:12.004 rmmod: ERROR: Module i40iw is not currently loaded 00:01:12.004 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:12.004 + true 00:01:12.004 + for D in $DRIVERS 00:01:12.004 + sudo modprobe ice 00:01:12.004 + exit 0 00:01:12.013 [Pipeline] } 00:01:12.031 [Pipeline] // withEnv 00:01:12.036 [Pipeline] } 00:01:12.052 [Pipeline] // stage 00:01:12.061 [Pipeline] catchError 00:01:12.062 [Pipeline] { 00:01:12.077 [Pipeline] timeout 00:01:12.077 Timeout set to expire in 40 min 00:01:12.079 [Pipeline] { 00:01:12.095 [Pipeline] stage 00:01:12.097 [Pipeline] { (Tests) 00:01:12.109 [Pipeline] sh 00:01:12.392 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:12.392 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:12.392 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:12.392 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:12.392 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:12.392 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:12.392 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:12.392 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:12.392 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:12.392 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:12.392 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:12.392 + source /etc/os-release 00:01:12.392 ++ NAME='Fedora Linux' 00:01:12.392 ++ VERSION='38 (Cloud Edition)' 00:01:12.392 ++ ID=fedora 00:01:12.392 ++ VERSION_ID=38 00:01:12.392 ++ VERSION_CODENAME= 00:01:12.392 ++ PLATFORM_ID=platform:f38 00:01:12.392 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:01:12.392 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:12.392 ++ LOGO=fedora-logo-icon 00:01:12.392 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:01:12.392 ++ HOME_URL=https://fedoraproject.org/ 00:01:12.392 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:01:12.392 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:12.392 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:12.392 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:12.392 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:01:12.392 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:12.392 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:01:12.392 ++ SUPPORT_END=2024-05-14 00:01:12.392 ++ VARIANT='Cloud Edition' 00:01:12.392 ++ VARIANT_ID=cloud 00:01:12.392 + uname -a 00:01:12.392 Linux spdk-gp-06 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:01:12.392 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:13.333 Hugepages 00:01:13.333 node hugesize free / total 00:01:13.333 node0 1048576kB 0 / 0 00:01:13.333 node0 2048kB 0 / 0 00:01:13.333 node1 1048576kB 0 / 0 00:01:13.333 node1 2048kB 0 / 0 00:01:13.333 00:01:13.333 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:13.333 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:13.333 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:13.333 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:13.333 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:13.333 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:13.333 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:13.333 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:13.333 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:13.333 NVMe 0000:0b:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:01:13.333 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:13.333 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:13.333 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:13.333 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:13.333 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:13.333 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:13.333 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:13.333 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:13.333 + rm -f /tmp/spdk-ld-path 00:01:13.333 + source autorun-spdk.conf 00:01:13.333 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:13.333 ++ SPDK_TEST_NVMF=1 00:01:13.333 ++ SPDK_TEST_NVME_CLI=1 00:01:13.333 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:13.333 ++ SPDK_TEST_NVMF_NICS=e810 00:01:13.333 ++ SPDK_TEST_VFIOUSER=1 00:01:13.333 ++ SPDK_RUN_UBSAN=1 00:01:13.333 ++ NET_TYPE=phy 00:01:13.333 ++ RUN_NIGHTLY=0 00:01:13.333 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:13.333 + [[ -n '' ]] 00:01:13.333 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:13.333 + for M in /var/spdk/build-*-manifest.txt 00:01:13.333 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:13.333 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:13.333 + for M in /var/spdk/build-*-manifest.txt 00:01:13.333 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:13.333 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:13.333 ++ uname 00:01:13.333 + [[ Linux == \L\i\n\u\x ]] 00:01:13.333 + sudo dmesg -T 00:01:13.593 + sudo dmesg --clear 00:01:13.593 + dmesg_pid=1246688 00:01:13.593 + [[ Fedora Linux == FreeBSD ]] 00:01:13.593 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:13.593 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:13.593 + sudo dmesg -Tw 00:01:13.593 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:13.593 + export VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:01:13.593 + VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:01:13.593 + [[ -x /usr/src/fio-static/fio ]] 00:01:13.593 + export FIO_BIN=/usr/src/fio-static/fio 00:01:13.593 + FIO_BIN=/usr/src/fio-static/fio 00:01:13.593 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:13.593 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:13.593 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:13.593 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:13.593 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:13.593 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:13.593 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:13.593 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:13.593 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:13.593 Test configuration: 00:01:13.593 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:13.593 SPDK_TEST_NVMF=1 00:01:13.593 SPDK_TEST_NVME_CLI=1 00:01:13.593 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:13.593 SPDK_TEST_NVMF_NICS=e810 00:01:13.593 SPDK_TEST_VFIOUSER=1 00:01:13.593 SPDK_RUN_UBSAN=1 00:01:13.593 NET_TYPE=phy 00:01:13.593 RUN_NIGHTLY=0 03:12:38 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:13.593 03:12:38 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:13.593 03:12:38 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:13.593 03:12:38 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:13.593 03:12:38 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:13.593 03:12:38 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:13.593 03:12:38 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:13.593 03:12:38 -- paths/export.sh@5 -- $ export PATH 00:01:13.593 03:12:38 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:13.593 03:12:38 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:13.593 03:12:38 -- common/autobuild_common.sh@435 -- $ date +%s 00:01:13.593 03:12:38 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714180358.XXXXXX 00:01:13.593 03:12:38 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714180358.FSrQ5N 00:01:13.593 03:12:38 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:01:13.593 03:12:38 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:01:13.593 03:12:38 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:13.593 03:12:38 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:13.593 03:12:38 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:13.593 03:12:38 -- common/autobuild_common.sh@451 -- $ get_config_params 00:01:13.593 03:12:38 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:01:13.593 03:12:38 -- common/autotest_common.sh@10 -- $ set +x 00:01:13.593 03:12:38 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user' 00:01:13.593 03:12:38 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:01:13.593 03:12:38 -- pm/common@17 -- $ local monitor 00:01:13.593 03:12:38 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:13.593 03:12:38 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1246722 00:01:13.593 03:12:38 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:13.593 03:12:38 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1246724 00:01:13.593 03:12:38 -- pm/common@21 -- $ date +%s 00:01:13.593 03:12:38 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:13.593 03:12:38 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1246727 00:01:13.593 03:12:38 -- pm/common@21 -- $ date +%s 00:01:13.593 03:12:38 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:13.593 03:12:38 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1246729 00:01:13.593 03:12:38 -- pm/common@21 -- $ date +%s 00:01:13.593 03:12:38 -- pm/common@26 -- $ sleep 1 00:01:13.593 03:12:38 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714180358 00:01:13.593 03:12:38 -- pm/common@21 -- $ date +%s 00:01:13.593 03:12:38 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714180358 00:01:13.593 03:12:38 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714180358 00:01:13.593 03:12:38 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714180358 00:01:13.593 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714180358_collect-vmstat.pm.log 00:01:13.593 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714180358_collect-bmc-pm.bmc.pm.log 00:01:13.593 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714180358_collect-cpu-load.pm.log 00:01:13.593 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714180358_collect-cpu-temp.pm.log 00:01:14.533 03:12:39 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:01:14.533 03:12:39 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:14.533 03:12:39 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:14.533 03:12:39 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:14.533 03:12:39 -- spdk/autobuild.sh@16 -- $ date -u 00:01:14.533 Sat Apr 27 01:12:39 AM UTC 2024 00:01:14.533 03:12:39 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:14.533 v24.05-pre-453-g33914772a 00:01:14.533 03:12:39 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:14.533 03:12:39 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:14.533 03:12:39 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:14.533 03:12:39 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:14.533 03:12:39 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:14.533 03:12:39 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.792 ************************************ 00:01:14.792 START TEST ubsan 00:01:14.792 ************************************ 00:01:14.792 03:12:39 -- common/autotest_common.sh@1111 -- $ echo 'using ubsan' 00:01:14.792 using ubsan 00:01:14.792 00:01:14.792 real 0m0.000s 00:01:14.792 user 0m0.000s 00:01:14.792 sys 0m0.000s 00:01:14.792 03:12:39 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:01:14.792 03:12:39 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.792 ************************************ 00:01:14.792 END TEST ubsan 00:01:14.792 ************************************ 00:01:14.792 03:12:39 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:14.792 03:12:39 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:14.792 03:12:39 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:14.792 03:12:39 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:14.792 03:12:39 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:14.792 03:12:39 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:14.792 03:12:39 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:14.792 03:12:39 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:14.792 03:12:39 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-shared 00:01:14.792 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:14.792 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:15.051 Using 'verbs' RDMA provider 00:01:25.604 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.spdk-isal.log)...done. 00:01:35.599 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:01:35.599 Creating mk/config.mk...done. 00:01:35.599 Creating mk/cc.flags.mk...done. 00:01:35.599 Type 'make' to build. 00:01:35.599 03:12:59 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:35.599 03:12:59 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:35.599 03:12:59 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:35.599 03:12:59 -- common/autotest_common.sh@10 -- $ set +x 00:01:35.599 ************************************ 00:01:35.599 START TEST make 00:01:35.599 ************************************ 00:01:35.599 03:13:00 -- common/autotest_common.sh@1111 -- $ make -j48 00:01:35.599 make[1]: Nothing to be done for 'all'. 00:01:37.022 The Meson build system 00:01:37.022 Version: 1.3.1 00:01:37.022 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:01:37.022 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:01:37.022 Build type: native build 00:01:37.022 Project name: libvfio-user 00:01:37.022 Project version: 0.0.1 00:01:37.022 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:37.022 C linker for the host machine: cc ld.bfd 2.39-16 00:01:37.022 Host machine cpu family: x86_64 00:01:37.022 Host machine cpu: x86_64 00:01:37.022 Run-time dependency threads found: YES 00:01:37.022 Library dl found: YES 00:01:37.022 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:37.022 Run-time dependency json-c found: YES 0.17 00:01:37.022 Run-time dependency cmocka found: YES 1.1.7 00:01:37.022 Program pytest-3 found: NO 00:01:37.022 Program flake8 found: NO 00:01:37.022 Program misspell-fixer found: NO 00:01:37.022 Program restructuredtext-lint found: NO 00:01:37.022 Program valgrind found: YES (/usr/bin/valgrind) 00:01:37.022 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:37.022 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:37.022 Compiler for C supports arguments -Wwrite-strings: YES 00:01:37.022 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:01:37.022 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:01:37.022 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:01:37.022 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:01:37.022 Build targets in project: 8 00:01:37.022 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:01:37.022 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:01:37.022 00:01:37.022 libvfio-user 0.0.1 00:01:37.022 00:01:37.022 User defined options 00:01:37.022 buildtype : debug 00:01:37.022 default_library: shared 00:01:37.022 libdir : /usr/local/lib 00:01:37.022 00:01:37.022 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:37.973 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:01:37.973 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:01:37.973 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:01:37.973 [3/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:01:37.973 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:01:37.973 [5/37] Compiling C object test/unit_tests.p/mocks.c.o 00:01:37.973 [6/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:01:37.973 [7/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:01:37.973 [8/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:01:37.973 [9/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:01:38.236 [10/37] Compiling C object samples/lspci.p/lspci.c.o 00:01:38.236 [11/37] Compiling C object samples/null.p/null.c.o 00:01:38.236 [12/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:01:38.236 [13/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:01:38.236 [14/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:01:38.236 [15/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:01:38.236 [16/37] Compiling C object samples/server.p/server.c.o 00:01:38.236 [17/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:01:38.236 [18/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:01:38.236 [19/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:01:38.236 [20/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:01:38.236 [21/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:01:38.236 [22/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:01:38.236 [23/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:01:38.236 [24/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:01:38.236 [25/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:01:38.236 [26/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:01:38.236 [27/37] Compiling C object samples/client.p/client.c.o 00:01:38.236 [28/37] Linking target lib/libvfio-user.so.0.0.1 00:01:38.236 [29/37] Linking target samples/client 00:01:38.497 [30/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:01:38.497 [31/37] Linking target test/unit_tests 00:01:38.497 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:01:38.497 [33/37] Linking target samples/null 00:01:38.497 [34/37] Linking target samples/shadow_ioeventfd_server 00:01:38.497 [35/37] Linking target samples/gpio-pci-idio-16 00:01:38.761 [36/37] Linking target samples/server 00:01:38.761 [37/37] Linking target samples/lspci 00:01:38.761 INFO: autodetecting backend as ninja 00:01:38.761 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:01:38.761 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:01:39.332 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:01:39.332 ninja: no work to do. 00:01:44.605 The Meson build system 00:01:44.605 Version: 1.3.1 00:01:44.605 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:44.605 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:44.605 Build type: native build 00:01:44.606 Program cat found: YES (/usr/bin/cat) 00:01:44.606 Project name: DPDK 00:01:44.606 Project version: 23.11.0 00:01:44.606 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:44.606 C linker for the host machine: cc ld.bfd 2.39-16 00:01:44.606 Host machine cpu family: x86_64 00:01:44.606 Host machine cpu: x86_64 00:01:44.606 Message: ## Building in Developer Mode ## 00:01:44.606 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:44.606 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:44.606 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:44.606 Program python3 found: YES (/usr/bin/python3) 00:01:44.606 Program cat found: YES (/usr/bin/cat) 00:01:44.606 Compiler for C supports arguments -march=native: YES 00:01:44.606 Checking for size of "void *" : 8 00:01:44.606 Checking for size of "void *" : 8 (cached) 00:01:44.606 Library m found: YES 00:01:44.606 Library numa found: YES 00:01:44.606 Has header "numaif.h" : YES 00:01:44.606 Library fdt found: NO 00:01:44.606 Library execinfo found: NO 00:01:44.606 Has header "execinfo.h" : YES 00:01:44.606 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:44.606 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:44.606 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:44.606 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:44.606 Run-time dependency openssl found: YES 3.0.9 00:01:44.606 Run-time dependency libpcap found: YES 1.10.4 00:01:44.606 Has header "pcap.h" with dependency libpcap: YES 00:01:44.606 Compiler for C supports arguments -Wcast-qual: YES 00:01:44.606 Compiler for C supports arguments -Wdeprecated: YES 00:01:44.606 Compiler for C supports arguments -Wformat: YES 00:01:44.606 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:44.606 Compiler for C supports arguments -Wformat-security: NO 00:01:44.606 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:44.606 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:44.606 Compiler for C supports arguments -Wnested-externs: YES 00:01:44.606 Compiler for C supports arguments -Wold-style-definition: YES 00:01:44.606 Compiler for C supports arguments -Wpointer-arith: YES 00:01:44.606 Compiler for C supports arguments -Wsign-compare: YES 00:01:44.606 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:44.606 Compiler for C supports arguments -Wundef: YES 00:01:44.606 Compiler for C supports arguments -Wwrite-strings: YES 00:01:44.606 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:44.606 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:44.606 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:44.606 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:44.606 Program objdump found: YES (/usr/bin/objdump) 00:01:44.606 Compiler for C supports arguments -mavx512f: YES 00:01:44.606 Checking if "AVX512 checking" compiles: YES 00:01:44.606 Fetching value of define "__SSE4_2__" : 1 00:01:44.606 Fetching value of define "__AES__" : 1 00:01:44.606 Fetching value of define "__AVX__" : 1 00:01:44.606 Fetching value of define "__AVX2__" : (undefined) 00:01:44.606 Fetching value of define "__AVX512BW__" : (undefined) 00:01:44.606 Fetching value of define "__AVX512CD__" : (undefined) 00:01:44.606 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:44.606 Fetching value of define "__AVX512F__" : (undefined) 00:01:44.606 Fetching value of define "__AVX512VL__" : (undefined) 00:01:44.606 Fetching value of define "__PCLMUL__" : 1 00:01:44.606 Fetching value of define "__RDRND__" : 1 00:01:44.606 Fetching value of define "__RDSEED__" : (undefined) 00:01:44.606 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:44.606 Fetching value of define "__znver1__" : (undefined) 00:01:44.606 Fetching value of define "__znver2__" : (undefined) 00:01:44.606 Fetching value of define "__znver3__" : (undefined) 00:01:44.606 Fetching value of define "__znver4__" : (undefined) 00:01:44.606 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:44.606 Message: lib/log: Defining dependency "log" 00:01:44.606 Message: lib/kvargs: Defining dependency "kvargs" 00:01:44.606 Message: lib/telemetry: Defining dependency "telemetry" 00:01:44.606 Checking for function "getentropy" : NO 00:01:44.606 Message: lib/eal: Defining dependency "eal" 00:01:44.606 Message: lib/ring: Defining dependency "ring" 00:01:44.606 Message: lib/rcu: Defining dependency "rcu" 00:01:44.606 Message: lib/mempool: Defining dependency "mempool" 00:01:44.606 Message: lib/mbuf: Defining dependency "mbuf" 00:01:44.606 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:44.606 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:44.606 Compiler for C supports arguments -mpclmul: YES 00:01:44.606 Compiler for C supports arguments -maes: YES 00:01:44.606 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:44.606 Compiler for C supports arguments -mavx512bw: YES 00:01:44.606 Compiler for C supports arguments -mavx512dq: YES 00:01:44.606 Compiler for C supports arguments -mavx512vl: YES 00:01:44.606 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:44.606 Compiler for C supports arguments -mavx2: YES 00:01:44.606 Compiler for C supports arguments -mavx: YES 00:01:44.606 Message: lib/net: Defining dependency "net" 00:01:44.606 Message: lib/meter: Defining dependency "meter" 00:01:44.606 Message: lib/ethdev: Defining dependency "ethdev" 00:01:44.606 Message: lib/pci: Defining dependency "pci" 00:01:44.606 Message: lib/cmdline: Defining dependency "cmdline" 00:01:44.606 Message: lib/hash: Defining dependency "hash" 00:01:44.606 Message: lib/timer: Defining dependency "timer" 00:01:44.606 Message: lib/compressdev: Defining dependency "compressdev" 00:01:44.606 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:44.606 Message: lib/dmadev: Defining dependency "dmadev" 00:01:44.606 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:44.606 Message: lib/power: Defining dependency "power" 00:01:44.606 Message: lib/reorder: Defining dependency "reorder" 00:01:44.606 Message: lib/security: Defining dependency "security" 00:01:44.606 Has header "linux/userfaultfd.h" : YES 00:01:44.606 Has header "linux/vduse.h" : YES 00:01:44.606 Message: lib/vhost: Defining dependency "vhost" 00:01:44.606 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:44.606 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:44.606 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:44.606 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:44.606 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:44.606 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:44.606 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:44.606 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:44.606 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:44.606 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:44.606 Program doxygen found: YES (/usr/bin/doxygen) 00:01:44.606 Configuring doxy-api-html.conf using configuration 00:01:44.606 Configuring doxy-api-man.conf using configuration 00:01:44.606 Program mandb found: YES (/usr/bin/mandb) 00:01:44.606 Program sphinx-build found: NO 00:01:44.606 Configuring rte_build_config.h using configuration 00:01:44.606 Message: 00:01:44.606 ================= 00:01:44.606 Applications Enabled 00:01:44.606 ================= 00:01:44.606 00:01:44.606 apps: 00:01:44.606 00:01:44.606 00:01:44.606 Message: 00:01:44.606 ================= 00:01:44.606 Libraries Enabled 00:01:44.606 ================= 00:01:44.606 00:01:44.606 libs: 00:01:44.606 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:44.606 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:44.606 cryptodev, dmadev, power, reorder, security, vhost, 00:01:44.606 00:01:44.606 Message: 00:01:44.606 =============== 00:01:44.606 Drivers Enabled 00:01:44.606 =============== 00:01:44.606 00:01:44.606 common: 00:01:44.606 00:01:44.606 bus: 00:01:44.606 pci, vdev, 00:01:44.606 mempool: 00:01:44.606 ring, 00:01:44.606 dma: 00:01:44.606 00:01:44.606 net: 00:01:44.606 00:01:44.606 crypto: 00:01:44.606 00:01:44.606 compress: 00:01:44.606 00:01:44.606 vdpa: 00:01:44.606 00:01:44.606 00:01:44.606 Message: 00:01:44.606 ================= 00:01:44.606 Content Skipped 00:01:44.606 ================= 00:01:44.606 00:01:44.606 apps: 00:01:44.606 dumpcap: explicitly disabled via build config 00:01:44.606 graph: explicitly disabled via build config 00:01:44.606 pdump: explicitly disabled via build config 00:01:44.606 proc-info: explicitly disabled via build config 00:01:44.606 test-acl: explicitly disabled via build config 00:01:44.606 test-bbdev: explicitly disabled via build config 00:01:44.606 test-cmdline: explicitly disabled via build config 00:01:44.606 test-compress-perf: explicitly disabled via build config 00:01:44.606 test-crypto-perf: explicitly disabled via build config 00:01:44.606 test-dma-perf: explicitly disabled via build config 00:01:44.606 test-eventdev: explicitly disabled via build config 00:01:44.606 test-fib: explicitly disabled via build config 00:01:44.606 test-flow-perf: explicitly disabled via build config 00:01:44.606 test-gpudev: explicitly disabled via build config 00:01:44.606 test-mldev: explicitly disabled via build config 00:01:44.606 test-pipeline: explicitly disabled via build config 00:01:44.606 test-pmd: explicitly disabled via build config 00:01:44.606 test-regex: explicitly disabled via build config 00:01:44.606 test-sad: explicitly disabled via build config 00:01:44.606 test-security-perf: explicitly disabled via build config 00:01:44.606 00:01:44.606 libs: 00:01:44.606 metrics: explicitly disabled via build config 00:01:44.606 acl: explicitly disabled via build config 00:01:44.606 bbdev: explicitly disabled via build config 00:01:44.606 bitratestats: explicitly disabled via build config 00:01:44.606 bpf: explicitly disabled via build config 00:01:44.606 cfgfile: explicitly disabled via build config 00:01:44.606 distributor: explicitly disabled via build config 00:01:44.606 efd: explicitly disabled via build config 00:01:44.606 eventdev: explicitly disabled via build config 00:01:44.606 dispatcher: explicitly disabled via build config 00:01:44.606 gpudev: explicitly disabled via build config 00:01:44.607 gro: explicitly disabled via build config 00:01:44.607 gso: explicitly disabled via build config 00:01:44.607 ip_frag: explicitly disabled via build config 00:01:44.607 jobstats: explicitly disabled via build config 00:01:44.607 latencystats: explicitly disabled via build config 00:01:44.607 lpm: explicitly disabled via build config 00:01:44.607 member: explicitly disabled via build config 00:01:44.607 pcapng: explicitly disabled via build config 00:01:44.607 rawdev: explicitly disabled via build config 00:01:44.607 regexdev: explicitly disabled via build config 00:01:44.607 mldev: explicitly disabled via build config 00:01:44.607 rib: explicitly disabled via build config 00:01:44.607 sched: explicitly disabled via build config 00:01:44.607 stack: explicitly disabled via build config 00:01:44.607 ipsec: explicitly disabled via build config 00:01:44.607 pdcp: explicitly disabled via build config 00:01:44.607 fib: explicitly disabled via build config 00:01:44.607 port: explicitly disabled via build config 00:01:44.607 pdump: explicitly disabled via build config 00:01:44.607 table: explicitly disabled via build config 00:01:44.607 pipeline: explicitly disabled via build config 00:01:44.607 graph: explicitly disabled via build config 00:01:44.607 node: explicitly disabled via build config 00:01:44.607 00:01:44.607 drivers: 00:01:44.607 common/cpt: not in enabled drivers build config 00:01:44.607 common/dpaax: not in enabled drivers build config 00:01:44.607 common/iavf: not in enabled drivers build config 00:01:44.607 common/idpf: not in enabled drivers build config 00:01:44.607 common/mvep: not in enabled drivers build config 00:01:44.607 common/octeontx: not in enabled drivers build config 00:01:44.607 bus/auxiliary: not in enabled drivers build config 00:01:44.607 bus/cdx: not in enabled drivers build config 00:01:44.607 bus/dpaa: not in enabled drivers build config 00:01:44.607 bus/fslmc: not in enabled drivers build config 00:01:44.607 bus/ifpga: not in enabled drivers build config 00:01:44.607 bus/platform: not in enabled drivers build config 00:01:44.607 bus/vmbus: not in enabled drivers build config 00:01:44.607 common/cnxk: not in enabled drivers build config 00:01:44.607 common/mlx5: not in enabled drivers build config 00:01:44.607 common/nfp: not in enabled drivers build config 00:01:44.607 common/qat: not in enabled drivers build config 00:01:44.607 common/sfc_efx: not in enabled drivers build config 00:01:44.607 mempool/bucket: not in enabled drivers build config 00:01:44.607 mempool/cnxk: not in enabled drivers build config 00:01:44.607 mempool/dpaa: not in enabled drivers build config 00:01:44.607 mempool/dpaa2: not in enabled drivers build config 00:01:44.607 mempool/octeontx: not in enabled drivers build config 00:01:44.607 mempool/stack: not in enabled drivers build config 00:01:44.607 dma/cnxk: not in enabled drivers build config 00:01:44.607 dma/dpaa: not in enabled drivers build config 00:01:44.607 dma/dpaa2: not in enabled drivers build config 00:01:44.607 dma/hisilicon: not in enabled drivers build config 00:01:44.607 dma/idxd: not in enabled drivers build config 00:01:44.607 dma/ioat: not in enabled drivers build config 00:01:44.607 dma/skeleton: not in enabled drivers build config 00:01:44.607 net/af_packet: not in enabled drivers build config 00:01:44.607 net/af_xdp: not in enabled drivers build config 00:01:44.607 net/ark: not in enabled drivers build config 00:01:44.607 net/atlantic: not in enabled drivers build config 00:01:44.607 net/avp: not in enabled drivers build config 00:01:44.607 net/axgbe: not in enabled drivers build config 00:01:44.607 net/bnx2x: not in enabled drivers build config 00:01:44.607 net/bnxt: not in enabled drivers build config 00:01:44.607 net/bonding: not in enabled drivers build config 00:01:44.607 net/cnxk: not in enabled drivers build config 00:01:44.607 net/cpfl: not in enabled drivers build config 00:01:44.607 net/cxgbe: not in enabled drivers build config 00:01:44.607 net/dpaa: not in enabled drivers build config 00:01:44.607 net/dpaa2: not in enabled drivers build config 00:01:44.607 net/e1000: not in enabled drivers build config 00:01:44.607 net/ena: not in enabled drivers build config 00:01:44.607 net/enetc: not in enabled drivers build config 00:01:44.607 net/enetfec: not in enabled drivers build config 00:01:44.607 net/enic: not in enabled drivers build config 00:01:44.607 net/failsafe: not in enabled drivers build config 00:01:44.607 net/fm10k: not in enabled drivers build config 00:01:44.607 net/gve: not in enabled drivers build config 00:01:44.607 net/hinic: not in enabled drivers build config 00:01:44.607 net/hns3: not in enabled drivers build config 00:01:44.607 net/i40e: not in enabled drivers build config 00:01:44.607 net/iavf: not in enabled drivers build config 00:01:44.607 net/ice: not in enabled drivers build config 00:01:44.607 net/idpf: not in enabled drivers build config 00:01:44.607 net/igc: not in enabled drivers build config 00:01:44.607 net/ionic: not in enabled drivers build config 00:01:44.607 net/ipn3ke: not in enabled drivers build config 00:01:44.607 net/ixgbe: not in enabled drivers build config 00:01:44.607 net/mana: not in enabled drivers build config 00:01:44.607 net/memif: not in enabled drivers build config 00:01:44.607 net/mlx4: not in enabled drivers build config 00:01:44.607 net/mlx5: not in enabled drivers build config 00:01:44.607 net/mvneta: not in enabled drivers build config 00:01:44.607 net/mvpp2: not in enabled drivers build config 00:01:44.607 net/netvsc: not in enabled drivers build config 00:01:44.607 net/nfb: not in enabled drivers build config 00:01:44.607 net/nfp: not in enabled drivers build config 00:01:44.607 net/ngbe: not in enabled drivers build config 00:01:44.607 net/null: not in enabled drivers build config 00:01:44.607 net/octeontx: not in enabled drivers build config 00:01:44.607 net/octeon_ep: not in enabled drivers build config 00:01:44.607 net/pcap: not in enabled drivers build config 00:01:44.607 net/pfe: not in enabled drivers build config 00:01:44.607 net/qede: not in enabled drivers build config 00:01:44.607 net/ring: not in enabled drivers build config 00:01:44.607 net/sfc: not in enabled drivers build config 00:01:44.607 net/softnic: not in enabled drivers build config 00:01:44.607 net/tap: not in enabled drivers build config 00:01:44.607 net/thunderx: not in enabled drivers build config 00:01:44.607 net/txgbe: not in enabled drivers build config 00:01:44.607 net/vdev_netvsc: not in enabled drivers build config 00:01:44.607 net/vhost: not in enabled drivers build config 00:01:44.607 net/virtio: not in enabled drivers build config 00:01:44.607 net/vmxnet3: not in enabled drivers build config 00:01:44.607 raw/*: missing internal dependency, "rawdev" 00:01:44.607 crypto/armv8: not in enabled drivers build config 00:01:44.607 crypto/bcmfs: not in enabled drivers build config 00:01:44.607 crypto/caam_jr: not in enabled drivers build config 00:01:44.607 crypto/ccp: not in enabled drivers build config 00:01:44.607 crypto/cnxk: not in enabled drivers build config 00:01:44.607 crypto/dpaa_sec: not in enabled drivers build config 00:01:44.607 crypto/dpaa2_sec: not in enabled drivers build config 00:01:44.607 crypto/ipsec_mb: not in enabled drivers build config 00:01:44.607 crypto/mlx5: not in enabled drivers build config 00:01:44.607 crypto/mvsam: not in enabled drivers build config 00:01:44.607 crypto/nitrox: not in enabled drivers build config 00:01:44.607 crypto/null: not in enabled drivers build config 00:01:44.607 crypto/octeontx: not in enabled drivers build config 00:01:44.607 crypto/openssl: not in enabled drivers build config 00:01:44.607 crypto/scheduler: not in enabled drivers build config 00:01:44.607 crypto/uadk: not in enabled drivers build config 00:01:44.607 crypto/virtio: not in enabled drivers build config 00:01:44.607 compress/isal: not in enabled drivers build config 00:01:44.607 compress/mlx5: not in enabled drivers build config 00:01:44.607 compress/octeontx: not in enabled drivers build config 00:01:44.607 compress/zlib: not in enabled drivers build config 00:01:44.607 regex/*: missing internal dependency, "regexdev" 00:01:44.607 ml/*: missing internal dependency, "mldev" 00:01:44.607 vdpa/ifc: not in enabled drivers build config 00:01:44.607 vdpa/mlx5: not in enabled drivers build config 00:01:44.607 vdpa/nfp: not in enabled drivers build config 00:01:44.607 vdpa/sfc: not in enabled drivers build config 00:01:44.607 event/*: missing internal dependency, "eventdev" 00:01:44.607 baseband/*: missing internal dependency, "bbdev" 00:01:44.607 gpu/*: missing internal dependency, "gpudev" 00:01:44.607 00:01:44.607 00:01:44.607 Build targets in project: 85 00:01:44.607 00:01:44.607 DPDK 23.11.0 00:01:44.607 00:01:44.607 User defined options 00:01:44.607 buildtype : debug 00:01:44.607 default_library : shared 00:01:44.607 libdir : lib 00:01:44.607 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:44.607 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:01:44.607 c_link_args : 00:01:44.607 cpu_instruction_set: native 00:01:44.607 disable_apps : test-acl,test-bbdev,test-crypto-perf,test-fib,test-pipeline,test-gpudev,test-flow-perf,pdump,dumpcap,test-sad,test-cmdline,test-eventdev,proc-info,test,test-dma-perf,test-pmd,test-mldev,test-compress-perf,test-security-perf,graph,test-regex 00:01:44.607 disable_libs : pipeline,member,eventdev,efd,bbdev,cfgfile,rib,sched,mldev,metrics,lpm,latencystats,pdump,pdcp,bpf,ipsec,fib,ip_frag,table,port,stack,gro,jobstats,regexdev,rawdev,pcapng,dispatcher,node,bitratestats,acl,gpudev,distributor,graph,gso 00:01:44.607 enable_docs : false 00:01:44.607 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:44.607 enable_kmods : false 00:01:44.607 tests : false 00:01:44.607 00:01:44.607 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:44.607 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:44.607 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:44.607 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:44.607 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:44.607 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:44.868 [5/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:44.868 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:44.868 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:44.868 [8/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:44.868 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:44.868 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:44.868 [11/265] Linking static target lib/librte_kvargs.a 00:01:44.868 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:44.868 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:44.868 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:44.868 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:44.868 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:44.868 [17/265] Linking static target lib/librte_log.a 00:01:44.868 [18/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:44.868 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:44.868 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:44.868 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:45.135 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.709 [23/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:45.709 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:45.709 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:45.709 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:45.709 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:45.709 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:45.709 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:45.709 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:45.709 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:45.709 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:45.709 [33/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:45.709 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:45.709 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:45.709 [36/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:45.709 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:45.709 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:45.709 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:45.709 [40/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:45.709 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:45.709 [42/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:45.709 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:45.709 [44/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:45.709 [45/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:45.709 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:45.709 [47/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:45.709 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:45.709 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:45.709 [50/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:45.709 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:45.709 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:45.709 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:45.709 [54/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:45.709 [55/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:45.709 [56/265] Linking static target lib/librte_telemetry.a 00:01:45.709 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:45.709 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:45.709 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:45.709 [60/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:45.970 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:45.970 [62/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:45.970 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:45.970 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:45.970 [65/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:45.970 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:45.970 [67/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:45.971 [68/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:45.971 [69/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:45.971 [70/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:45.971 [71/265] Linking static target lib/librte_pci.a 00:01:45.971 [72/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:45.971 [73/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:45.971 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:45.971 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:46.232 [76/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.232 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:46.232 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:46.232 [79/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:46.232 [80/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:46.232 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:46.232 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:46.232 [83/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:46.232 [84/265] Linking target lib/librte_log.so.24.0 00:01:46.232 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:46.232 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:46.495 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:46.495 [88/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:46.495 [89/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.495 [90/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:46.495 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:46.495 [92/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:46.495 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:46.495 [94/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:46.495 [95/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:46.495 [96/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:46.495 [97/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:46.495 [98/265] Linking static target lib/librte_ring.a 00:01:46.757 [99/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:46.757 [100/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:46.757 [101/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:46.757 [102/265] Linking static target lib/librte_eal.a 00:01:46.757 [103/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:46.757 [104/265] Linking static target lib/librte_meter.a 00:01:46.757 [105/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:46.757 [106/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:46.757 [107/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.757 [108/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:46.757 [109/265] Linking target lib/librte_kvargs.so.24.0 00:01:46.757 [110/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:46.757 [111/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:46.757 [112/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:46.757 [113/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:46.757 [114/265] Linking target lib/librte_telemetry.so.24.0 00:01:46.757 [115/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:46.757 [116/265] Linking static target lib/librte_mempool.a 00:01:46.757 [117/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:46.757 [118/265] Linking static target lib/librte_rcu.a 00:01:46.757 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:46.757 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:47.018 [121/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:47.018 [122/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:47.018 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:47.018 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:47.018 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:47.018 [126/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:47.018 [127/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:47.018 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:47.018 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:47.018 [130/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:47.018 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:47.018 [132/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:47.018 [133/265] Linking static target lib/librte_cmdline.a 00:01:47.018 [134/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:47.283 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:47.283 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:47.283 [137/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:47.283 [138/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:47.283 [139/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:47.283 [140/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.283 [141/265] Linking static target lib/librte_net.a 00:01:47.283 [142/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:47.283 [143/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.283 [144/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:47.283 [145/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:47.544 [146/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.544 [147/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:47.544 [148/265] Linking static target lib/librte_timer.a 00:01:47.544 [149/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:47.544 [150/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:47.544 [151/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:47.544 [152/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:47.544 [153/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:47.544 [154/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:47.544 [155/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:47.544 [156/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:47.544 [157/265] Linking static target lib/librte_dmadev.a 00:01:47.803 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:47.803 [159/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:47.803 [160/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.803 [161/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.803 [162/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:47.803 [163/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:47.803 [164/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.803 [165/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:47.803 [166/265] Linking static target lib/librte_compressdev.a 00:01:47.803 [167/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:47.803 [168/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:47.803 [169/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:48.061 [170/265] Linking static target lib/librte_hash.a 00:01:48.061 [171/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:48.061 [172/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:48.061 [173/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:48.061 [174/265] Linking static target lib/librte_power.a 00:01:48.061 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:48.061 [176/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:48.061 [177/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:48.061 [178/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.061 [179/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:48.061 [180/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.061 [181/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:48.061 [182/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:48.061 [183/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:48.061 [184/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:48.061 [185/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:48.061 [186/265] Linking static target lib/librte_reorder.a 00:01:48.318 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:48.318 [188/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:48.319 [189/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:48.319 [190/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:48.319 [191/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:48.319 [192/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:48.319 [193/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:48.319 [194/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.319 [195/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:48.319 [196/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:48.319 [197/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:48.319 [198/265] Linking static target drivers/librte_bus_vdev.a 00:01:48.319 [199/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:48.319 [200/265] Linking static target lib/librte_security.a 00:01:48.319 [201/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:48.319 [202/265] Linking static target lib/librte_mbuf.a 00:01:48.319 [203/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.576 [204/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.576 [205/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:48.576 [206/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:48.576 [207/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:48.576 [208/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:48.576 [209/265] Linking static target drivers/librte_mempool_ring.a 00:01:48.576 [210/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:48.576 [211/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:48.576 [212/265] Linking static target drivers/librte_bus_pci.a 00:01:48.576 [213/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:48.576 [214/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.576 [215/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.834 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:48.834 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.834 [218/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:48.834 [219/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:48.834 [220/265] Linking static target lib/librte_cryptodev.a 00:01:48.834 [221/265] Linking static target lib/librte_ethdev.a 00:01:48.834 [222/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.834 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.767 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.669 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:53.041 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.041 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.041 [228/265] Linking target lib/librte_eal.so.24.0 00:01:53.042 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:53.300 [230/265] Linking target lib/librte_timer.so.24.0 00:01:53.300 [231/265] Linking target lib/librte_pci.so.24.0 00:01:53.300 [232/265] Linking target lib/librte_ring.so.24.0 00:01:53.300 [233/265] Linking target lib/librte_dmadev.so.24.0 00:01:53.300 [234/265] Linking target lib/librte_meter.so.24.0 00:01:53.300 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:53.300 [236/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:53.300 [237/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:53.300 [238/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:53.300 [239/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:53.300 [240/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:53.300 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:53.300 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:53.300 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:53.558 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:53.558 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:53.558 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:53.558 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:53.558 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:53.558 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:53.558 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:53.558 [251/265] Linking target lib/librte_net.so.24.0 00:01:53.558 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:53.816 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:53.816 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:53.816 [255/265] Linking target lib/librte_security.so.24.0 00:01:53.816 [256/265] Linking target lib/librte_hash.so.24.0 00:01:53.817 [257/265] Linking target lib/librte_cmdline.so.24.0 00:01:53.817 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:54.090 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:54.090 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:54.090 [261/265] Linking target lib/librte_power.so.24.0 00:01:56.623 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:56.623 [263/265] Linking static target lib/librte_vhost.a 00:01:57.558 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.558 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:57.558 INFO: autodetecting backend as ninja 00:01:57.558 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:01:58.492 CC lib/ut/ut.o 00:01:58.492 CC lib/ut_mock/mock.o 00:01:58.492 CC lib/log/log.o 00:01:58.492 CC lib/log/log_flags.o 00:01:58.492 CC lib/log/log_deprecated.o 00:01:58.492 LIB libspdk_ut_mock.a 00:01:58.492 SO libspdk_ut_mock.so.6.0 00:01:58.492 LIB libspdk_ut.a 00:01:58.492 LIB libspdk_log.a 00:01:58.492 SO libspdk_ut.so.2.0 00:01:58.492 SO libspdk_log.so.7.0 00:01:58.771 SYMLINK libspdk_ut_mock.so 00:01:58.771 SYMLINK libspdk_ut.so 00:01:58.771 SYMLINK libspdk_log.so 00:01:58.771 CC lib/ioat/ioat.o 00:01:58.771 CC lib/dma/dma.o 00:01:58.771 CXX lib/trace_parser/trace.o 00:01:58.771 CC lib/util/base64.o 00:01:58.771 CC lib/util/bit_array.o 00:01:58.771 CC lib/util/cpuset.o 00:01:58.771 CC lib/util/crc16.o 00:01:58.771 CC lib/util/crc32.o 00:01:58.771 CC lib/util/crc32c.o 00:01:58.771 CC lib/util/crc32_ieee.o 00:01:58.771 CC lib/util/crc64.o 00:01:58.771 CC lib/util/dif.o 00:01:58.771 CC lib/util/fd.o 00:01:58.771 CC lib/util/file.o 00:01:58.771 CC lib/util/hexlify.o 00:01:58.771 CC lib/util/iov.o 00:01:58.771 CC lib/util/math.o 00:01:58.771 CC lib/util/pipe.o 00:01:58.771 CC lib/util/strerror_tls.o 00:01:58.771 CC lib/util/string.o 00:01:58.771 CC lib/util/uuid.o 00:01:58.771 CC lib/util/fd_group.o 00:01:58.771 CC lib/util/xor.o 00:01:58.771 CC lib/util/zipf.o 00:01:59.048 CC lib/vfio_user/host/vfio_user_pci.o 00:01:59.048 CC lib/vfio_user/host/vfio_user.o 00:01:59.048 LIB libspdk_dma.a 00:01:59.048 SO libspdk_dma.so.4.0 00:01:59.048 SYMLINK libspdk_dma.so 00:01:59.048 LIB libspdk_ioat.a 00:01:59.306 SO libspdk_ioat.so.7.0 00:01:59.306 SYMLINK libspdk_ioat.so 00:01:59.306 LIB libspdk_vfio_user.a 00:01:59.306 SO libspdk_vfio_user.so.5.0 00:01:59.306 SYMLINK libspdk_vfio_user.so 00:01:59.306 LIB libspdk_util.a 00:01:59.564 SO libspdk_util.so.9.0 00:01:59.564 SYMLINK libspdk_util.so 00:01:59.822 CC lib/vmd/vmd.o 00:01:59.822 CC lib/rdma/common.o 00:01:59.822 CC lib/json/json_parse.o 00:01:59.822 CC lib/env_dpdk/env.o 00:01:59.822 CC lib/conf/conf.o 00:01:59.822 CC lib/idxd/idxd.o 00:01:59.822 CC lib/vmd/led.o 00:01:59.822 CC lib/rdma/rdma_verbs.o 00:01:59.822 CC lib/json/json_util.o 00:01:59.822 CC lib/idxd/idxd_user.o 00:01:59.822 CC lib/json/json_write.o 00:01:59.822 CC lib/env_dpdk/memory.o 00:01:59.822 CC lib/env_dpdk/pci.o 00:01:59.822 CC lib/env_dpdk/init.o 00:01:59.822 CC lib/env_dpdk/threads.o 00:01:59.822 CC lib/env_dpdk/pci_ioat.o 00:01:59.822 CC lib/env_dpdk/pci_virtio.o 00:01:59.822 CC lib/env_dpdk/pci_vmd.o 00:01:59.822 CC lib/env_dpdk/pci_idxd.o 00:01:59.822 CC lib/env_dpdk/pci_event.o 00:01:59.822 CC lib/env_dpdk/sigbus_handler.o 00:01:59.822 CC lib/env_dpdk/pci_dpdk.o 00:01:59.822 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:59.822 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:59.822 LIB libspdk_trace_parser.a 00:01:59.822 SO libspdk_trace_parser.so.5.0 00:01:59.822 SYMLINK libspdk_trace_parser.so 00:02:00.080 LIB libspdk_conf.a 00:02:00.080 SO libspdk_conf.so.6.0 00:02:00.080 LIB libspdk_rdma.a 00:02:00.080 LIB libspdk_json.a 00:02:00.080 SO libspdk_rdma.so.6.0 00:02:00.080 SYMLINK libspdk_conf.so 00:02:00.080 SO libspdk_json.so.6.0 00:02:00.080 SYMLINK libspdk_rdma.so 00:02:00.080 SYMLINK libspdk_json.so 00:02:00.338 LIB libspdk_idxd.a 00:02:00.338 CC lib/jsonrpc/jsonrpc_server.o 00:02:00.338 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:00.338 CC lib/jsonrpc/jsonrpc_client.o 00:02:00.338 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:00.338 SO libspdk_idxd.so.12.0 00:02:00.338 SYMLINK libspdk_idxd.so 00:02:00.338 LIB libspdk_vmd.a 00:02:00.596 SO libspdk_vmd.so.6.0 00:02:00.596 SYMLINK libspdk_vmd.so 00:02:00.596 LIB libspdk_jsonrpc.a 00:02:00.596 SO libspdk_jsonrpc.so.6.0 00:02:00.596 SYMLINK libspdk_jsonrpc.so 00:02:00.854 CC lib/rpc/rpc.o 00:02:01.112 LIB libspdk_rpc.a 00:02:01.112 SO libspdk_rpc.so.6.0 00:02:01.112 SYMLINK libspdk_rpc.so 00:02:01.371 CC lib/keyring/keyring.o 00:02:01.371 CC lib/keyring/keyring_rpc.o 00:02:01.371 CC lib/notify/notify.o 00:02:01.371 CC lib/trace/trace.o 00:02:01.371 CC lib/notify/notify_rpc.o 00:02:01.371 CC lib/trace/trace_flags.o 00:02:01.371 CC lib/trace/trace_rpc.o 00:02:01.630 LIB libspdk_notify.a 00:02:01.630 SO libspdk_notify.so.6.0 00:02:01.630 LIB libspdk_keyring.a 00:02:01.630 LIB libspdk_trace.a 00:02:01.630 SYMLINK libspdk_notify.so 00:02:01.630 SO libspdk_keyring.so.1.0 00:02:01.630 SO libspdk_trace.so.10.0 00:02:01.630 SYMLINK libspdk_keyring.so 00:02:01.630 SYMLINK libspdk_trace.so 00:02:01.888 LIB libspdk_env_dpdk.a 00:02:01.888 SO libspdk_env_dpdk.so.14.0 00:02:01.888 CC lib/thread/thread.o 00:02:01.888 CC lib/sock/sock.o 00:02:01.888 CC lib/thread/iobuf.o 00:02:01.888 CC lib/sock/sock_rpc.o 00:02:01.888 SYMLINK libspdk_env_dpdk.so 00:02:02.146 LIB libspdk_sock.a 00:02:02.405 SO libspdk_sock.so.9.0 00:02:02.405 SYMLINK libspdk_sock.so 00:02:02.405 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:02.405 CC lib/nvme/nvme_ctrlr.o 00:02:02.405 CC lib/nvme/nvme_fabric.o 00:02:02.405 CC lib/nvme/nvme_ns_cmd.o 00:02:02.405 CC lib/nvme/nvme_ns.o 00:02:02.405 CC lib/nvme/nvme_pcie_common.o 00:02:02.405 CC lib/nvme/nvme_pcie.o 00:02:02.405 CC lib/nvme/nvme_qpair.o 00:02:02.405 CC lib/nvme/nvme.o 00:02:02.405 CC lib/nvme/nvme_quirks.o 00:02:02.405 CC lib/nvme/nvme_transport.o 00:02:02.405 CC lib/nvme/nvme_discovery.o 00:02:02.405 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:02.405 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:02.405 CC lib/nvme/nvme_tcp.o 00:02:02.405 CC lib/nvme/nvme_opal.o 00:02:02.405 CC lib/nvme/nvme_io_msg.o 00:02:02.405 CC lib/nvme/nvme_poll_group.o 00:02:02.405 CC lib/nvme/nvme_zns.o 00:02:02.405 CC lib/nvme/nvme_stubs.o 00:02:02.405 CC lib/nvme/nvme_auth.o 00:02:02.405 CC lib/nvme/nvme_cuse.o 00:02:02.405 CC lib/nvme/nvme_vfio_user.o 00:02:02.405 CC lib/nvme/nvme_rdma.o 00:02:03.340 LIB libspdk_thread.a 00:02:03.599 SO libspdk_thread.so.10.0 00:02:03.599 SYMLINK libspdk_thread.so 00:02:03.599 CC lib/blob/blobstore.o 00:02:03.599 CC lib/blob/request.o 00:02:03.599 CC lib/virtio/virtio.o 00:02:03.599 CC lib/init/json_config.o 00:02:03.599 CC lib/virtio/virtio_vhost_user.o 00:02:03.599 CC lib/blob/zeroes.o 00:02:03.599 CC lib/init/subsystem.o 00:02:03.599 CC lib/virtio/virtio_vfio_user.o 00:02:03.599 CC lib/blob/blob_bs_dev.o 00:02:03.599 CC lib/init/subsystem_rpc.o 00:02:03.599 CC lib/virtio/virtio_pci.o 00:02:03.599 CC lib/init/rpc.o 00:02:03.599 CC lib/vfu_tgt/tgt_endpoint.o 00:02:03.599 CC lib/accel/accel.o 00:02:03.599 CC lib/accel/accel_rpc.o 00:02:03.599 CC lib/vfu_tgt/tgt_rpc.o 00:02:03.599 CC lib/accel/accel_sw.o 00:02:03.857 LIB libspdk_init.a 00:02:04.115 SO libspdk_init.so.5.0 00:02:04.115 LIB libspdk_virtio.a 00:02:04.115 LIB libspdk_vfu_tgt.a 00:02:04.115 SYMLINK libspdk_init.so 00:02:04.115 SO libspdk_vfu_tgt.so.3.0 00:02:04.115 SO libspdk_virtio.so.7.0 00:02:04.115 SYMLINK libspdk_vfu_tgt.so 00:02:04.115 SYMLINK libspdk_virtio.so 00:02:04.115 CC lib/event/app.o 00:02:04.115 CC lib/event/reactor.o 00:02:04.115 CC lib/event/log_rpc.o 00:02:04.115 CC lib/event/app_rpc.o 00:02:04.115 CC lib/event/scheduler_static.o 00:02:04.681 LIB libspdk_event.a 00:02:04.681 SO libspdk_event.so.13.0 00:02:04.681 SYMLINK libspdk_event.so 00:02:04.681 LIB libspdk_accel.a 00:02:04.939 SO libspdk_accel.so.15.0 00:02:04.939 LIB libspdk_nvme.a 00:02:04.939 SYMLINK libspdk_accel.so 00:02:04.939 SO libspdk_nvme.so.13.0 00:02:04.939 CC lib/bdev/bdev.o 00:02:04.939 CC lib/bdev/bdev_rpc.o 00:02:04.939 CC lib/bdev/bdev_zone.o 00:02:04.939 CC lib/bdev/part.o 00:02:04.939 CC lib/bdev/scsi_nvme.o 00:02:05.199 SYMLINK libspdk_nvme.so 00:02:06.577 LIB libspdk_blob.a 00:02:06.577 SO libspdk_blob.so.11.0 00:02:06.836 SYMLINK libspdk_blob.so 00:02:06.836 CC lib/lvol/lvol.o 00:02:06.836 CC lib/blobfs/blobfs.o 00:02:06.836 CC lib/blobfs/tree.o 00:02:07.769 LIB libspdk_bdev.a 00:02:07.769 LIB libspdk_blobfs.a 00:02:07.769 SO libspdk_bdev.so.15.0 00:02:07.769 SO libspdk_blobfs.so.10.0 00:02:07.769 LIB libspdk_lvol.a 00:02:07.769 SO libspdk_lvol.so.10.0 00:02:07.769 SYMLINK libspdk_blobfs.so 00:02:07.769 SYMLINK libspdk_bdev.so 00:02:07.769 SYMLINK libspdk_lvol.so 00:02:08.035 CC lib/ublk/ublk.o 00:02:08.035 CC lib/nvmf/ctrlr.o 00:02:08.035 CC lib/ublk/ublk_rpc.o 00:02:08.035 CC lib/nbd/nbd.o 00:02:08.035 CC lib/nvmf/ctrlr_discovery.o 00:02:08.035 CC lib/scsi/dev.o 00:02:08.035 CC lib/nvmf/ctrlr_bdev.o 00:02:08.035 CC lib/nbd/nbd_rpc.o 00:02:08.035 CC lib/scsi/lun.o 00:02:08.035 CC lib/ftl/ftl_core.o 00:02:08.035 CC lib/nvmf/subsystem.o 00:02:08.035 CC lib/scsi/port.o 00:02:08.035 CC lib/ftl/ftl_init.o 00:02:08.035 CC lib/nvmf/nvmf.o 00:02:08.035 CC lib/scsi/scsi.o 00:02:08.035 CC lib/ftl/ftl_layout.o 00:02:08.035 CC lib/scsi/scsi_bdev.o 00:02:08.035 CC lib/nvmf/nvmf_rpc.o 00:02:08.035 CC lib/ftl/ftl_debug.o 00:02:08.035 CC lib/scsi/scsi_pr.o 00:02:08.035 CC lib/scsi/scsi_rpc.o 00:02:08.035 CC lib/scsi/task.o 00:02:08.035 CC lib/nvmf/transport.o 00:02:08.035 CC lib/ftl/ftl_io.o 00:02:08.035 CC lib/ftl/ftl_l2p.o 00:02:08.035 CC lib/nvmf/tcp.o 00:02:08.035 CC lib/ftl/ftl_sb.o 00:02:08.035 CC lib/nvmf/vfio_user.o 00:02:08.035 CC lib/nvmf/rdma.o 00:02:08.035 CC lib/ftl/ftl_l2p_flat.o 00:02:08.035 CC lib/ftl/ftl_nv_cache.o 00:02:08.035 CC lib/ftl/ftl_band.o 00:02:08.035 CC lib/ftl/ftl_band_ops.o 00:02:08.035 CC lib/ftl/ftl_writer.o 00:02:08.035 CC lib/ftl/ftl_rq.o 00:02:08.035 CC lib/ftl/ftl_reloc.o 00:02:08.035 CC lib/ftl/ftl_l2p_cache.o 00:02:08.035 CC lib/ftl/ftl_p2l.o 00:02:08.035 CC lib/ftl/mngt/ftl_mngt.o 00:02:08.035 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:08.035 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:08.035 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:08.035 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:08.035 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:08.035 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:08.035 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:08.035 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:08.035 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:08.294 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:08.294 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:08.294 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:08.294 CC lib/ftl/utils/ftl_conf.o 00:02:08.294 CC lib/ftl/utils/ftl_md.o 00:02:08.294 CC lib/ftl/utils/ftl_mempool.o 00:02:08.294 CC lib/ftl/utils/ftl_bitmap.o 00:02:08.554 CC lib/ftl/utils/ftl_property.o 00:02:08.554 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:08.554 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:08.554 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:08.554 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:08.554 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:08.554 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:08.554 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:08.554 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:08.554 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:08.554 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:08.554 CC lib/ftl/base/ftl_base_dev.o 00:02:08.554 CC lib/ftl/base/ftl_base_bdev.o 00:02:08.554 CC lib/ftl/ftl_trace.o 00:02:08.815 LIB libspdk_nbd.a 00:02:08.815 SO libspdk_nbd.so.7.0 00:02:08.815 SYMLINK libspdk_nbd.so 00:02:08.815 LIB libspdk_scsi.a 00:02:09.075 SO libspdk_scsi.so.9.0 00:02:09.075 LIB libspdk_ublk.a 00:02:09.075 SO libspdk_ublk.so.3.0 00:02:09.075 SYMLINK libspdk_scsi.so 00:02:09.075 SYMLINK libspdk_ublk.so 00:02:09.332 CC lib/iscsi/conn.o 00:02:09.333 CC lib/vhost/vhost.o 00:02:09.333 CC lib/vhost/vhost_rpc.o 00:02:09.333 CC lib/iscsi/init_grp.o 00:02:09.333 CC lib/iscsi/iscsi.o 00:02:09.333 CC lib/vhost/vhost_scsi.o 00:02:09.333 CC lib/iscsi/md5.o 00:02:09.333 CC lib/vhost/vhost_blk.o 00:02:09.333 CC lib/iscsi/param.o 00:02:09.333 CC lib/vhost/rte_vhost_user.o 00:02:09.333 CC lib/iscsi/portal_grp.o 00:02:09.333 CC lib/iscsi/tgt_node.o 00:02:09.333 CC lib/iscsi/iscsi_subsystem.o 00:02:09.333 CC lib/iscsi/iscsi_rpc.o 00:02:09.333 CC lib/iscsi/task.o 00:02:09.333 LIB libspdk_ftl.a 00:02:09.590 SO libspdk_ftl.so.9.0 00:02:09.848 SYMLINK libspdk_ftl.so 00:02:10.413 LIB libspdk_vhost.a 00:02:10.413 SO libspdk_vhost.so.8.0 00:02:10.671 LIB libspdk_nvmf.a 00:02:10.671 SYMLINK libspdk_vhost.so 00:02:10.671 SO libspdk_nvmf.so.18.0 00:02:10.671 LIB libspdk_iscsi.a 00:02:10.671 SO libspdk_iscsi.so.8.0 00:02:10.671 SYMLINK libspdk_nvmf.so 00:02:10.929 SYMLINK libspdk_iscsi.so 00:02:11.187 CC module/env_dpdk/env_dpdk_rpc.o 00:02:11.187 CC module/vfu_device/vfu_virtio.o 00:02:11.187 CC module/vfu_device/vfu_virtio_blk.o 00:02:11.187 CC module/vfu_device/vfu_virtio_scsi.o 00:02:11.187 CC module/vfu_device/vfu_virtio_rpc.o 00:02:11.187 CC module/accel/error/accel_error.o 00:02:11.187 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:11.187 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:11.187 CC module/blob/bdev/blob_bdev.o 00:02:11.187 CC module/accel/error/accel_error_rpc.o 00:02:11.187 CC module/keyring/file/keyring.o 00:02:11.187 CC module/sock/posix/posix.o 00:02:11.187 CC module/keyring/file/keyring_rpc.o 00:02:11.187 CC module/accel/dsa/accel_dsa.o 00:02:11.187 CC module/accel/iaa/accel_iaa.o 00:02:11.187 CC module/accel/dsa/accel_dsa_rpc.o 00:02:11.187 CC module/accel/iaa/accel_iaa_rpc.o 00:02:11.187 CC module/scheduler/gscheduler/gscheduler.o 00:02:11.187 CC module/accel/ioat/accel_ioat.o 00:02:11.187 CC module/accel/ioat/accel_ioat_rpc.o 00:02:11.187 LIB libspdk_env_dpdk_rpc.a 00:02:11.187 SO libspdk_env_dpdk_rpc.so.6.0 00:02:11.446 SYMLINK libspdk_env_dpdk_rpc.so 00:02:11.446 LIB libspdk_keyring_file.a 00:02:11.446 LIB libspdk_scheduler_gscheduler.a 00:02:11.446 LIB libspdk_scheduler_dpdk_governor.a 00:02:11.446 SO libspdk_scheduler_gscheduler.so.4.0 00:02:11.446 SO libspdk_keyring_file.so.1.0 00:02:11.446 LIB libspdk_accel_error.a 00:02:11.446 SO libspdk_scheduler_dpdk_governor.so.4.0 00:02:11.446 LIB libspdk_accel_ioat.a 00:02:11.446 LIB libspdk_scheduler_dynamic.a 00:02:11.446 SO libspdk_accel_error.so.2.0 00:02:11.446 LIB libspdk_accel_iaa.a 00:02:11.446 SO libspdk_scheduler_dynamic.so.4.0 00:02:11.446 SO libspdk_accel_ioat.so.6.0 00:02:11.446 SYMLINK libspdk_scheduler_gscheduler.so 00:02:11.446 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:11.446 SYMLINK libspdk_keyring_file.so 00:02:11.446 SO libspdk_accel_iaa.so.3.0 00:02:11.446 LIB libspdk_accel_dsa.a 00:02:11.446 SYMLINK libspdk_accel_error.so 00:02:11.446 LIB libspdk_blob_bdev.a 00:02:11.446 SYMLINK libspdk_scheduler_dynamic.so 00:02:11.446 SO libspdk_accel_dsa.so.5.0 00:02:11.446 SYMLINK libspdk_accel_ioat.so 00:02:11.446 SYMLINK libspdk_accel_iaa.so 00:02:11.446 SO libspdk_blob_bdev.so.11.0 00:02:11.446 SYMLINK libspdk_accel_dsa.so 00:02:11.446 SYMLINK libspdk_blob_bdev.so 00:02:11.710 LIB libspdk_vfu_device.a 00:02:11.711 SO libspdk_vfu_device.so.3.0 00:02:11.711 CC module/bdev/error/vbdev_error.o 00:02:11.711 CC module/bdev/delay/vbdev_delay.o 00:02:11.711 CC module/bdev/null/bdev_null.o 00:02:11.711 CC module/blobfs/bdev/blobfs_bdev.o 00:02:11.711 CC module/bdev/error/vbdev_error_rpc.o 00:02:11.711 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:11.711 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:11.711 CC module/bdev/null/bdev_null_rpc.o 00:02:11.711 CC module/bdev/gpt/gpt.o 00:02:11.711 CC module/bdev/gpt/vbdev_gpt.o 00:02:11.711 CC module/bdev/lvol/vbdev_lvol.o 00:02:11.711 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:11.711 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:11.711 CC module/bdev/iscsi/bdev_iscsi.o 00:02:11.711 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:11.711 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:11.711 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:11.711 CC module/bdev/passthru/vbdev_passthru.o 00:02:11.711 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:11.711 CC module/bdev/malloc/bdev_malloc.o 00:02:11.711 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:11.711 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:11.711 CC module/bdev/split/vbdev_split.o 00:02:11.711 CC module/bdev/nvme/bdev_nvme.o 00:02:11.711 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:11.711 CC module/bdev/split/vbdev_split_rpc.o 00:02:11.711 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:11.711 CC module/bdev/nvme/nvme_rpc.o 00:02:11.711 CC module/bdev/aio/bdev_aio.o 00:02:11.711 CC module/bdev/nvme/bdev_mdns_client.o 00:02:11.711 CC module/bdev/aio/bdev_aio_rpc.o 00:02:11.711 CC module/bdev/nvme/vbdev_opal.o 00:02:11.711 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:11.711 CC module/bdev/raid/bdev_raid.o 00:02:11.711 CC module/bdev/raid/bdev_raid_rpc.o 00:02:11.711 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:11.711 CC module/bdev/ftl/bdev_ftl.o 00:02:11.711 CC module/bdev/raid/bdev_raid_sb.o 00:02:11.711 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:11.711 CC module/bdev/raid/raid0.o 00:02:11.711 CC module/bdev/raid/raid1.o 00:02:11.711 CC module/bdev/raid/concat.o 00:02:11.969 SYMLINK libspdk_vfu_device.so 00:02:11.969 LIB libspdk_sock_posix.a 00:02:12.227 SO libspdk_sock_posix.so.6.0 00:02:12.227 LIB libspdk_blobfs_bdev.a 00:02:12.227 SYMLINK libspdk_sock_posix.so 00:02:12.227 SO libspdk_blobfs_bdev.so.6.0 00:02:12.227 LIB libspdk_bdev_split.a 00:02:12.227 LIB libspdk_bdev_null.a 00:02:12.227 SYMLINK libspdk_blobfs_bdev.so 00:02:12.227 SO libspdk_bdev_split.so.6.0 00:02:12.227 LIB libspdk_bdev_error.a 00:02:12.227 SO libspdk_bdev_null.so.6.0 00:02:12.227 LIB libspdk_bdev_malloc.a 00:02:12.227 LIB libspdk_bdev_aio.a 00:02:12.227 SO libspdk_bdev_error.so.6.0 00:02:12.227 LIB libspdk_bdev_gpt.a 00:02:12.227 SYMLINK libspdk_bdev_split.so 00:02:12.227 SO libspdk_bdev_aio.so.6.0 00:02:12.227 SO libspdk_bdev_malloc.so.6.0 00:02:12.227 SO libspdk_bdev_gpt.so.6.0 00:02:12.227 SYMLINK libspdk_bdev_null.so 00:02:12.227 LIB libspdk_bdev_ftl.a 00:02:12.484 LIB libspdk_bdev_passthru.a 00:02:12.484 SYMLINK libspdk_bdev_error.so 00:02:12.484 LIB libspdk_bdev_zone_block.a 00:02:12.484 LIB libspdk_bdev_iscsi.a 00:02:12.484 SO libspdk_bdev_ftl.so.6.0 00:02:12.484 SO libspdk_bdev_passthru.so.6.0 00:02:12.484 SYMLINK libspdk_bdev_aio.so 00:02:12.484 SYMLINK libspdk_bdev_malloc.so 00:02:12.484 SO libspdk_bdev_zone_block.so.6.0 00:02:12.484 SYMLINK libspdk_bdev_gpt.so 00:02:12.484 SO libspdk_bdev_iscsi.so.6.0 00:02:12.484 LIB libspdk_bdev_delay.a 00:02:12.484 SYMLINK libspdk_bdev_ftl.so 00:02:12.484 SYMLINK libspdk_bdev_passthru.so 00:02:12.484 LIB libspdk_bdev_virtio.a 00:02:12.484 SYMLINK libspdk_bdev_zone_block.so 00:02:12.485 SO libspdk_bdev_delay.so.6.0 00:02:12.485 SYMLINK libspdk_bdev_iscsi.so 00:02:12.485 SO libspdk_bdev_virtio.so.6.0 00:02:12.485 SYMLINK libspdk_bdev_delay.so 00:02:12.485 LIB libspdk_bdev_lvol.a 00:02:12.485 SYMLINK libspdk_bdev_virtio.so 00:02:12.485 SO libspdk_bdev_lvol.so.6.0 00:02:12.742 SYMLINK libspdk_bdev_lvol.so 00:02:13.000 LIB libspdk_bdev_raid.a 00:02:13.000 SO libspdk_bdev_raid.so.6.0 00:02:13.000 SYMLINK libspdk_bdev_raid.so 00:02:14.433 LIB libspdk_bdev_nvme.a 00:02:14.433 SO libspdk_bdev_nvme.so.7.0 00:02:14.433 SYMLINK libspdk_bdev_nvme.so 00:02:14.691 CC module/event/subsystems/iobuf/iobuf.o 00:02:14.691 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:14.691 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:14.691 CC module/event/subsystems/vmd/vmd.o 00:02:14.691 CC module/event/subsystems/scheduler/scheduler.o 00:02:14.691 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:14.691 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:02:14.691 CC module/event/subsystems/keyring/keyring.o 00:02:14.691 CC module/event/subsystems/sock/sock.o 00:02:14.691 LIB libspdk_event_keyring.a 00:02:14.691 LIB libspdk_event_sock.a 00:02:14.691 LIB libspdk_event_scheduler.a 00:02:14.691 LIB libspdk_event_vhost_blk.a 00:02:14.691 LIB libspdk_event_vfu_tgt.a 00:02:14.691 LIB libspdk_event_vmd.a 00:02:14.950 LIB libspdk_event_iobuf.a 00:02:14.950 SO libspdk_event_scheduler.so.4.0 00:02:14.950 SO libspdk_event_vfu_tgt.so.3.0 00:02:14.950 SO libspdk_event_keyring.so.1.0 00:02:14.950 SO libspdk_event_sock.so.5.0 00:02:14.950 SO libspdk_event_vhost_blk.so.3.0 00:02:14.950 SO libspdk_event_vmd.so.6.0 00:02:14.950 SO libspdk_event_iobuf.so.3.0 00:02:14.950 SYMLINK libspdk_event_sock.so 00:02:14.950 SYMLINK libspdk_event_scheduler.so 00:02:14.950 SYMLINK libspdk_event_vfu_tgt.so 00:02:14.950 SYMLINK libspdk_event_vhost_blk.so 00:02:14.950 SYMLINK libspdk_event_keyring.so 00:02:14.950 SYMLINK libspdk_event_vmd.so 00:02:14.950 SYMLINK libspdk_event_iobuf.so 00:02:14.950 CC module/event/subsystems/accel/accel.o 00:02:15.208 LIB libspdk_event_accel.a 00:02:15.208 SO libspdk_event_accel.so.6.0 00:02:15.208 SYMLINK libspdk_event_accel.so 00:02:15.466 CC module/event/subsystems/bdev/bdev.o 00:02:15.724 LIB libspdk_event_bdev.a 00:02:15.724 SO libspdk_event_bdev.so.6.0 00:02:15.724 SYMLINK libspdk_event_bdev.so 00:02:15.982 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:15.982 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:15.982 CC module/event/subsystems/scsi/scsi.o 00:02:15.982 CC module/event/subsystems/nbd/nbd.o 00:02:15.982 CC module/event/subsystems/ublk/ublk.o 00:02:15.982 LIB libspdk_event_nbd.a 00:02:15.982 LIB libspdk_event_ublk.a 00:02:15.982 LIB libspdk_event_scsi.a 00:02:15.982 SO libspdk_event_nbd.so.6.0 00:02:15.982 SO libspdk_event_ublk.so.3.0 00:02:15.982 SO libspdk_event_scsi.so.6.0 00:02:15.982 SYMLINK libspdk_event_nbd.so 00:02:15.982 SYMLINK libspdk_event_ublk.so 00:02:16.240 SYMLINK libspdk_event_scsi.so 00:02:16.240 LIB libspdk_event_nvmf.a 00:02:16.240 SO libspdk_event_nvmf.so.6.0 00:02:16.240 SYMLINK libspdk_event_nvmf.so 00:02:16.240 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:16.240 CC module/event/subsystems/iscsi/iscsi.o 00:02:16.499 LIB libspdk_event_vhost_scsi.a 00:02:16.499 SO libspdk_event_vhost_scsi.so.3.0 00:02:16.499 LIB libspdk_event_iscsi.a 00:02:16.499 SO libspdk_event_iscsi.so.6.0 00:02:16.499 SYMLINK libspdk_event_vhost_scsi.so 00:02:16.499 SYMLINK libspdk_event_iscsi.so 00:02:16.760 SO libspdk.so.6.0 00:02:16.760 SYMLINK libspdk.so 00:02:16.760 CC app/trace_record/trace_record.o 00:02:17.019 CXX app/trace/trace.o 00:02:17.019 CC app/spdk_nvme_perf/perf.o 00:02:17.019 CC app/spdk_top/spdk_top.o 00:02:17.019 TEST_HEADER include/spdk/accel.h 00:02:17.019 CC app/spdk_lspci/spdk_lspci.o 00:02:17.019 CC test/rpc_client/rpc_client_test.o 00:02:17.019 CC app/spdk_nvme_identify/identify.o 00:02:17.019 TEST_HEADER include/spdk/accel_module.h 00:02:17.019 CC app/spdk_nvme_discover/discovery_aer.o 00:02:17.019 TEST_HEADER include/spdk/assert.h 00:02:17.019 TEST_HEADER include/spdk/barrier.h 00:02:17.019 TEST_HEADER include/spdk/base64.h 00:02:17.019 TEST_HEADER include/spdk/bdev.h 00:02:17.019 TEST_HEADER include/spdk/bdev_module.h 00:02:17.019 TEST_HEADER include/spdk/bdev_zone.h 00:02:17.019 TEST_HEADER include/spdk/bit_array.h 00:02:17.019 TEST_HEADER include/spdk/bit_pool.h 00:02:17.019 TEST_HEADER include/spdk/blob_bdev.h 00:02:17.019 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:17.019 TEST_HEADER include/spdk/blobfs.h 00:02:17.019 TEST_HEADER include/spdk/blob.h 00:02:17.019 TEST_HEADER include/spdk/conf.h 00:02:17.019 TEST_HEADER include/spdk/config.h 00:02:17.019 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:17.019 CC app/spdk_dd/spdk_dd.o 00:02:17.019 CC app/nvmf_tgt/nvmf_main.o 00:02:17.019 TEST_HEADER include/spdk/cpuset.h 00:02:17.019 TEST_HEADER include/spdk/crc16.h 00:02:17.019 TEST_HEADER include/spdk/crc32.h 00:02:17.019 CC app/iscsi_tgt/iscsi_tgt.o 00:02:17.019 TEST_HEADER include/spdk/crc64.h 00:02:17.019 TEST_HEADER include/spdk/dif.h 00:02:17.019 TEST_HEADER include/spdk/dma.h 00:02:17.019 CC app/vhost/vhost.o 00:02:17.019 TEST_HEADER include/spdk/endian.h 00:02:17.019 TEST_HEADER include/spdk/env_dpdk.h 00:02:17.019 TEST_HEADER include/spdk/env.h 00:02:17.019 TEST_HEADER include/spdk/event.h 00:02:17.019 TEST_HEADER include/spdk/fd_group.h 00:02:17.019 TEST_HEADER include/spdk/fd.h 00:02:17.019 TEST_HEADER include/spdk/file.h 00:02:17.019 TEST_HEADER include/spdk/ftl.h 00:02:17.019 TEST_HEADER include/spdk/gpt_spec.h 00:02:17.019 TEST_HEADER include/spdk/hexlify.h 00:02:17.019 CC app/spdk_tgt/spdk_tgt.o 00:02:17.019 TEST_HEADER include/spdk/histogram_data.h 00:02:17.019 TEST_HEADER include/spdk/idxd.h 00:02:17.019 CC examples/vmd/lsvmd/lsvmd.o 00:02:17.019 CC test/env/pci/pci_ut.o 00:02:17.019 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:17.019 TEST_HEADER include/spdk/idxd_spec.h 00:02:17.019 CC examples/accel/perf/accel_perf.o 00:02:17.019 CC examples/sock/hello_world/hello_sock.o 00:02:17.019 TEST_HEADER include/spdk/init.h 00:02:17.019 CC examples/util/zipf/zipf.o 00:02:17.019 CC test/app/histogram_perf/histogram_perf.o 00:02:17.019 CC test/env/memory/memory_ut.o 00:02:17.019 CC test/nvme/aer/aer.o 00:02:17.019 TEST_HEADER include/spdk/ioat.h 00:02:17.019 CC test/env/vtophys/vtophys.o 00:02:17.019 CC examples/ioat/verify/verify.o 00:02:17.019 CC examples/nvme/hello_world/hello_world.o 00:02:17.019 TEST_HEADER include/spdk/ioat_spec.h 00:02:17.019 CC examples/vmd/led/led.o 00:02:17.019 TEST_HEADER include/spdk/iscsi_spec.h 00:02:17.019 CC test/event/event_perf/event_perf.o 00:02:17.019 CC examples/ioat/perf/perf.o 00:02:17.019 CC examples/idxd/perf/perf.o 00:02:17.019 CC app/fio/nvme/fio_plugin.o 00:02:17.019 TEST_HEADER include/spdk/json.h 00:02:17.019 TEST_HEADER include/spdk/jsonrpc.h 00:02:17.019 CC test/thread/poller_perf/poller_perf.o 00:02:17.019 CC examples/nvme/reconnect/reconnect.o 00:02:17.019 TEST_HEADER include/spdk/keyring.h 00:02:17.019 TEST_HEADER include/spdk/keyring_module.h 00:02:17.019 TEST_HEADER include/spdk/likely.h 00:02:17.019 TEST_HEADER include/spdk/log.h 00:02:17.019 TEST_HEADER include/spdk/lvol.h 00:02:17.019 TEST_HEADER include/spdk/memory.h 00:02:17.019 TEST_HEADER include/spdk/mmio.h 00:02:17.019 TEST_HEADER include/spdk/nbd.h 00:02:17.019 CC examples/bdev/hello_world/hello_bdev.o 00:02:17.019 CC test/bdev/bdevio/bdevio.o 00:02:17.019 TEST_HEADER include/spdk/notify.h 00:02:17.019 CC examples/bdev/bdevperf/bdevperf.o 00:02:17.019 TEST_HEADER include/spdk/nvme.h 00:02:17.019 TEST_HEADER include/spdk/nvme_intel.h 00:02:17.019 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:17.019 CC examples/blob/hello_world/hello_blob.o 00:02:17.019 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:17.019 TEST_HEADER include/spdk/nvme_spec.h 00:02:17.019 CC test/blobfs/mkfs/mkfs.o 00:02:17.019 CC examples/blob/cli/blobcli.o 00:02:17.019 TEST_HEADER include/spdk/nvme_zns.h 00:02:17.019 CC examples/nvmf/nvmf/nvmf.o 00:02:17.019 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:17.019 CC test/dma/test_dma/test_dma.o 00:02:17.019 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:17.019 CC test/accel/dif/dif.o 00:02:17.019 CC test/app/bdev_svc/bdev_svc.o 00:02:17.282 TEST_HEADER include/spdk/nvmf.h 00:02:17.282 CC examples/thread/thread/thread_ex.o 00:02:17.282 TEST_HEADER include/spdk/nvmf_spec.h 00:02:17.282 TEST_HEADER include/spdk/nvmf_transport.h 00:02:17.282 TEST_HEADER include/spdk/opal.h 00:02:17.282 TEST_HEADER include/spdk/opal_spec.h 00:02:17.282 TEST_HEADER include/spdk/pci_ids.h 00:02:17.282 TEST_HEADER include/spdk/pipe.h 00:02:17.282 TEST_HEADER include/spdk/queue.h 00:02:17.282 TEST_HEADER include/spdk/reduce.h 00:02:17.282 TEST_HEADER include/spdk/rpc.h 00:02:17.282 TEST_HEADER include/spdk/scheduler.h 00:02:17.282 TEST_HEADER include/spdk/scsi.h 00:02:17.282 TEST_HEADER include/spdk/scsi_spec.h 00:02:17.282 TEST_HEADER include/spdk/sock.h 00:02:17.282 CC test/env/mem_callbacks/mem_callbacks.o 00:02:17.282 TEST_HEADER include/spdk/stdinc.h 00:02:17.282 LINK spdk_lspci 00:02:17.282 TEST_HEADER include/spdk/string.h 00:02:17.282 CC test/lvol/esnap/esnap.o 00:02:17.282 TEST_HEADER include/spdk/thread.h 00:02:17.282 TEST_HEADER include/spdk/trace.h 00:02:17.282 TEST_HEADER include/spdk/trace_parser.h 00:02:17.282 TEST_HEADER include/spdk/tree.h 00:02:17.282 TEST_HEADER include/spdk/ublk.h 00:02:17.282 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:17.282 TEST_HEADER include/spdk/util.h 00:02:17.282 TEST_HEADER include/spdk/uuid.h 00:02:17.282 TEST_HEADER include/spdk/version.h 00:02:17.282 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:17.282 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:17.282 TEST_HEADER include/spdk/vhost.h 00:02:17.282 TEST_HEADER include/spdk/vmd.h 00:02:17.282 TEST_HEADER include/spdk/xor.h 00:02:17.282 TEST_HEADER include/spdk/zipf.h 00:02:17.282 CXX test/cpp_headers/accel.o 00:02:17.282 LINK rpc_client_test 00:02:17.282 LINK spdk_nvme_discover 00:02:17.282 LINK lsvmd 00:02:17.282 LINK interrupt_tgt 00:02:17.282 LINK nvmf_tgt 00:02:17.282 LINK vtophys 00:02:17.282 LINK zipf 00:02:17.282 LINK histogram_perf 00:02:17.282 LINK event_perf 00:02:17.282 LINK led 00:02:17.282 LINK spdk_trace_record 00:02:17.282 LINK poller_perf 00:02:17.282 LINK env_dpdk_post_init 00:02:17.282 LINK vhost 00:02:17.547 LINK iscsi_tgt 00:02:17.547 LINK spdk_tgt 00:02:17.547 LINK verify 00:02:17.547 LINK hello_world 00:02:17.547 LINK hello_sock 00:02:17.547 LINK mkfs 00:02:17.547 LINK ioat_perf 00:02:17.547 LINK bdev_svc 00:02:17.547 LINK hello_bdev 00:02:17.547 LINK aer 00:02:17.547 CXX test/cpp_headers/accel_module.o 00:02:17.547 LINK hello_blob 00:02:17.810 LINK thread 00:02:17.810 LINK nvmf 00:02:17.810 LINK idxd_perf 00:02:17.810 LINK spdk_dd 00:02:17.810 LINK reconnect 00:02:17.810 LINK spdk_trace 00:02:17.810 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:17.810 CXX test/cpp_headers/assert.o 00:02:17.810 LINK pci_ut 00:02:17.810 LINK bdevio 00:02:17.810 CC test/event/reactor/reactor.o 00:02:17.810 LINK dif 00:02:17.810 CXX test/cpp_headers/barrier.o 00:02:17.810 LINK test_dma 00:02:17.810 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:17.810 CXX test/cpp_headers/base64.o 00:02:18.076 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:18.076 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:18.076 CC test/nvme/reset/reset.o 00:02:18.076 CC examples/nvme/hotplug/hotplug.o 00:02:18.076 CC test/app/jsoncat/jsoncat.o 00:02:18.076 LINK nvme_fuzz 00:02:18.076 CC test/nvme/sgl/sgl.o 00:02:18.076 CC examples/nvme/arbitration/arbitration.o 00:02:18.076 CXX test/cpp_headers/bdev.o 00:02:18.076 CC test/app/stub/stub.o 00:02:18.076 CC test/nvme/e2edp/nvme_dp.o 00:02:18.076 LINK accel_perf 00:02:18.076 CC app/fio/bdev/fio_plugin.o 00:02:18.076 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:18.076 CC examples/nvme/abort/abort.o 00:02:18.076 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:18.076 LINK spdk_nvme 00:02:18.076 CXX test/cpp_headers/bdev_module.o 00:02:18.076 LINK blobcli 00:02:18.076 LINK reactor 00:02:18.337 CC test/nvme/overhead/overhead.o 00:02:18.337 CC test/event/reactor_perf/reactor_perf.o 00:02:18.337 CC test/nvme/err_injection/err_injection.o 00:02:18.337 CXX test/cpp_headers/bdev_zone.o 00:02:18.337 CC test/nvme/startup/startup.o 00:02:18.337 CC test/nvme/reserve/reserve.o 00:02:18.337 CXX test/cpp_headers/bit_array.o 00:02:18.337 CXX test/cpp_headers/bit_pool.o 00:02:18.337 CC test/event/app_repeat/app_repeat.o 00:02:18.338 CC test/nvme/simple_copy/simple_copy.o 00:02:18.338 LINK jsoncat 00:02:18.338 CC test/event/scheduler/scheduler.o 00:02:18.338 CC test/nvme/connect_stress/connect_stress.o 00:02:18.338 CXX test/cpp_headers/blob_bdev.o 00:02:18.338 CXX test/cpp_headers/blobfs_bdev.o 00:02:18.338 CC test/nvme/boot_partition/boot_partition.o 00:02:18.338 CC test/nvme/compliance/nvme_compliance.o 00:02:18.338 CC test/nvme/fused_ordering/fused_ordering.o 00:02:18.338 LINK stub 00:02:18.338 CXX test/cpp_headers/blobfs.o 00:02:18.338 CXX test/cpp_headers/blob.o 00:02:18.338 LINK mem_callbacks 00:02:18.600 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:18.600 CXX test/cpp_headers/conf.o 00:02:18.600 LINK spdk_nvme_perf 00:02:18.600 LINK cmb_copy 00:02:18.600 CXX test/cpp_headers/config.o 00:02:18.600 LINK hotplug 00:02:18.600 LINK pmr_persistence 00:02:18.600 CXX test/cpp_headers/cpuset.o 00:02:18.600 LINK reactor_perf 00:02:18.600 CC test/nvme/fdp/fdp.o 00:02:18.600 CXX test/cpp_headers/crc16.o 00:02:18.600 CC test/nvme/cuse/cuse.o 00:02:18.600 LINK reset 00:02:18.600 LINK sgl 00:02:18.600 CXX test/cpp_headers/crc32.o 00:02:18.600 LINK startup 00:02:18.600 LINK bdevperf 00:02:18.600 LINK nvme_dp 00:02:18.600 LINK err_injection 00:02:18.600 CXX test/cpp_headers/crc64.o 00:02:18.600 CXX test/cpp_headers/dif.o 00:02:18.600 LINK spdk_top 00:02:18.600 LINK app_repeat 00:02:18.600 CXX test/cpp_headers/dma.o 00:02:18.600 CXX test/cpp_headers/endian.o 00:02:18.600 LINK arbitration 00:02:18.600 CXX test/cpp_headers/env_dpdk.o 00:02:18.862 LINK reserve 00:02:18.862 CXX test/cpp_headers/env.o 00:02:18.863 LINK connect_stress 00:02:18.863 LINK spdk_nvme_identify 00:02:18.863 LINK boot_partition 00:02:18.863 LINK overhead 00:02:18.863 LINK vhost_fuzz 00:02:18.863 CXX test/cpp_headers/event.o 00:02:18.863 LINK simple_copy 00:02:18.863 CXX test/cpp_headers/fd_group.o 00:02:18.863 CXX test/cpp_headers/fd.o 00:02:18.863 CXX test/cpp_headers/file.o 00:02:18.863 CXX test/cpp_headers/ftl.o 00:02:18.863 LINK memory_ut 00:02:18.863 CXX test/cpp_headers/gpt_spec.o 00:02:18.863 LINK fused_ordering 00:02:18.863 LINK scheduler 00:02:18.863 CXX test/cpp_headers/hexlify.o 00:02:18.863 LINK nvme_manage 00:02:18.863 LINK doorbell_aers 00:02:18.863 CXX test/cpp_headers/histogram_data.o 00:02:18.863 CXX test/cpp_headers/idxd.o 00:02:18.863 LINK abort 00:02:18.863 CXX test/cpp_headers/idxd_spec.o 00:02:18.863 CXX test/cpp_headers/init.o 00:02:18.863 CXX test/cpp_headers/ioat.o 00:02:18.863 CXX test/cpp_headers/ioat_spec.o 00:02:18.863 CXX test/cpp_headers/iscsi_spec.o 00:02:18.863 CXX test/cpp_headers/json.o 00:02:18.863 CXX test/cpp_headers/jsonrpc.o 00:02:18.863 CXX test/cpp_headers/keyring.o 00:02:19.122 CXX test/cpp_headers/keyring_module.o 00:02:19.122 CXX test/cpp_headers/likely.o 00:02:19.122 CXX test/cpp_headers/log.o 00:02:19.122 CXX test/cpp_headers/lvol.o 00:02:19.122 CXX test/cpp_headers/memory.o 00:02:19.122 CXX test/cpp_headers/mmio.o 00:02:19.122 CXX test/cpp_headers/nbd.o 00:02:19.122 LINK spdk_bdev 00:02:19.122 CXX test/cpp_headers/notify.o 00:02:19.122 CXX test/cpp_headers/nvme.o 00:02:19.122 LINK nvme_compliance 00:02:19.122 CXX test/cpp_headers/nvme_intel.o 00:02:19.122 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:19.122 CXX test/cpp_headers/nvme_spec.o 00:02:19.122 CXX test/cpp_headers/nvme_ocssd.o 00:02:19.122 CXX test/cpp_headers/nvme_zns.o 00:02:19.122 CXX test/cpp_headers/nvmf_cmd.o 00:02:19.122 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:19.122 CXX test/cpp_headers/nvmf.o 00:02:19.122 CXX test/cpp_headers/nvmf_spec.o 00:02:19.122 LINK fdp 00:02:19.122 CXX test/cpp_headers/nvmf_transport.o 00:02:19.122 CXX test/cpp_headers/opal.o 00:02:19.122 CXX test/cpp_headers/opal_spec.o 00:02:19.122 CXX test/cpp_headers/pci_ids.o 00:02:19.122 CXX test/cpp_headers/pipe.o 00:02:19.122 CXX test/cpp_headers/queue.o 00:02:19.385 CXX test/cpp_headers/reduce.o 00:02:19.385 CXX test/cpp_headers/rpc.o 00:02:19.385 CXX test/cpp_headers/scheduler.o 00:02:19.385 CXX test/cpp_headers/scsi.o 00:02:19.385 CXX test/cpp_headers/scsi_spec.o 00:02:19.385 CXX test/cpp_headers/sock.o 00:02:19.385 CXX test/cpp_headers/stdinc.o 00:02:19.385 CXX test/cpp_headers/string.o 00:02:19.385 CXX test/cpp_headers/thread.o 00:02:19.385 CXX test/cpp_headers/trace.o 00:02:19.385 CXX test/cpp_headers/trace_parser.o 00:02:19.385 CXX test/cpp_headers/tree.o 00:02:19.385 CXX test/cpp_headers/ublk.o 00:02:19.385 CXX test/cpp_headers/util.o 00:02:19.385 CXX test/cpp_headers/uuid.o 00:02:19.385 CXX test/cpp_headers/version.o 00:02:19.385 CXX test/cpp_headers/vfio_user_pci.o 00:02:19.385 CXX test/cpp_headers/vfio_user_spec.o 00:02:19.385 CXX test/cpp_headers/vhost.o 00:02:19.385 CXX test/cpp_headers/vmd.o 00:02:19.385 CXX test/cpp_headers/xor.o 00:02:19.385 CXX test/cpp_headers/zipf.o 00:02:20.317 LINK cuse 00:02:20.317 LINK iscsi_fuzz 00:02:22.844 LINK esnap 00:02:23.101 00:02:23.101 real 0m47.928s 00:02:23.101 user 10m9.931s 00:02:23.101 sys 2m30.284s 00:02:23.101 03:13:48 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:02:23.101 03:13:48 -- common/autotest_common.sh@10 -- $ set +x 00:02:23.101 ************************************ 00:02:23.101 END TEST make 00:02:23.101 ************************************ 00:02:23.101 03:13:48 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:02:23.101 03:13:48 -- pm/common@30 -- $ signal_monitor_resources TERM 00:02:23.101 03:13:48 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:02:23.101 03:13:48 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:23.101 03:13:48 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:02:23.101 03:13:48 -- pm/common@45 -- $ pid=1246740 00:02:23.101 03:13:48 -- pm/common@52 -- $ sudo kill -TERM 1246740 00:02:23.101 03:13:48 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:23.101 03:13:48 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:02:23.101 03:13:48 -- pm/common@45 -- $ pid=1246742 00:02:23.101 03:13:48 -- pm/common@52 -- $ sudo kill -TERM 1246742 00:02:23.101 03:13:48 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:23.101 03:13:48 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:02:23.101 03:13:48 -- pm/common@45 -- $ pid=1246741 00:02:23.101 03:13:48 -- pm/common@52 -- $ sudo kill -TERM 1246741 00:02:23.359 03:13:48 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:23.359 03:13:48 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:02:23.359 03:13:48 -- pm/common@45 -- $ pid=1246743 00:02:23.359 03:13:48 -- pm/common@52 -- $ sudo kill -TERM 1246743 00:02:23.359 03:13:48 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:23.359 03:13:48 -- nvmf/common.sh@7 -- # uname -s 00:02:23.359 03:13:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:23.359 03:13:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:23.359 03:13:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:23.359 03:13:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:23.359 03:13:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:23.359 03:13:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:23.359 03:13:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:23.359 03:13:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:23.359 03:13:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:23.359 03:13:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:23.359 03:13:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:02:23.359 03:13:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:02:23.359 03:13:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:23.359 03:13:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:23.359 03:13:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:23.359 03:13:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:02:23.359 03:13:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:23.359 03:13:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:23.359 03:13:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:23.359 03:13:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:23.359 03:13:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:23.359 03:13:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:23.360 03:13:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:23.360 03:13:48 -- paths/export.sh@5 -- # export PATH 00:02:23.360 03:13:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:23.360 03:13:48 -- nvmf/common.sh@47 -- # : 0 00:02:23.360 03:13:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:02:23.360 03:13:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:02:23.360 03:13:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:02:23.360 03:13:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:23.360 03:13:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:23.360 03:13:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:02:23.360 03:13:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:02:23.360 03:13:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:02:23.360 03:13:48 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:23.360 03:13:48 -- spdk/autotest.sh@32 -- # uname -s 00:02:23.360 03:13:48 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:23.360 03:13:48 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:23.360 03:13:48 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:23.360 03:13:48 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:23.360 03:13:48 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:23.360 03:13:48 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:23.360 03:13:48 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:23.360 03:13:48 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:23.360 03:13:48 -- spdk/autotest.sh@48 -- # udevadm_pid=1301465 00:02:23.360 03:13:48 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:23.360 03:13:48 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:02:23.360 03:13:48 -- pm/common@17 -- # local monitor 00:02:23.360 03:13:48 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:23.360 03:13:48 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1301467 00:02:23.360 03:13:48 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:23.360 03:13:48 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1301470 00:02:23.360 03:13:48 -- pm/common@21 -- # date +%s 00:02:23.360 03:13:48 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:23.360 03:13:48 -- pm/common@21 -- # date +%s 00:02:23.360 03:13:48 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1301472 00:02:23.360 03:13:48 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:23.360 03:13:48 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1301476 00:02:23.360 03:13:48 -- pm/common@21 -- # date +%s 00:02:23.360 03:13:48 -- pm/common@26 -- # sleep 1 00:02:23.360 03:13:48 -- pm/common@21 -- # date +%s 00:02:23.360 03:13:48 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714180428 00:02:23.360 03:13:48 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714180428 00:02:23.360 03:13:48 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714180428 00:02:23.360 03:13:48 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714180428 00:02:23.360 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714180428_collect-vmstat.pm.log 00:02:23.360 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714180428_collect-bmc-pm.bmc.pm.log 00:02:23.360 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714180428_collect-cpu-load.pm.log 00:02:23.360 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714180428_collect-cpu-temp.pm.log 00:02:24.295 03:13:49 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:24.295 03:13:49 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:02:24.295 03:13:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:02:24.295 03:13:49 -- common/autotest_common.sh@10 -- # set +x 00:02:24.295 03:13:49 -- spdk/autotest.sh@59 -- # create_test_list 00:02:24.295 03:13:49 -- common/autotest_common.sh@734 -- # xtrace_disable 00:02:24.295 03:13:49 -- common/autotest_common.sh@10 -- # set +x 00:02:24.295 03:13:49 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:24.295 03:13:49 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:24.295 03:13:49 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:24.295 03:13:49 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:24.295 03:13:49 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:24.295 03:13:49 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:02:24.295 03:13:49 -- common/autotest_common.sh@1441 -- # uname 00:02:24.295 03:13:49 -- common/autotest_common.sh@1441 -- # '[' Linux = FreeBSD ']' 00:02:24.295 03:13:49 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:02:24.295 03:13:49 -- common/autotest_common.sh@1461 -- # uname 00:02:24.295 03:13:49 -- common/autotest_common.sh@1461 -- # [[ Linux = FreeBSD ]] 00:02:24.295 03:13:49 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:02:24.295 03:13:49 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:02:24.295 03:13:49 -- spdk/autotest.sh@72 -- # hash lcov 00:02:24.295 03:13:49 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:24.295 03:13:49 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:02:24.295 --rc lcov_branch_coverage=1 00:02:24.295 --rc lcov_function_coverage=1 00:02:24.295 --rc genhtml_branch_coverage=1 00:02:24.295 --rc genhtml_function_coverage=1 00:02:24.295 --rc genhtml_legend=1 00:02:24.295 --rc geninfo_all_blocks=1 00:02:24.295 ' 00:02:24.295 03:13:49 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:02:24.295 --rc lcov_branch_coverage=1 00:02:24.295 --rc lcov_function_coverage=1 00:02:24.295 --rc genhtml_branch_coverage=1 00:02:24.295 --rc genhtml_function_coverage=1 00:02:24.295 --rc genhtml_legend=1 00:02:24.295 --rc geninfo_all_blocks=1 00:02:24.295 ' 00:02:24.295 03:13:49 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:02:24.295 --rc lcov_branch_coverage=1 00:02:24.295 --rc lcov_function_coverage=1 00:02:24.295 --rc genhtml_branch_coverage=1 00:02:24.295 --rc genhtml_function_coverage=1 00:02:24.295 --rc genhtml_legend=1 00:02:24.295 --rc geninfo_all_blocks=1 00:02:24.295 --no-external' 00:02:24.295 03:13:49 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:02:24.295 --rc lcov_branch_coverage=1 00:02:24.295 --rc lcov_function_coverage=1 00:02:24.295 --rc genhtml_branch_coverage=1 00:02:24.295 --rc genhtml_function_coverage=1 00:02:24.295 --rc genhtml_legend=1 00:02:24.295 --rc geninfo_all_blocks=1 00:02:24.295 --no-external' 00:02:24.295 03:13:49 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:24.553 lcov: LCOV version 1.14 00:02:24.553 03:13:49 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:34.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:34.533 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:34.534 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:34.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:37.818 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:02:37.818 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:02:50.082 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:50.082 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:50.082 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:50.082 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:50.082 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:50.082 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:56.646 03:14:21 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:02:56.646 03:14:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:02:56.646 03:14:21 -- common/autotest_common.sh@10 -- # set +x 00:02:56.646 03:14:21 -- spdk/autotest.sh@91 -- # rm -f 00:02:56.646 03:14:21 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:57.579 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:57.579 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:57.579 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:57.837 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:57.837 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:57.837 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:57.837 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:57.837 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:57.837 0000:0b:00.0 (8086 0a54): Already using the nvme driver 00:02:57.837 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:57.837 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:57.837 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:57.837 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:57.837 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:57.837 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:57.837 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:57.837 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:58.112 03:14:22 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:02:58.112 03:14:22 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:02:58.112 03:14:22 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:02:58.112 03:14:22 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:02:58.112 03:14:22 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:58.112 03:14:22 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:02:58.112 03:14:22 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:02:58.112 03:14:22 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:58.112 03:14:22 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:02:58.112 03:14:22 -- spdk/autotest.sh@98 -- # (( 0 > 0 )) 00:02:58.112 03:14:22 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:02:58.112 03:14:22 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:02:58.112 03:14:22 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:02:58.112 03:14:22 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:02:58.112 03:14:22 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:58.112 No valid GPT data, bailing 00:02:58.112 03:14:22 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:58.112 03:14:22 -- scripts/common.sh@391 -- # pt= 00:02:58.112 03:14:22 -- scripts/common.sh@392 -- # return 1 00:02:58.112 03:14:22 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:58.112 1+0 records in 00:02:58.112 1+0 records out 00:02:58.112 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00262617 s, 399 MB/s 00:02:58.112 03:14:22 -- spdk/autotest.sh@118 -- # sync 00:02:58.112 03:14:22 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:58.112 03:14:22 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:58.112 03:14:22 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:00.016 03:14:24 -- spdk/autotest.sh@124 -- # uname -s 00:03:00.016 03:14:24 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:03:00.016 03:14:24 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:00.016 03:14:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:00.016 03:14:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:00.016 03:14:24 -- common/autotest_common.sh@10 -- # set +x 00:03:00.016 ************************************ 00:03:00.016 START TEST setup.sh 00:03:00.016 ************************************ 00:03:00.016 03:14:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:00.016 * Looking for test storage... 00:03:00.016 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:00.016 03:14:24 -- setup/test-setup.sh@10 -- # uname -s 00:03:00.016 03:14:24 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:00.016 03:14:24 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:00.016 03:14:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:00.016 03:14:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:00.016 03:14:24 -- common/autotest_common.sh@10 -- # set +x 00:03:00.274 ************************************ 00:03:00.274 START TEST acl 00:03:00.274 ************************************ 00:03:00.274 03:14:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:00.274 * Looking for test storage... 00:03:00.274 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:00.274 03:14:25 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:00.274 03:14:25 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:00.274 03:14:25 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:00.274 03:14:25 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:00.274 03:14:25 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:00.274 03:14:25 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:00.274 03:14:25 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:00.274 03:14:25 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:00.274 03:14:25 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:00.274 03:14:25 -- setup/acl.sh@12 -- # devs=() 00:03:00.274 03:14:25 -- setup/acl.sh@12 -- # declare -a devs 00:03:00.274 03:14:25 -- setup/acl.sh@13 -- # drivers=() 00:03:00.274 03:14:25 -- setup/acl.sh@13 -- # declare -A drivers 00:03:00.274 03:14:25 -- setup/acl.sh@51 -- # setup reset 00:03:00.275 03:14:25 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:00.275 03:14:25 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:01.651 03:14:26 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:01.651 03:14:26 -- setup/acl.sh@16 -- # local dev driver 00:03:01.651 03:14:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:01.651 03:14:26 -- setup/acl.sh@15 -- # setup output status 00:03:01.651 03:14:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:01.651 03:14:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:03.026 Hugepages 00:03:03.026 node hugesize free / total 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # continue 00:03:03.026 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # continue 00:03:03.026 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # continue 00:03:03.026 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.026 00:03:03.026 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # continue 00:03:03.026 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.026 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.026 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.026 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.026 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.026 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.026 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.026 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.026 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:0b:00.0 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\0\b\:\0\0\.\0* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:03.027 03:14:27 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.027 03:14:27 -- setup/acl.sh@20 -- # continue 00:03:03.027 03:14:27 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.027 03:14:27 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:03.027 03:14:27 -- setup/acl.sh@54 -- # run_test denied denied 00:03:03.027 03:14:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:03.027 03:14:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:03.027 03:14:27 -- common/autotest_common.sh@10 -- # set +x 00:03:03.027 ************************************ 00:03:03.027 START TEST denied 00:03:03.027 ************************************ 00:03:03.027 03:14:27 -- common/autotest_common.sh@1111 -- # denied 00:03:03.027 03:14:27 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:0b:00.0' 00:03:03.027 03:14:27 -- setup/acl.sh@38 -- # setup output config 00:03:03.027 03:14:27 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:0b:00.0' 00:03:03.027 03:14:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.027 03:14:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:04.926 0000:0b:00.0 (8086 0a54): Skipping denied controller at 0000:0b:00.0 00:03:04.926 03:14:29 -- setup/acl.sh@40 -- # verify 0000:0b:00.0 00:03:04.926 03:14:29 -- setup/acl.sh@28 -- # local dev driver 00:03:04.926 03:14:29 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:04.926 03:14:29 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:0b:00.0 ]] 00:03:04.926 03:14:29 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:0b:00.0/driver 00:03:04.926 03:14:29 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:04.926 03:14:29 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:04.926 03:14:29 -- setup/acl.sh@41 -- # setup reset 00:03:04.926 03:14:29 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:04.926 03:14:29 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:07.458 00:03:07.458 real 0m3.895s 00:03:07.458 user 0m1.136s 00:03:07.458 sys 0m1.859s 00:03:07.458 03:14:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:07.458 03:14:31 -- common/autotest_common.sh@10 -- # set +x 00:03:07.458 ************************************ 00:03:07.458 END TEST denied 00:03:07.458 ************************************ 00:03:07.458 03:14:31 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:07.458 03:14:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:07.458 03:14:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:07.458 03:14:31 -- common/autotest_common.sh@10 -- # set +x 00:03:07.458 ************************************ 00:03:07.458 START TEST allowed 00:03:07.458 ************************************ 00:03:07.458 03:14:31 -- common/autotest_common.sh@1111 -- # allowed 00:03:07.458 03:14:31 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:0b:00.0 00:03:07.458 03:14:31 -- setup/acl.sh@45 -- # setup output config 00:03:07.458 03:14:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:07.458 03:14:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:07.458 03:14:31 -- setup/acl.sh@46 -- # grep -E '0000:0b:00.0 .*: nvme -> .*' 00:03:09.360 0000:0b:00.0 (8086 0a54): nvme -> vfio-pci 00:03:09.360 03:14:34 -- setup/acl.sh@47 -- # verify 00:03:09.360 03:14:34 -- setup/acl.sh@28 -- # local dev driver 00:03:09.360 03:14:34 -- setup/acl.sh@48 -- # setup reset 00:03:09.360 03:14:34 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:09.360 03:14:34 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:10.734 00:03:10.734 real 0m3.682s 00:03:10.734 user 0m0.946s 00:03:10.734 sys 0m1.645s 00:03:10.734 03:14:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:10.734 03:14:35 -- common/autotest_common.sh@10 -- # set +x 00:03:10.734 ************************************ 00:03:10.734 END TEST allowed 00:03:10.734 ************************************ 00:03:10.734 00:03:10.734 real 0m10.586s 00:03:10.734 user 0m3.280s 00:03:10.734 sys 0m5.366s 00:03:10.734 03:14:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:10.734 03:14:35 -- common/autotest_common.sh@10 -- # set +x 00:03:10.734 ************************************ 00:03:10.734 END TEST acl 00:03:10.734 ************************************ 00:03:10.734 03:14:35 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:10.734 03:14:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:10.734 03:14:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:10.734 03:14:35 -- common/autotest_common.sh@10 -- # set +x 00:03:11.020 ************************************ 00:03:11.020 START TEST hugepages 00:03:11.020 ************************************ 00:03:11.020 03:14:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:11.020 * Looking for test storage... 00:03:11.020 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:11.020 03:14:35 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:11.020 03:14:35 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:11.020 03:14:35 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:11.020 03:14:35 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:11.020 03:14:35 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:11.020 03:14:35 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:11.020 03:14:35 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:11.020 03:14:35 -- setup/common.sh@18 -- # local node= 00:03:11.020 03:14:35 -- setup/common.sh@19 -- # local var val 00:03:11.020 03:14:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.020 03:14:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.021 03:14:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:11.021 03:14:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:11.021 03:14:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.021 03:14:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 37463516 kB' 'MemAvailable: 42221012 kB' 'Buffers: 3728 kB' 'Cached: 16483152 kB' 'SwapCached: 0 kB' 'Active: 12437016 kB' 'Inactive: 4476976 kB' 'Active(anon): 11818124 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 430388 kB' 'Mapped: 228004 kB' 'Shmem: 11391012 kB' 'KReclaimable: 306280 kB' 'Slab: 666128 kB' 'SReclaimable: 306280 kB' 'SUnreclaim: 359848 kB' 'KernelStack: 12736 kB' 'PageTables: 8716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36562320 kB' 'Committed_AS: 12957800 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195940 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.021 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.021 03:14:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # continue 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.022 03:14:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.022 03:14:35 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.022 03:14:35 -- setup/common.sh@33 -- # echo 2048 00:03:11.022 03:14:35 -- setup/common.sh@33 -- # return 0 00:03:11.022 03:14:35 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:11.022 03:14:35 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:11.022 03:14:35 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:11.022 03:14:35 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:11.022 03:14:35 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:11.022 03:14:35 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:11.022 03:14:35 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:11.022 03:14:35 -- setup/hugepages.sh@207 -- # get_nodes 00:03:11.022 03:14:35 -- setup/hugepages.sh@27 -- # local node 00:03:11.022 03:14:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:11.022 03:14:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:11.022 03:14:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:11.022 03:14:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:11.022 03:14:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:11.022 03:14:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:11.022 03:14:35 -- setup/hugepages.sh@208 -- # clear_hp 00:03:11.022 03:14:35 -- setup/hugepages.sh@37 -- # local node hp 00:03:11.022 03:14:35 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:11.022 03:14:35 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:11.022 03:14:35 -- setup/hugepages.sh@41 -- # echo 0 00:03:11.022 03:14:35 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:11.022 03:14:35 -- setup/hugepages.sh@41 -- # echo 0 00:03:11.022 03:14:35 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:11.022 03:14:35 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:11.022 03:14:35 -- setup/hugepages.sh@41 -- # echo 0 00:03:11.022 03:14:35 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:11.022 03:14:35 -- setup/hugepages.sh@41 -- # echo 0 00:03:11.022 03:14:35 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:11.022 03:14:35 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:11.022 03:14:35 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:11.022 03:14:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:11.022 03:14:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:11.022 03:14:35 -- common/autotest_common.sh@10 -- # set +x 00:03:11.022 ************************************ 00:03:11.022 START TEST default_setup 00:03:11.022 ************************************ 00:03:11.022 03:14:35 -- common/autotest_common.sh@1111 -- # default_setup 00:03:11.022 03:14:35 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:11.022 03:14:35 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:11.022 03:14:35 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:11.022 03:14:35 -- setup/hugepages.sh@51 -- # shift 00:03:11.022 03:14:35 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:11.022 03:14:35 -- setup/hugepages.sh@52 -- # local node_ids 00:03:11.022 03:14:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:11.022 03:14:35 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:11.022 03:14:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:11.022 03:14:35 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:11.022 03:14:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:11.022 03:14:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:11.022 03:14:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:11.022 03:14:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:11.022 03:14:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:11.022 03:14:35 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:11.022 03:14:35 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:11.022 03:14:35 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:11.022 03:14:35 -- setup/hugepages.sh@73 -- # return 0 00:03:11.022 03:14:35 -- setup/hugepages.sh@137 -- # setup output 00:03:11.022 03:14:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:11.022 03:14:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:12.406 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:12.406 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:12.406 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:12.406 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:12.406 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:12.406 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:12.406 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:12.406 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:12.406 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:12.406 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:12.406 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:12.406 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:12.407 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:12.407 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:12.407 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:12.407 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:13.343 0000:0b:00.0 (8086 0a54): nvme -> vfio-pci 00:03:13.343 03:14:38 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:13.343 03:14:38 -- setup/hugepages.sh@89 -- # local node 00:03:13.343 03:14:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:13.343 03:14:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:13.343 03:14:38 -- setup/hugepages.sh@92 -- # local surp 00:03:13.343 03:14:38 -- setup/hugepages.sh@93 -- # local resv 00:03:13.343 03:14:38 -- setup/hugepages.sh@94 -- # local anon 00:03:13.343 03:14:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:13.343 03:14:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:13.343 03:14:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:13.343 03:14:38 -- setup/common.sh@18 -- # local node= 00:03:13.343 03:14:38 -- setup/common.sh@19 -- # local var val 00:03:13.343 03:14:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.343 03:14:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.343 03:14:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.343 03:14:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.343 03:14:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.343 03:14:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.343 03:14:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39555128 kB' 'MemAvailable: 44312616 kB' 'Buffers: 3728 kB' 'Cached: 16483240 kB' 'SwapCached: 0 kB' 'Active: 12455848 kB' 'Inactive: 4476976 kB' 'Active(anon): 11836956 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449112 kB' 'Mapped: 228116 kB' 'Shmem: 11391100 kB' 'KReclaimable: 306272 kB' 'Slab: 665640 kB' 'SReclaimable: 306272 kB' 'SUnreclaim: 359368 kB' 'KernelStack: 12640 kB' 'PageTables: 8692 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12977376 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195972 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.343 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.343 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.344 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.344 03:14:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.606 03:14:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.606 03:14:38 -- setup/common.sh@33 -- # echo 0 00:03:13.606 03:14:38 -- setup/common.sh@33 -- # return 0 00:03:13.606 03:14:38 -- setup/hugepages.sh@97 -- # anon=0 00:03:13.606 03:14:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:13.606 03:14:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.606 03:14:38 -- setup/common.sh@18 -- # local node= 00:03:13.606 03:14:38 -- setup/common.sh@19 -- # local var val 00:03:13.606 03:14:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.606 03:14:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.606 03:14:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.606 03:14:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.606 03:14:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.606 03:14:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.606 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39556068 kB' 'MemAvailable: 44313556 kB' 'Buffers: 3728 kB' 'Cached: 16483244 kB' 'SwapCached: 0 kB' 'Active: 12455076 kB' 'Inactive: 4476976 kB' 'Active(anon): 11836184 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448332 kB' 'Mapped: 228152 kB' 'Shmem: 11391104 kB' 'KReclaimable: 306272 kB' 'Slab: 665652 kB' 'SReclaimable: 306272 kB' 'SUnreclaim: 359380 kB' 'KernelStack: 12736 kB' 'PageTables: 8592 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12977388 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195956 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.607 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.607 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.608 03:14:38 -- setup/common.sh@33 -- # echo 0 00:03:13.608 03:14:38 -- setup/common.sh@33 -- # return 0 00:03:13.608 03:14:38 -- setup/hugepages.sh@99 -- # surp=0 00:03:13.608 03:14:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:13.608 03:14:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:13.608 03:14:38 -- setup/common.sh@18 -- # local node= 00:03:13.608 03:14:38 -- setup/common.sh@19 -- # local var val 00:03:13.608 03:14:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.608 03:14:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.608 03:14:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.608 03:14:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.608 03:14:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.608 03:14:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39557092 kB' 'MemAvailable: 44314580 kB' 'Buffers: 3728 kB' 'Cached: 16483256 kB' 'SwapCached: 0 kB' 'Active: 12454980 kB' 'Inactive: 4476976 kB' 'Active(anon): 11836088 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448204 kB' 'Mapped: 228076 kB' 'Shmem: 11391116 kB' 'KReclaimable: 306272 kB' 'Slab: 665628 kB' 'SReclaimable: 306272 kB' 'SUnreclaim: 359356 kB' 'KernelStack: 12736 kB' 'PageTables: 8632 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12977404 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195972 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.608 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.608 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.609 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.609 03:14:38 -- setup/common.sh@33 -- # echo 0 00:03:13.609 03:14:38 -- setup/common.sh@33 -- # return 0 00:03:13.609 03:14:38 -- setup/hugepages.sh@100 -- # resv=0 00:03:13.609 03:14:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:13.609 nr_hugepages=1024 00:03:13.609 03:14:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:13.609 resv_hugepages=0 00:03:13.609 03:14:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:13.609 surplus_hugepages=0 00:03:13.609 03:14:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:13.609 anon_hugepages=0 00:03:13.609 03:14:38 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:13.609 03:14:38 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:13.609 03:14:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:13.609 03:14:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:13.609 03:14:38 -- setup/common.sh@18 -- # local node= 00:03:13.609 03:14:38 -- setup/common.sh@19 -- # local var val 00:03:13.609 03:14:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.609 03:14:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.609 03:14:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.609 03:14:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.609 03:14:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.609 03:14:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.609 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39557092 kB' 'MemAvailable: 44314580 kB' 'Buffers: 3728 kB' 'Cached: 16483268 kB' 'SwapCached: 0 kB' 'Active: 12454984 kB' 'Inactive: 4476976 kB' 'Active(anon): 11836092 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448200 kB' 'Mapped: 228076 kB' 'Shmem: 11391128 kB' 'KReclaimable: 306272 kB' 'Slab: 665628 kB' 'SReclaimable: 306272 kB' 'SUnreclaim: 359356 kB' 'KernelStack: 12736 kB' 'PageTables: 8632 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12977416 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195972 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.610 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.610 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.611 03:14:38 -- setup/common.sh@33 -- # echo 1024 00:03:13.611 03:14:38 -- setup/common.sh@33 -- # return 0 00:03:13.611 03:14:38 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:13.611 03:14:38 -- setup/hugepages.sh@112 -- # get_nodes 00:03:13.611 03:14:38 -- setup/hugepages.sh@27 -- # local node 00:03:13.611 03:14:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.611 03:14:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:13.611 03:14:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.611 03:14:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:13.611 03:14:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:13.611 03:14:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:13.611 03:14:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:13.611 03:14:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:13.611 03:14:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:13.611 03:14:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.611 03:14:38 -- setup/common.sh@18 -- # local node=0 00:03:13.611 03:14:38 -- setup/common.sh@19 -- # local var val 00:03:13.611 03:14:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.611 03:14:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.611 03:14:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:13.611 03:14:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:13.611 03:14:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.611 03:14:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 22795448 kB' 'MemUsed: 10081492 kB' 'SwapCached: 0 kB' 'Active: 6807832 kB' 'Inactive: 108712 kB' 'Active(anon): 6469572 kB' 'Inactive(anon): 0 kB' 'Active(file): 338260 kB' 'Inactive(file): 108712 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6678772 kB' 'Mapped: 121548 kB' 'AnonPages: 240964 kB' 'Shmem: 6231800 kB' 'KernelStack: 7528 kB' 'PageTables: 5324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98476 kB' 'Slab: 268008 kB' 'SReclaimable: 98476 kB' 'SUnreclaim: 169532 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.611 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.611 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # continue 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.612 03:14:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.612 03:14:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.612 03:14:38 -- setup/common.sh@33 -- # echo 0 00:03:13.612 03:14:38 -- setup/common.sh@33 -- # return 0 00:03:13.612 03:14:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:13.612 03:14:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:13.612 03:14:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:13.612 03:14:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:13.612 03:14:38 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:13.612 node0=1024 expecting 1024 00:03:13.612 03:14:38 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:13.612 00:03:13.612 real 0m2.480s 00:03:13.612 user 0m0.638s 00:03:13.612 sys 0m0.928s 00:03:13.612 03:14:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:13.612 03:14:38 -- common/autotest_common.sh@10 -- # set +x 00:03:13.612 ************************************ 00:03:13.612 END TEST default_setup 00:03:13.612 ************************************ 00:03:13.612 03:14:38 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:13.612 03:14:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:13.612 03:14:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:13.612 03:14:38 -- common/autotest_common.sh@10 -- # set +x 00:03:13.612 ************************************ 00:03:13.612 START TEST per_node_1G_alloc 00:03:13.612 ************************************ 00:03:13.612 03:14:38 -- common/autotest_common.sh@1111 -- # per_node_1G_alloc 00:03:13.612 03:14:38 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:13.612 03:14:38 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:13.612 03:14:38 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:13.612 03:14:38 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:13.612 03:14:38 -- setup/hugepages.sh@51 -- # shift 00:03:13.612 03:14:38 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:13.612 03:14:38 -- setup/hugepages.sh@52 -- # local node_ids 00:03:13.612 03:14:38 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:13.612 03:14:38 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:13.612 03:14:38 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:13.612 03:14:38 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:13.612 03:14:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:13.612 03:14:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:13.612 03:14:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:13.612 03:14:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:13.612 03:14:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:13.612 03:14:38 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:13.612 03:14:38 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:13.612 03:14:38 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:13.612 03:14:38 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:13.612 03:14:38 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:13.612 03:14:38 -- setup/hugepages.sh@73 -- # return 0 00:03:13.612 03:14:38 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:13.612 03:14:38 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:13.612 03:14:38 -- setup/hugepages.sh@146 -- # setup output 00:03:13.612 03:14:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:13.612 03:14:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:14.992 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:14.992 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:14.992 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:14.992 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:14.992 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:14.992 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:14.992 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:14.992 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:14.992 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:14.992 0000:0b:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:14.992 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:14.992 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:14.992 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:14.992 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:14.992 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:14.992 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:14.992 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:14.992 03:14:39 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:14.992 03:14:39 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:14.992 03:14:39 -- setup/hugepages.sh@89 -- # local node 00:03:14.992 03:14:39 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:14.992 03:14:39 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:14.992 03:14:39 -- setup/hugepages.sh@92 -- # local surp 00:03:14.992 03:14:39 -- setup/hugepages.sh@93 -- # local resv 00:03:14.992 03:14:39 -- setup/hugepages.sh@94 -- # local anon 00:03:14.992 03:14:39 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:14.992 03:14:39 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:14.992 03:14:39 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:14.992 03:14:39 -- setup/common.sh@18 -- # local node= 00:03:14.992 03:14:39 -- setup/common.sh@19 -- # local var val 00:03:14.992 03:14:39 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.992 03:14:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.992 03:14:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.992 03:14:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.992 03:14:39 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.992 03:14:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39578248 kB' 'MemAvailable: 44335736 kB' 'Buffers: 3728 kB' 'Cached: 16483332 kB' 'SwapCached: 0 kB' 'Active: 12451468 kB' 'Inactive: 4476976 kB' 'Active(anon): 11832576 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444748 kB' 'Mapped: 228240 kB' 'Shmem: 11391192 kB' 'KReclaimable: 306272 kB' 'Slab: 665600 kB' 'SReclaimable: 306272 kB' 'SUnreclaim: 359328 kB' 'KernelStack: 12672 kB' 'PageTables: 8336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12971384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195908 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.992 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.992 03:14:39 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.993 03:14:39 -- setup/common.sh@33 -- # echo 0 00:03:14.993 03:14:39 -- setup/common.sh@33 -- # return 0 00:03:14.993 03:14:39 -- setup/hugepages.sh@97 -- # anon=0 00:03:14.993 03:14:39 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:14.993 03:14:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.993 03:14:39 -- setup/common.sh@18 -- # local node= 00:03:14.993 03:14:39 -- setup/common.sh@19 -- # local var val 00:03:14.993 03:14:39 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.993 03:14:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.993 03:14:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.993 03:14:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.993 03:14:39 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.993 03:14:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39578248 kB' 'MemAvailable: 44335736 kB' 'Buffers: 3728 kB' 'Cached: 16483336 kB' 'SwapCached: 0 kB' 'Active: 12451388 kB' 'Inactive: 4476976 kB' 'Active(anon): 11832496 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444672 kB' 'Mapped: 228184 kB' 'Shmem: 11391196 kB' 'KReclaimable: 306272 kB' 'Slab: 665592 kB' 'SReclaimable: 306272 kB' 'SUnreclaim: 359320 kB' 'KernelStack: 12672 kB' 'PageTables: 8328 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12971396 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195892 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.993 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.993 03:14:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.994 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.994 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.995 03:14:39 -- setup/common.sh@33 -- # echo 0 00:03:14.995 03:14:39 -- setup/common.sh@33 -- # return 0 00:03:14.995 03:14:39 -- setup/hugepages.sh@99 -- # surp=0 00:03:14.995 03:14:39 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:14.995 03:14:39 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:14.995 03:14:39 -- setup/common.sh@18 -- # local node= 00:03:14.995 03:14:39 -- setup/common.sh@19 -- # local var val 00:03:14.995 03:14:39 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.995 03:14:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.995 03:14:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.995 03:14:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.995 03:14:39 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.995 03:14:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39578248 kB' 'MemAvailable: 44335736 kB' 'Buffers: 3728 kB' 'Cached: 16483348 kB' 'SwapCached: 0 kB' 'Active: 12451532 kB' 'Inactive: 4476976 kB' 'Active(anon): 11832640 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444756 kB' 'Mapped: 228108 kB' 'Shmem: 11391208 kB' 'KReclaimable: 306272 kB' 'Slab: 665592 kB' 'SReclaimable: 306272 kB' 'SUnreclaim: 359320 kB' 'KernelStack: 12688 kB' 'PageTables: 8372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12971408 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195892 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # continue 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.995 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.995 03:14:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.257 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.257 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.258 03:14:39 -- setup/common.sh@33 -- # echo 0 00:03:15.258 03:14:39 -- setup/common.sh@33 -- # return 0 00:03:15.258 03:14:39 -- setup/hugepages.sh@100 -- # resv=0 00:03:15.258 03:14:39 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:15.258 nr_hugepages=1024 00:03:15.258 03:14:39 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:15.258 resv_hugepages=0 00:03:15.258 03:14:39 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:15.258 surplus_hugepages=0 00:03:15.258 03:14:39 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:15.258 anon_hugepages=0 00:03:15.258 03:14:39 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:15.258 03:14:39 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:15.258 03:14:39 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:15.258 03:14:39 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:15.258 03:14:39 -- setup/common.sh@18 -- # local node= 00:03:15.258 03:14:39 -- setup/common.sh@19 -- # local var val 00:03:15.258 03:14:39 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.258 03:14:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.258 03:14:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.258 03:14:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.258 03:14:39 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.258 03:14:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39578248 kB' 'MemAvailable: 44335736 kB' 'Buffers: 3728 kB' 'Cached: 16483364 kB' 'SwapCached: 0 kB' 'Active: 12451564 kB' 'Inactive: 4476976 kB' 'Active(anon): 11832672 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444756 kB' 'Mapped: 228108 kB' 'Shmem: 11391224 kB' 'KReclaimable: 306272 kB' 'Slab: 665592 kB' 'SReclaimable: 306272 kB' 'SUnreclaim: 359320 kB' 'KernelStack: 12688 kB' 'PageTables: 8372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12971424 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195908 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:39 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.258 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.258 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.259 03:14:40 -- setup/common.sh@33 -- # echo 1024 00:03:15.259 03:14:40 -- setup/common.sh@33 -- # return 0 00:03:15.259 03:14:40 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:15.259 03:14:40 -- setup/hugepages.sh@112 -- # get_nodes 00:03:15.259 03:14:40 -- setup/hugepages.sh@27 -- # local node 00:03:15.259 03:14:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:15.259 03:14:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:15.259 03:14:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:15.259 03:14:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:15.259 03:14:40 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:15.259 03:14:40 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:15.259 03:14:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:15.259 03:14:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:15.259 03:14:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:15.259 03:14:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:15.259 03:14:40 -- setup/common.sh@18 -- # local node=0 00:03:15.259 03:14:40 -- setup/common.sh@19 -- # local var val 00:03:15.259 03:14:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.259 03:14:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.259 03:14:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:15.259 03:14:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:15.259 03:14:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.259 03:14:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 23866984 kB' 'MemUsed: 9009956 kB' 'SwapCached: 0 kB' 'Active: 6806292 kB' 'Inactive: 108712 kB' 'Active(anon): 6468032 kB' 'Inactive(anon): 0 kB' 'Active(file): 338260 kB' 'Inactive(file): 108712 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6678792 kB' 'Mapped: 121580 kB' 'AnonPages: 239640 kB' 'Shmem: 6231820 kB' 'KernelStack: 7544 kB' 'PageTables: 5084 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98476 kB' 'Slab: 267996 kB' 'SReclaimable: 98476 kB' 'SUnreclaim: 169520 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.259 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.259 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@33 -- # echo 0 00:03:15.260 03:14:40 -- setup/common.sh@33 -- # return 0 00:03:15.260 03:14:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:15.260 03:14:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:15.260 03:14:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:15.260 03:14:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:15.260 03:14:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:15.260 03:14:40 -- setup/common.sh@18 -- # local node=1 00:03:15.260 03:14:40 -- setup/common.sh@19 -- # local var val 00:03:15.260 03:14:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.260 03:14:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.260 03:14:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:15.260 03:14:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:15.260 03:14:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.260 03:14:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27664796 kB' 'MemFree: 15714280 kB' 'MemUsed: 11950516 kB' 'SwapCached: 0 kB' 'Active: 5646132 kB' 'Inactive: 4368264 kB' 'Active(anon): 5365500 kB' 'Inactive(anon): 0 kB' 'Active(file): 280632 kB' 'Inactive(file): 4368264 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9808312 kB' 'Mapped: 106528 kB' 'AnonPages: 206236 kB' 'Shmem: 5159416 kB' 'KernelStack: 5128 kB' 'PageTables: 3244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 207788 kB' 'Slab: 397588 kB' 'SReclaimable: 207788 kB' 'SUnreclaim: 189800 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.260 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.260 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # continue 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.261 03:14:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.261 03:14:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.261 03:14:40 -- setup/common.sh@33 -- # echo 0 00:03:15.261 03:14:40 -- setup/common.sh@33 -- # return 0 00:03:15.261 03:14:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:15.261 03:14:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:15.261 03:14:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:15.261 03:14:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:15.261 03:14:40 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:15.261 node0=512 expecting 512 00:03:15.261 03:14:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:15.261 03:14:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:15.261 03:14:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:15.261 03:14:40 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:15.261 node1=512 expecting 512 00:03:15.261 03:14:40 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:15.261 00:03:15.261 real 0m1.498s 00:03:15.261 user 0m0.610s 00:03:15.261 sys 0m0.848s 00:03:15.261 03:14:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:15.261 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:03:15.261 ************************************ 00:03:15.261 END TEST per_node_1G_alloc 00:03:15.261 ************************************ 00:03:15.261 03:14:40 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:15.261 03:14:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.261 03:14:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.261 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:03:15.261 ************************************ 00:03:15.261 START TEST even_2G_alloc 00:03:15.262 ************************************ 00:03:15.262 03:14:40 -- common/autotest_common.sh@1111 -- # even_2G_alloc 00:03:15.262 03:14:40 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:15.262 03:14:40 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:15.262 03:14:40 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:15.262 03:14:40 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:15.262 03:14:40 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:15.262 03:14:40 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:15.262 03:14:40 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:15.262 03:14:40 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:15.262 03:14:40 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:15.262 03:14:40 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:15.262 03:14:40 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:15.262 03:14:40 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:15.262 03:14:40 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:15.262 03:14:40 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:15.262 03:14:40 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.262 03:14:40 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:15.262 03:14:40 -- setup/hugepages.sh@83 -- # : 512 00:03:15.262 03:14:40 -- setup/hugepages.sh@84 -- # : 1 00:03:15.262 03:14:40 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.262 03:14:40 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:15.262 03:14:40 -- setup/hugepages.sh@83 -- # : 0 00:03:15.262 03:14:40 -- setup/hugepages.sh@84 -- # : 0 00:03:15.262 03:14:40 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.262 03:14:40 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:15.262 03:14:40 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:15.262 03:14:40 -- setup/hugepages.sh@153 -- # setup output 00:03:15.262 03:14:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.262 03:14:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:16.643 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:16.643 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:16.643 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:16.643 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:16.643 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:16.643 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:16.643 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:16.643 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.643 0000:0b:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:16.643 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:16.643 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:16.643 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:16.643 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:16.643 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:16.643 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:16.643 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:16.643 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.643 03:14:41 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:16.643 03:14:41 -- setup/hugepages.sh@89 -- # local node 00:03:16.643 03:14:41 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:16.643 03:14:41 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:16.643 03:14:41 -- setup/hugepages.sh@92 -- # local surp 00:03:16.643 03:14:41 -- setup/hugepages.sh@93 -- # local resv 00:03:16.643 03:14:41 -- setup/hugepages.sh@94 -- # local anon 00:03:16.643 03:14:41 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:16.643 03:14:41 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:16.643 03:14:41 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:16.643 03:14:41 -- setup/common.sh@18 -- # local node= 00:03:16.643 03:14:41 -- setup/common.sh@19 -- # local var val 00:03:16.643 03:14:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.643 03:14:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.643 03:14:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.643 03:14:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.643 03:14:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.643 03:14:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39579424 kB' 'MemAvailable: 44336872 kB' 'Buffers: 3728 kB' 'Cached: 16483432 kB' 'SwapCached: 0 kB' 'Active: 12448364 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829472 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441344 kB' 'Mapped: 227144 kB' 'Shmem: 11391292 kB' 'KReclaimable: 306232 kB' 'Slab: 665420 kB' 'SReclaimable: 306232 kB' 'SUnreclaim: 359188 kB' 'KernelStack: 12608 kB' 'PageTables: 7980 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12960520 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195988 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.643 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.643 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.644 03:14:41 -- setup/common.sh@33 -- # echo 0 00:03:16.644 03:14:41 -- setup/common.sh@33 -- # return 0 00:03:16.644 03:14:41 -- setup/hugepages.sh@97 -- # anon=0 00:03:16.644 03:14:41 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:16.644 03:14:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.644 03:14:41 -- setup/common.sh@18 -- # local node= 00:03:16.644 03:14:41 -- setup/common.sh@19 -- # local var val 00:03:16.644 03:14:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.644 03:14:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.644 03:14:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.644 03:14:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.644 03:14:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.644 03:14:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39580168 kB' 'MemAvailable: 44337608 kB' 'Buffers: 3728 kB' 'Cached: 16483432 kB' 'SwapCached: 0 kB' 'Active: 12448284 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829392 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441284 kB' 'Mapped: 227096 kB' 'Shmem: 11391292 kB' 'KReclaimable: 306224 kB' 'Slab: 665340 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 359116 kB' 'KernelStack: 12640 kB' 'PageTables: 8040 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12960532 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195988 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.644 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.644 03:14:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.645 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.645 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.645 03:14:41 -- setup/common.sh@33 -- # echo 0 00:03:16.645 03:14:41 -- setup/common.sh@33 -- # return 0 00:03:16.645 03:14:41 -- setup/hugepages.sh@99 -- # surp=0 00:03:16.645 03:14:41 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:16.645 03:14:41 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:16.645 03:14:41 -- setup/common.sh@18 -- # local node= 00:03:16.645 03:14:41 -- setup/common.sh@19 -- # local var val 00:03:16.646 03:14:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.646 03:14:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.646 03:14:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.646 03:14:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.646 03:14:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.646 03:14:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39579916 kB' 'MemAvailable: 44337356 kB' 'Buffers: 3728 kB' 'Cached: 16483432 kB' 'SwapCached: 0 kB' 'Active: 12448000 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829108 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441000 kB' 'Mapped: 227096 kB' 'Shmem: 11391292 kB' 'KReclaimable: 306224 kB' 'Slab: 665344 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 359120 kB' 'KernelStack: 12656 kB' 'PageTables: 8064 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12960544 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196004 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.646 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.646 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.647 03:14:41 -- setup/common.sh@33 -- # echo 0 00:03:16.647 03:14:41 -- setup/common.sh@33 -- # return 0 00:03:16.647 03:14:41 -- setup/hugepages.sh@100 -- # resv=0 00:03:16.647 03:14:41 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:16.647 nr_hugepages=1024 00:03:16.647 03:14:41 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:16.647 resv_hugepages=0 00:03:16.647 03:14:41 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:16.647 surplus_hugepages=0 00:03:16.647 03:14:41 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:16.647 anon_hugepages=0 00:03:16.647 03:14:41 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.647 03:14:41 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:16.647 03:14:41 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:16.647 03:14:41 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:16.647 03:14:41 -- setup/common.sh@18 -- # local node= 00:03:16.647 03:14:41 -- setup/common.sh@19 -- # local var val 00:03:16.647 03:14:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.647 03:14:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.647 03:14:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.647 03:14:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.647 03:14:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.647 03:14:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39579916 kB' 'MemAvailable: 44337356 kB' 'Buffers: 3728 kB' 'Cached: 16483460 kB' 'SwapCached: 0 kB' 'Active: 12448072 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829180 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441028 kB' 'Mapped: 227096 kB' 'Shmem: 11391320 kB' 'KReclaimable: 306224 kB' 'Slab: 665344 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 359120 kB' 'KernelStack: 12640 kB' 'PageTables: 8016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12960560 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196020 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.647 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.647 03:14:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.648 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.648 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.649 03:14:41 -- setup/common.sh@33 -- # echo 1024 00:03:16.649 03:14:41 -- setup/common.sh@33 -- # return 0 00:03:16.649 03:14:41 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.649 03:14:41 -- setup/hugepages.sh@112 -- # get_nodes 00:03:16.649 03:14:41 -- setup/hugepages.sh@27 -- # local node 00:03:16.649 03:14:41 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.649 03:14:41 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.649 03:14:41 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.649 03:14:41 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.649 03:14:41 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:16.649 03:14:41 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:16.649 03:14:41 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.649 03:14:41 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.649 03:14:41 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:16.649 03:14:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.649 03:14:41 -- setup/common.sh@18 -- # local node=0 00:03:16.649 03:14:41 -- setup/common.sh@19 -- # local var val 00:03:16.649 03:14:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.649 03:14:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.649 03:14:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:16.649 03:14:41 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:16.649 03:14:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.649 03:14:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 23860916 kB' 'MemUsed: 9016024 kB' 'SwapCached: 0 kB' 'Active: 6802100 kB' 'Inactive: 108712 kB' 'Active(anon): 6463840 kB' 'Inactive(anon): 0 kB' 'Active(file): 338260 kB' 'Inactive(file): 108712 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6678800 kB' 'Mapped: 120708 kB' 'AnonPages: 235112 kB' 'Shmem: 6231828 kB' 'KernelStack: 7448 kB' 'PageTables: 4716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98468 kB' 'Slab: 267760 kB' 'SReclaimable: 98468 kB' 'SUnreclaim: 169292 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.649 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.649 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@33 -- # echo 0 00:03:16.650 03:14:41 -- setup/common.sh@33 -- # return 0 00:03:16.650 03:14:41 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.650 03:14:41 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.650 03:14:41 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.650 03:14:41 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:16.650 03:14:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.650 03:14:41 -- setup/common.sh@18 -- # local node=1 00:03:16.650 03:14:41 -- setup/common.sh@19 -- # local var val 00:03:16.650 03:14:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.650 03:14:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.650 03:14:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:16.650 03:14:41 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:16.650 03:14:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.650 03:14:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27664796 kB' 'MemFree: 15719292 kB' 'MemUsed: 11945504 kB' 'SwapCached: 0 kB' 'Active: 5647004 kB' 'Inactive: 4368264 kB' 'Active(anon): 5366372 kB' 'Inactive(anon): 0 kB' 'Active(file): 280632 kB' 'Inactive(file): 4368264 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9808404 kB' 'Mapped: 106388 kB' 'AnonPages: 207024 kB' 'Shmem: 5159508 kB' 'KernelStack: 5496 kB' 'PageTables: 4108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 207756 kB' 'Slab: 397576 kB' 'SReclaimable: 207756 kB' 'SUnreclaim: 189820 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.650 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.650 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # continue 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.651 03:14:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.651 03:14:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.651 03:14:41 -- setup/common.sh@33 -- # echo 0 00:03:16.651 03:14:41 -- setup/common.sh@33 -- # return 0 00:03:16.651 03:14:41 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.651 03:14:41 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.651 03:14:41 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.651 03:14:41 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.651 03:14:41 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:16.651 node0=512 expecting 512 00:03:16.651 03:14:41 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.651 03:14:41 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.651 03:14:41 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.651 03:14:41 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:16.651 node1=512 expecting 512 00:03:16.651 03:14:41 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:16.651 00:03:16.651 real 0m1.434s 00:03:16.651 user 0m0.596s 00:03:16.651 sys 0m0.794s 00:03:16.651 03:14:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:16.651 03:14:41 -- common/autotest_common.sh@10 -- # set +x 00:03:16.651 ************************************ 00:03:16.651 END TEST even_2G_alloc 00:03:16.651 ************************************ 00:03:16.909 03:14:41 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:16.909 03:14:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:16.909 03:14:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:16.909 03:14:41 -- common/autotest_common.sh@10 -- # set +x 00:03:16.909 ************************************ 00:03:16.909 START TEST odd_alloc 00:03:16.909 ************************************ 00:03:16.909 03:14:41 -- common/autotest_common.sh@1111 -- # odd_alloc 00:03:16.909 03:14:41 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:16.909 03:14:41 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:16.909 03:14:41 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:16.909 03:14:41 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:16.909 03:14:41 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:16.909 03:14:41 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:16.909 03:14:41 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:16.909 03:14:41 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:16.909 03:14:41 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:16.909 03:14:41 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:16.909 03:14:41 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:16.909 03:14:41 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:16.909 03:14:41 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:16.909 03:14:41 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:16.909 03:14:41 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.909 03:14:41 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:16.909 03:14:41 -- setup/hugepages.sh@83 -- # : 513 00:03:16.909 03:14:41 -- setup/hugepages.sh@84 -- # : 1 00:03:16.909 03:14:41 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.909 03:14:41 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:16.909 03:14:41 -- setup/hugepages.sh@83 -- # : 0 00:03:16.909 03:14:41 -- setup/hugepages.sh@84 -- # : 0 00:03:16.909 03:14:41 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.909 03:14:41 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:16.909 03:14:41 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:16.909 03:14:41 -- setup/hugepages.sh@160 -- # setup output 00:03:16.909 03:14:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.909 03:14:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:17.845 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.106 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.106 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.106 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.106 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.106 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.106 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.107 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.107 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.107 0000:0b:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:18.107 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.107 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.107 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.107 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.107 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.107 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.107 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.107 03:14:43 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:18.107 03:14:43 -- setup/hugepages.sh@89 -- # local node 00:03:18.107 03:14:43 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:18.107 03:14:43 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:18.107 03:14:43 -- setup/hugepages.sh@92 -- # local surp 00:03:18.107 03:14:43 -- setup/hugepages.sh@93 -- # local resv 00:03:18.107 03:14:43 -- setup/hugepages.sh@94 -- # local anon 00:03:18.107 03:14:43 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:18.107 03:14:43 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:18.107 03:14:43 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:18.107 03:14:43 -- setup/common.sh@18 -- # local node= 00:03:18.107 03:14:43 -- setup/common.sh@19 -- # local var val 00:03:18.107 03:14:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.107 03:14:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.107 03:14:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.107 03:14:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.107 03:14:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.107 03:14:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39587316 kB' 'MemAvailable: 44344756 kB' 'Buffers: 3728 kB' 'Cached: 16483528 kB' 'SwapCached: 0 kB' 'Active: 12448288 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829396 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441320 kB' 'Mapped: 227124 kB' 'Shmem: 11391388 kB' 'KReclaimable: 306224 kB' 'Slab: 665072 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358848 kB' 'KernelStack: 12688 kB' 'PageTables: 8124 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609872 kB' 'Committed_AS: 12960912 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195940 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.107 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.107 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.108 03:14:43 -- setup/common.sh@33 -- # echo 0 00:03:18.108 03:14:43 -- setup/common.sh@33 -- # return 0 00:03:18.108 03:14:43 -- setup/hugepages.sh@97 -- # anon=0 00:03:18.108 03:14:43 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:18.108 03:14:43 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.108 03:14:43 -- setup/common.sh@18 -- # local node= 00:03:18.108 03:14:43 -- setup/common.sh@19 -- # local var val 00:03:18.108 03:14:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.108 03:14:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.108 03:14:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.108 03:14:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.108 03:14:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.108 03:14:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39587164 kB' 'MemAvailable: 44344604 kB' 'Buffers: 3728 kB' 'Cached: 16483532 kB' 'SwapCached: 0 kB' 'Active: 12448184 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829292 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441196 kB' 'Mapped: 227124 kB' 'Shmem: 11391392 kB' 'KReclaimable: 306224 kB' 'Slab: 665072 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358848 kB' 'KernelStack: 12656 kB' 'PageTables: 8012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609872 kB' 'Committed_AS: 12960924 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195924 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.108 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.108 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.109 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.109 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.110 03:14:43 -- setup/common.sh@33 -- # echo 0 00:03:18.110 03:14:43 -- setup/common.sh@33 -- # return 0 00:03:18.110 03:14:43 -- setup/hugepages.sh@99 -- # surp=0 00:03:18.110 03:14:43 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:18.110 03:14:43 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:18.110 03:14:43 -- setup/common.sh@18 -- # local node= 00:03:18.110 03:14:43 -- setup/common.sh@19 -- # local var val 00:03:18.110 03:14:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.110 03:14:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.110 03:14:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.110 03:14:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.110 03:14:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.110 03:14:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39586664 kB' 'MemAvailable: 44344104 kB' 'Buffers: 3728 kB' 'Cached: 16483544 kB' 'SwapCached: 0 kB' 'Active: 12448432 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829540 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441436 kB' 'Mapped: 227124 kB' 'Shmem: 11391404 kB' 'KReclaimable: 306224 kB' 'Slab: 665080 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358856 kB' 'KernelStack: 12672 kB' 'PageTables: 8072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609872 kB' 'Committed_AS: 12960940 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195924 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.110 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.110 03:14:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.111 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.111 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.111 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.111 03:14:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.111 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.111 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.111 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.111 03:14:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.111 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.111 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.111 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.372 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.372 03:14:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.373 03:14:43 -- setup/common.sh@33 -- # echo 0 00:03:18.373 03:14:43 -- setup/common.sh@33 -- # return 0 00:03:18.373 03:14:43 -- setup/hugepages.sh@100 -- # resv=0 00:03:18.373 03:14:43 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:18.373 nr_hugepages=1025 00:03:18.373 03:14:43 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:18.373 resv_hugepages=0 00:03:18.373 03:14:43 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:18.373 surplus_hugepages=0 00:03:18.373 03:14:43 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:18.373 anon_hugepages=0 00:03:18.373 03:14:43 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:18.373 03:14:43 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:18.373 03:14:43 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:18.373 03:14:43 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:18.373 03:14:43 -- setup/common.sh@18 -- # local node= 00:03:18.373 03:14:43 -- setup/common.sh@19 -- # local var val 00:03:18.373 03:14:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.373 03:14:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.373 03:14:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.373 03:14:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.373 03:14:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.373 03:14:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39587320 kB' 'MemAvailable: 44344760 kB' 'Buffers: 3728 kB' 'Cached: 16483560 kB' 'SwapCached: 0 kB' 'Active: 12448440 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829548 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441448 kB' 'Mapped: 227124 kB' 'Shmem: 11391420 kB' 'KReclaimable: 306224 kB' 'Slab: 665080 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358856 kB' 'KernelStack: 12672 kB' 'PageTables: 8072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609872 kB' 'Committed_AS: 12960952 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195924 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.373 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.373 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.374 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.374 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.375 03:14:43 -- setup/common.sh@33 -- # echo 1025 00:03:18.375 03:14:43 -- setup/common.sh@33 -- # return 0 00:03:18.375 03:14:43 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:18.375 03:14:43 -- setup/hugepages.sh@112 -- # get_nodes 00:03:18.375 03:14:43 -- setup/hugepages.sh@27 -- # local node 00:03:18.375 03:14:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.375 03:14:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.375 03:14:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.375 03:14:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:18.375 03:14:43 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:18.375 03:14:43 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:18.375 03:14:43 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.375 03:14:43 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.375 03:14:43 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:18.375 03:14:43 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.375 03:14:43 -- setup/common.sh@18 -- # local node=0 00:03:18.375 03:14:43 -- setup/common.sh@19 -- # local var val 00:03:18.375 03:14:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.375 03:14:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.375 03:14:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:18.375 03:14:43 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:18.375 03:14:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.375 03:14:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 23879140 kB' 'MemUsed: 8997800 kB' 'SwapCached: 0 kB' 'Active: 6801772 kB' 'Inactive: 108712 kB' 'Active(anon): 6463512 kB' 'Inactive(anon): 0 kB' 'Active(file): 338260 kB' 'Inactive(file): 108712 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6678812 kB' 'Mapped: 120736 kB' 'AnonPages: 234852 kB' 'Shmem: 6231840 kB' 'KernelStack: 7480 kB' 'PageTables: 4744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98468 kB' 'Slab: 267580 kB' 'SReclaimable: 98468 kB' 'SUnreclaim: 169112 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.375 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.375 03:14:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@33 -- # echo 0 00:03:18.376 03:14:43 -- setup/common.sh@33 -- # return 0 00:03:18.376 03:14:43 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.376 03:14:43 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.376 03:14:43 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.376 03:14:43 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:18.376 03:14:43 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.376 03:14:43 -- setup/common.sh@18 -- # local node=1 00:03:18.376 03:14:43 -- setup/common.sh@19 -- # local var val 00:03:18.376 03:14:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.376 03:14:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.376 03:14:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:18.376 03:14:43 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:18.376 03:14:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.376 03:14:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27664796 kB' 'MemFree: 15708968 kB' 'MemUsed: 11955828 kB' 'SwapCached: 0 kB' 'Active: 5646368 kB' 'Inactive: 4368264 kB' 'Active(anon): 5365736 kB' 'Inactive(anon): 0 kB' 'Active(file): 280632 kB' 'Inactive(file): 4368264 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9808488 kB' 'Mapped: 106388 kB' 'AnonPages: 206268 kB' 'Shmem: 5159592 kB' 'KernelStack: 5176 kB' 'PageTables: 3284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 207756 kB' 'Slab: 397500 kB' 'SReclaimable: 207756 kB' 'SUnreclaim: 189744 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.376 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.376 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # continue 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.377 03:14:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.377 03:14:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.377 03:14:43 -- setup/common.sh@33 -- # echo 0 00:03:18.377 03:14:43 -- setup/common.sh@33 -- # return 0 00:03:18.377 03:14:43 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.377 03:14:43 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.377 03:14:43 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.377 03:14:43 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:18.377 node0=512 expecting 513 00:03:18.377 03:14:43 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.377 03:14:43 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.377 03:14:43 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.377 03:14:43 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:18.377 node1=513 expecting 512 00:03:18.377 03:14:43 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:18.377 00:03:18.377 real 0m1.453s 00:03:18.377 user 0m0.595s 00:03:18.377 sys 0m0.815s 00:03:18.377 03:14:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:18.377 03:14:43 -- common/autotest_common.sh@10 -- # set +x 00:03:18.377 ************************************ 00:03:18.377 END TEST odd_alloc 00:03:18.377 ************************************ 00:03:18.377 03:14:43 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:18.377 03:14:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:18.377 03:14:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:18.377 03:14:43 -- common/autotest_common.sh@10 -- # set +x 00:03:18.377 ************************************ 00:03:18.377 START TEST custom_alloc 00:03:18.377 ************************************ 00:03:18.377 03:14:43 -- common/autotest_common.sh@1111 -- # custom_alloc 00:03:18.377 03:14:43 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:18.377 03:14:43 -- setup/hugepages.sh@169 -- # local node 00:03:18.377 03:14:43 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:18.377 03:14:43 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:18.377 03:14:43 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:18.377 03:14:43 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:18.377 03:14:43 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:18.377 03:14:43 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:18.377 03:14:43 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:18.377 03:14:43 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:18.377 03:14:43 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:18.377 03:14:43 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:18.377 03:14:43 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:18.377 03:14:43 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:18.377 03:14:43 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:18.377 03:14:43 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:18.377 03:14:43 -- setup/hugepages.sh@83 -- # : 256 00:03:18.377 03:14:43 -- setup/hugepages.sh@84 -- # : 1 00:03:18.377 03:14:43 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:18.377 03:14:43 -- setup/hugepages.sh@83 -- # : 0 00:03:18.377 03:14:43 -- setup/hugepages.sh@84 -- # : 0 00:03:18.377 03:14:43 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:18.377 03:14:43 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:18.377 03:14:43 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:18.377 03:14:43 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:18.377 03:14:43 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:18.377 03:14:43 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:18.377 03:14:43 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:18.377 03:14:43 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:18.377 03:14:43 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:18.377 03:14:43 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:18.377 03:14:43 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:18.377 03:14:43 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:18.377 03:14:43 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:18.377 03:14:43 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:18.377 03:14:43 -- setup/hugepages.sh@78 -- # return 0 00:03:18.377 03:14:43 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:18.377 03:14:43 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:18.378 03:14:43 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:18.378 03:14:43 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:18.378 03:14:43 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:18.378 03:14:43 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:18.378 03:14:43 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:18.378 03:14:43 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:18.378 03:14:43 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:18.378 03:14:43 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:18.378 03:14:43 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:18.378 03:14:43 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:18.378 03:14:43 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:18.378 03:14:43 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:18.378 03:14:43 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:18.378 03:14:43 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:18.378 03:14:43 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:18.378 03:14:43 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:18.378 03:14:43 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:18.378 03:14:43 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:18.378 03:14:43 -- setup/hugepages.sh@78 -- # return 0 00:03:18.378 03:14:43 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:18.378 03:14:43 -- setup/hugepages.sh@187 -- # setup output 00:03:18.378 03:14:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:18.378 03:14:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:19.757 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.757 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.757 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.757 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.757 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.757 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.757 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.757 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.757 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.757 0000:0b:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:19.757 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.757 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.757 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.757 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.757 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.757 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.757 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.757 03:14:44 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:19.757 03:14:44 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:19.757 03:14:44 -- setup/hugepages.sh@89 -- # local node 00:03:19.757 03:14:44 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:19.757 03:14:44 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:19.757 03:14:44 -- setup/hugepages.sh@92 -- # local surp 00:03:19.757 03:14:44 -- setup/hugepages.sh@93 -- # local resv 00:03:19.757 03:14:44 -- setup/hugepages.sh@94 -- # local anon 00:03:19.757 03:14:44 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:19.757 03:14:44 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:19.757 03:14:44 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:19.757 03:14:44 -- setup/common.sh@18 -- # local node= 00:03:19.757 03:14:44 -- setup/common.sh@19 -- # local var val 00:03:19.757 03:14:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.757 03:14:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.757 03:14:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.757 03:14:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.757 03:14:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.757 03:14:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 38547020 kB' 'MemAvailable: 43304460 kB' 'Buffers: 3728 kB' 'Cached: 16483628 kB' 'SwapCached: 0 kB' 'Active: 12448712 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829820 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441596 kB' 'Mapped: 227308 kB' 'Shmem: 11391488 kB' 'KReclaimable: 306224 kB' 'Slab: 665204 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358980 kB' 'KernelStack: 12672 kB' 'PageTables: 8080 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086608 kB' 'Committed_AS: 12961012 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195876 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 03:14:44 -- setup/common.sh@33 -- # echo 0 00:03:19.758 03:14:44 -- setup/common.sh@33 -- # return 0 00:03:19.758 03:14:44 -- setup/hugepages.sh@97 -- # anon=0 00:03:19.758 03:14:44 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:19.758 03:14:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.758 03:14:44 -- setup/common.sh@18 -- # local node= 00:03:19.758 03:14:44 -- setup/common.sh@19 -- # local var val 00:03:19.758 03:14:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.758 03:14:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.758 03:14:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.758 03:14:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.758 03:14:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.758 03:14:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 38546012 kB' 'MemAvailable: 43303452 kB' 'Buffers: 3728 kB' 'Cached: 16483628 kB' 'SwapCached: 0 kB' 'Active: 12448676 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829784 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441528 kB' 'Mapped: 227172 kB' 'Shmem: 11391488 kB' 'KReclaimable: 306224 kB' 'Slab: 665196 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358972 kB' 'KernelStack: 12672 kB' 'PageTables: 8080 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086608 kB' 'Committed_AS: 12961024 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195876 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.759 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.760 03:14:44 -- setup/common.sh@33 -- # echo 0 00:03:19.760 03:14:44 -- setup/common.sh@33 -- # return 0 00:03:19.760 03:14:44 -- setup/hugepages.sh@99 -- # surp=0 00:03:19.760 03:14:44 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:19.760 03:14:44 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:19.760 03:14:44 -- setup/common.sh@18 -- # local node= 00:03:19.760 03:14:44 -- setup/common.sh@19 -- # local var val 00:03:19.760 03:14:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.760 03:14:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.760 03:14:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.760 03:14:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.760 03:14:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.760 03:14:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 38545508 kB' 'MemAvailable: 43302948 kB' 'Buffers: 3728 kB' 'Cached: 16483640 kB' 'SwapCached: 0 kB' 'Active: 12448756 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829864 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441488 kB' 'Mapped: 227172 kB' 'Shmem: 11391500 kB' 'KReclaimable: 306224 kB' 'Slab: 665196 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358972 kB' 'KernelStack: 12656 kB' 'PageTables: 8028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086608 kB' 'Committed_AS: 12961040 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195860 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.760 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.760 03:14:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.761 03:14:44 -- setup/common.sh@33 -- # echo 0 00:03:19.761 03:14:44 -- setup/common.sh@33 -- # return 0 00:03:19.761 03:14:44 -- setup/hugepages.sh@100 -- # resv=0 00:03:19.761 03:14:44 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:19.761 nr_hugepages=1536 00:03:19.761 03:14:44 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:19.761 resv_hugepages=0 00:03:19.761 03:14:44 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:19.761 surplus_hugepages=0 00:03:19.761 03:14:44 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:19.761 anon_hugepages=0 00:03:19.761 03:14:44 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:19.761 03:14:44 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:19.761 03:14:44 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:19.761 03:14:44 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:19.761 03:14:44 -- setup/common.sh@18 -- # local node= 00:03:19.761 03:14:44 -- setup/common.sh@19 -- # local var val 00:03:19.761 03:14:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.761 03:14:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.761 03:14:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.761 03:14:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.761 03:14:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.761 03:14:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 38545508 kB' 'MemAvailable: 43302948 kB' 'Buffers: 3728 kB' 'Cached: 16483656 kB' 'SwapCached: 0 kB' 'Active: 12448724 kB' 'Inactive: 4476976 kB' 'Active(anon): 11829832 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 441472 kB' 'Mapped: 227172 kB' 'Shmem: 11391516 kB' 'KReclaimable: 306224 kB' 'Slab: 665196 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358972 kB' 'KernelStack: 12640 kB' 'PageTables: 7984 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086608 kB' 'Committed_AS: 12961052 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195860 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.761 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.761 03:14:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.762 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.762 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.763 03:14:44 -- setup/common.sh@33 -- # echo 1536 00:03:19.763 03:14:44 -- setup/common.sh@33 -- # return 0 00:03:19.763 03:14:44 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:19.763 03:14:44 -- setup/hugepages.sh@112 -- # get_nodes 00:03:19.763 03:14:44 -- setup/hugepages.sh@27 -- # local node 00:03:19.763 03:14:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.763 03:14:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:19.763 03:14:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.763 03:14:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:19.763 03:14:44 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:19.763 03:14:44 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:19.763 03:14:44 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.763 03:14:44 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.763 03:14:44 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:19.763 03:14:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.763 03:14:44 -- setup/common.sh@18 -- # local node=0 00:03:19.763 03:14:44 -- setup/common.sh@19 -- # local var val 00:03:19.763 03:14:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.763 03:14:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.763 03:14:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:19.763 03:14:44 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:19.763 03:14:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.763 03:14:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 23879912 kB' 'MemUsed: 8997028 kB' 'SwapCached: 0 kB' 'Active: 6802064 kB' 'Inactive: 108712 kB' 'Active(anon): 6463804 kB' 'Inactive(anon): 0 kB' 'Active(file): 338260 kB' 'Inactive(file): 108712 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6678860 kB' 'Mapped: 120784 kB' 'AnonPages: 235000 kB' 'Shmem: 6231888 kB' 'KernelStack: 7448 kB' 'PageTables: 4656 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98468 kB' 'Slab: 267652 kB' 'SReclaimable: 98468 kB' 'SUnreclaim: 169184 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.763 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.763 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@33 -- # echo 0 00:03:19.764 03:14:44 -- setup/common.sh@33 -- # return 0 00:03:19.764 03:14:44 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.764 03:14:44 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.764 03:14:44 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.764 03:14:44 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:19.764 03:14:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.764 03:14:44 -- setup/common.sh@18 -- # local node=1 00:03:19.764 03:14:44 -- setup/common.sh@19 -- # local var val 00:03:19.764 03:14:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.764 03:14:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.764 03:14:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:19.764 03:14:44 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:19.764 03:14:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.764 03:14:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27664796 kB' 'MemFree: 14665940 kB' 'MemUsed: 12998856 kB' 'SwapCached: 0 kB' 'Active: 5646688 kB' 'Inactive: 4368264 kB' 'Active(anon): 5366056 kB' 'Inactive(anon): 0 kB' 'Active(file): 280632 kB' 'Inactive(file): 4368264 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9808552 kB' 'Mapped: 106388 kB' 'AnonPages: 206412 kB' 'Shmem: 5159656 kB' 'KernelStack: 5176 kB' 'PageTables: 3284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 207756 kB' 'Slab: 397544 kB' 'SReclaimable: 207756 kB' 'SUnreclaim: 189788 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.764 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.764 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # continue 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.765 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.765 03:14:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # continue 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # continue 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # continue 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # continue 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # continue 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # continue 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # continue 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # continue 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # continue 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 03:14:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 03:14:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.023 03:14:44 -- setup/common.sh@33 -- # echo 0 00:03:20.023 03:14:44 -- setup/common.sh@33 -- # return 0 00:03:20.023 03:14:44 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.023 03:14:44 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.023 03:14:44 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.023 03:14:44 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.023 03:14:44 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:20.023 node0=512 expecting 512 00:03:20.023 03:14:44 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.023 03:14:44 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.023 03:14:44 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.023 03:14:44 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:20.023 node1=1024 expecting 1024 00:03:20.023 03:14:44 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:20.023 00:03:20.023 real 0m1.449s 00:03:20.023 user 0m0.580s 00:03:20.023 sys 0m0.825s 00:03:20.023 03:14:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:20.023 03:14:44 -- common/autotest_common.sh@10 -- # set +x 00:03:20.023 ************************************ 00:03:20.023 END TEST custom_alloc 00:03:20.023 ************************************ 00:03:20.023 03:14:44 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:20.023 03:14:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:20.023 03:14:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:20.023 03:14:44 -- common/autotest_common.sh@10 -- # set +x 00:03:20.023 ************************************ 00:03:20.023 START TEST no_shrink_alloc 00:03:20.023 ************************************ 00:03:20.023 03:14:44 -- common/autotest_common.sh@1111 -- # no_shrink_alloc 00:03:20.023 03:14:44 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:20.023 03:14:44 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:20.023 03:14:44 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:20.023 03:14:44 -- setup/hugepages.sh@51 -- # shift 00:03:20.023 03:14:44 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:20.023 03:14:44 -- setup/hugepages.sh@52 -- # local node_ids 00:03:20.023 03:14:44 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:20.023 03:14:44 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:20.023 03:14:44 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:20.023 03:14:44 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:20.023 03:14:44 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:20.023 03:14:44 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:20.023 03:14:44 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:20.023 03:14:44 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:20.023 03:14:44 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:20.023 03:14:44 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:20.023 03:14:44 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:20.023 03:14:44 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:20.023 03:14:44 -- setup/hugepages.sh@73 -- # return 0 00:03:20.023 03:14:44 -- setup/hugepages.sh@198 -- # setup output 00:03:20.023 03:14:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:20.023 03:14:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.962 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.962 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.962 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.962 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.962 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.962 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.962 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.962 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.223 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:21.223 0000:0b:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:21.223 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:21.223 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:21.223 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:21.223 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:21.223 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:21.223 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:21.223 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.223 03:14:46 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:21.223 03:14:46 -- setup/hugepages.sh@89 -- # local node 00:03:21.223 03:14:46 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:21.223 03:14:46 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:21.223 03:14:46 -- setup/hugepages.sh@92 -- # local surp 00:03:21.223 03:14:46 -- setup/hugepages.sh@93 -- # local resv 00:03:21.223 03:14:46 -- setup/hugepages.sh@94 -- # local anon 00:03:21.223 03:14:46 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:21.223 03:14:46 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:21.223 03:14:46 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:21.223 03:14:46 -- setup/common.sh@18 -- # local node= 00:03:21.223 03:14:46 -- setup/common.sh@19 -- # local var val 00:03:21.223 03:14:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.223 03:14:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.223 03:14:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.223 03:14:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.223 03:14:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.223 03:14:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39578752 kB' 'MemAvailable: 44336192 kB' 'Buffers: 3728 kB' 'Cached: 16483724 kB' 'SwapCached: 0 kB' 'Active: 12451004 kB' 'Inactive: 4476976 kB' 'Active(anon): 11832112 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443824 kB' 'Mapped: 227284 kB' 'Shmem: 11391584 kB' 'KReclaimable: 306224 kB' 'Slab: 665388 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 359164 kB' 'KernelStack: 13120 kB' 'PageTables: 9132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12963072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196404 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.223 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.223 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.224 03:14:46 -- setup/common.sh@33 -- # echo 0 00:03:21.224 03:14:46 -- setup/common.sh@33 -- # return 0 00:03:21.224 03:14:46 -- setup/hugepages.sh@97 -- # anon=0 00:03:21.224 03:14:46 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:21.224 03:14:46 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.224 03:14:46 -- setup/common.sh@18 -- # local node= 00:03:21.224 03:14:46 -- setup/common.sh@19 -- # local var val 00:03:21.224 03:14:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.224 03:14:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.224 03:14:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.224 03:14:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.224 03:14:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.224 03:14:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39584852 kB' 'MemAvailable: 44342292 kB' 'Buffers: 3728 kB' 'Cached: 16483724 kB' 'SwapCached: 0 kB' 'Active: 12450988 kB' 'Inactive: 4476976 kB' 'Active(anon): 11832096 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443696 kB' 'Mapped: 227296 kB' 'Shmem: 11391584 kB' 'KReclaimable: 306224 kB' 'Slab: 665376 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 359152 kB' 'KernelStack: 13104 kB' 'PageTables: 9028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12963604 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196212 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.224 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.224 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.225 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.225 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.226 03:14:46 -- setup/common.sh@33 -- # echo 0 00:03:21.226 03:14:46 -- setup/common.sh@33 -- # return 0 00:03:21.226 03:14:46 -- setup/hugepages.sh@99 -- # surp=0 00:03:21.226 03:14:46 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:21.226 03:14:46 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:21.226 03:14:46 -- setup/common.sh@18 -- # local node= 00:03:21.226 03:14:46 -- setup/common.sh@19 -- # local var val 00:03:21.226 03:14:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.226 03:14:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.226 03:14:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.226 03:14:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.226 03:14:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.226 03:14:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39583696 kB' 'MemAvailable: 44341136 kB' 'Buffers: 3728 kB' 'Cached: 16483740 kB' 'SwapCached: 0 kB' 'Active: 12451036 kB' 'Inactive: 4476976 kB' 'Active(anon): 11832144 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443832 kB' 'Mapped: 227208 kB' 'Shmem: 11391600 kB' 'KReclaimable: 306224 kB' 'Slab: 665540 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 359316 kB' 'KernelStack: 13120 kB' 'PageTables: 9244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12963260 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196196 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.226 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.226 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.227 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.227 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.227 03:14:46 -- setup/common.sh@33 -- # echo 0 00:03:21.227 03:14:46 -- setup/common.sh@33 -- # return 0 00:03:21.227 03:14:46 -- setup/hugepages.sh@100 -- # resv=0 00:03:21.227 03:14:46 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:21.227 nr_hugepages=1024 00:03:21.227 03:14:46 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:21.227 resv_hugepages=0 00:03:21.227 03:14:46 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:21.227 surplus_hugepages=0 00:03:21.227 03:14:46 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:21.227 anon_hugepages=0 00:03:21.227 03:14:46 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:21.227 03:14:46 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:21.227 03:14:46 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:21.227 03:14:46 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:21.227 03:14:46 -- setup/common.sh@18 -- # local node= 00:03:21.227 03:14:46 -- setup/common.sh@19 -- # local var val 00:03:21.227 03:14:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.227 03:14:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.227 03:14:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.227 03:14:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.227 03:14:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.227 03:14:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39583376 kB' 'MemAvailable: 44340816 kB' 'Buffers: 3728 kB' 'Cached: 16483752 kB' 'SwapCached: 0 kB' 'Active: 12450956 kB' 'Inactive: 4476976 kB' 'Active(anon): 11832064 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 443740 kB' 'Mapped: 227208 kB' 'Shmem: 11391612 kB' 'KReclaimable: 306224 kB' 'Slab: 665540 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 359316 kB' 'KernelStack: 12848 kB' 'PageTables: 9240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12961240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196020 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.487 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.487 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.488 03:14:46 -- setup/common.sh@33 -- # echo 1024 00:03:21.488 03:14:46 -- setup/common.sh@33 -- # return 0 00:03:21.488 03:14:46 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:21.488 03:14:46 -- setup/hugepages.sh@112 -- # get_nodes 00:03:21.488 03:14:46 -- setup/hugepages.sh@27 -- # local node 00:03:21.488 03:14:46 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.488 03:14:46 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:21.488 03:14:46 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.488 03:14:46 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:21.488 03:14:46 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.488 03:14:46 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.488 03:14:46 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.488 03:14:46 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.488 03:14:46 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:21.488 03:14:46 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.488 03:14:46 -- setup/common.sh@18 -- # local node=0 00:03:21.488 03:14:46 -- setup/common.sh@19 -- # local var val 00:03:21.488 03:14:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.488 03:14:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.488 03:14:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:21.488 03:14:46 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:21.488 03:14:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.488 03:14:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 22836744 kB' 'MemUsed: 10040196 kB' 'SwapCached: 0 kB' 'Active: 6802748 kB' 'Inactive: 108712 kB' 'Active(anon): 6464488 kB' 'Inactive(anon): 0 kB' 'Active(file): 338260 kB' 'Inactive(file): 108712 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6678872 kB' 'Mapped: 120816 kB' 'AnonPages: 235804 kB' 'Shmem: 6231900 kB' 'KernelStack: 7512 kB' 'PageTables: 4780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98468 kB' 'Slab: 267624 kB' 'SReclaimable: 98468 kB' 'SUnreclaim: 169156 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.488 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.488 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # continue 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.489 03:14:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.489 03:14:46 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.489 03:14:46 -- setup/common.sh@33 -- # echo 0 00:03:21.489 03:14:46 -- setup/common.sh@33 -- # return 0 00:03:21.489 03:14:46 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.489 03:14:46 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.489 03:14:46 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.489 03:14:46 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.489 03:14:46 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:21.489 node0=1024 expecting 1024 00:03:21.489 03:14:46 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:21.489 03:14:46 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:21.489 03:14:46 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:21.489 03:14:46 -- setup/hugepages.sh@202 -- # setup output 00:03:21.489 03:14:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.489 03:14:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:22.424 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:22.424 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:22.424 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:22.424 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:22.424 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:22.424 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:22.424 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:22.424 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:22.424 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:22.424 0000:0b:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:22.424 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:22.424 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:22.424 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:22.424 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:22.424 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:22.424 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:22.424 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:22.686 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:22.686 03:14:47 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:22.686 03:14:47 -- setup/hugepages.sh@89 -- # local node 00:03:22.686 03:14:47 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:22.686 03:14:47 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:22.686 03:14:47 -- setup/hugepages.sh@92 -- # local surp 00:03:22.686 03:14:47 -- setup/hugepages.sh@93 -- # local resv 00:03:22.686 03:14:47 -- setup/hugepages.sh@94 -- # local anon 00:03:22.686 03:14:47 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:22.686 03:14:47 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:22.686 03:14:47 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:22.686 03:14:47 -- setup/common.sh@18 -- # local node= 00:03:22.686 03:14:47 -- setup/common.sh@19 -- # local var val 00:03:22.686 03:14:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.686 03:14:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.686 03:14:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.686 03:14:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.686 03:14:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.686 03:14:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39562668 kB' 'MemAvailable: 44320108 kB' 'Buffers: 3728 kB' 'Cached: 16483804 kB' 'SwapCached: 0 kB' 'Active: 12449360 kB' 'Inactive: 4476976 kB' 'Active(anon): 11830468 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 442032 kB' 'Mapped: 227248 kB' 'Shmem: 11391664 kB' 'KReclaimable: 306224 kB' 'Slab: 665080 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358856 kB' 'KernelStack: 12688 kB' 'PageTables: 8000 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12961280 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196020 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.686 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.686 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.687 03:14:47 -- setup/common.sh@33 -- # echo 0 00:03:22.687 03:14:47 -- setup/common.sh@33 -- # return 0 00:03:22.687 03:14:47 -- setup/hugepages.sh@97 -- # anon=0 00:03:22.687 03:14:47 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:22.687 03:14:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.687 03:14:47 -- setup/common.sh@18 -- # local node= 00:03:22.687 03:14:47 -- setup/common.sh@19 -- # local var val 00:03:22.687 03:14:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.687 03:14:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.687 03:14:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.687 03:14:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.687 03:14:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.687 03:14:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39563104 kB' 'MemAvailable: 44320544 kB' 'Buffers: 3728 kB' 'Cached: 16483804 kB' 'SwapCached: 0 kB' 'Active: 12449816 kB' 'Inactive: 4476976 kB' 'Active(anon): 11830924 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 442448 kB' 'Mapped: 227208 kB' 'Shmem: 11391664 kB' 'KReclaimable: 306224 kB' 'Slab: 665088 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358864 kB' 'KernelStack: 12704 kB' 'PageTables: 8036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12961292 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195988 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.687 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.687 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.688 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.688 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.689 03:14:47 -- setup/common.sh@33 -- # echo 0 00:03:22.689 03:14:47 -- setup/common.sh@33 -- # return 0 00:03:22.689 03:14:47 -- setup/hugepages.sh@99 -- # surp=0 00:03:22.689 03:14:47 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:22.689 03:14:47 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:22.689 03:14:47 -- setup/common.sh@18 -- # local node= 00:03:22.689 03:14:47 -- setup/common.sh@19 -- # local var val 00:03:22.689 03:14:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.689 03:14:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.689 03:14:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.689 03:14:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.689 03:14:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.689 03:14:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39563152 kB' 'MemAvailable: 44320592 kB' 'Buffers: 3728 kB' 'Cached: 16483816 kB' 'SwapCached: 0 kB' 'Active: 12449368 kB' 'Inactive: 4476976 kB' 'Active(anon): 11830476 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 442020 kB' 'Mapped: 227208 kB' 'Shmem: 11391676 kB' 'KReclaimable: 306224 kB' 'Slab: 665112 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358888 kB' 'KernelStack: 12720 kB' 'PageTables: 8088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12961308 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195988 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.689 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.689 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.690 03:14:47 -- setup/common.sh@33 -- # echo 0 00:03:22.690 03:14:47 -- setup/common.sh@33 -- # return 0 00:03:22.690 03:14:47 -- setup/hugepages.sh@100 -- # resv=0 00:03:22.690 03:14:47 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:22.690 nr_hugepages=1024 00:03:22.690 03:14:47 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:22.690 resv_hugepages=0 00:03:22.690 03:14:47 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:22.690 surplus_hugepages=0 00:03:22.690 03:14:47 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:22.690 anon_hugepages=0 00:03:22.690 03:14:47 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.690 03:14:47 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:22.690 03:14:47 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:22.690 03:14:47 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:22.690 03:14:47 -- setup/common.sh@18 -- # local node= 00:03:22.690 03:14:47 -- setup/common.sh@19 -- # local var val 00:03:22.690 03:14:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.690 03:14:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.690 03:14:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.690 03:14:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.690 03:14:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.690 03:14:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 39563152 kB' 'MemAvailable: 44320592 kB' 'Buffers: 3728 kB' 'Cached: 16483816 kB' 'SwapCached: 0 kB' 'Active: 12449520 kB' 'Inactive: 4476976 kB' 'Active(anon): 11830628 kB' 'Inactive(anon): 0 kB' 'Active(file): 618892 kB' 'Inactive(file): 4476976 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 442172 kB' 'Mapped: 227208 kB' 'Shmem: 11391676 kB' 'KReclaimable: 306224 kB' 'Slab: 665112 kB' 'SReclaimable: 306224 kB' 'SUnreclaim: 358888 kB' 'KernelStack: 12720 kB' 'PageTables: 8088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 12961320 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195988 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1713756 kB' 'DirectMap2M: 18128896 kB' 'DirectMap1G: 49283072 kB' 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.690 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.690 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.691 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.691 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.692 03:14:47 -- setup/common.sh@33 -- # echo 1024 00:03:22.692 03:14:47 -- setup/common.sh@33 -- # return 0 00:03:22.692 03:14:47 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.692 03:14:47 -- setup/hugepages.sh@112 -- # get_nodes 00:03:22.692 03:14:47 -- setup/hugepages.sh@27 -- # local node 00:03:22.692 03:14:47 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.692 03:14:47 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:22.692 03:14:47 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.692 03:14:47 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:22.692 03:14:47 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:22.692 03:14:47 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:22.692 03:14:47 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.692 03:14:47 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.692 03:14:47 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:22.692 03:14:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.692 03:14:47 -- setup/common.sh@18 -- # local node=0 00:03:22.692 03:14:47 -- setup/common.sh@19 -- # local var val 00:03:22.692 03:14:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.692 03:14:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.692 03:14:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:22.692 03:14:47 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:22.692 03:14:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.692 03:14:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 22829148 kB' 'MemUsed: 10047792 kB' 'SwapCached: 0 kB' 'Active: 6803048 kB' 'Inactive: 108712 kB' 'Active(anon): 6464788 kB' 'Inactive(anon): 0 kB' 'Active(file): 338260 kB' 'Inactive(file): 108712 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6678884 kB' 'Mapped: 120824 kB' 'AnonPages: 236024 kB' 'Shmem: 6231912 kB' 'KernelStack: 7512 kB' 'PageTables: 4808 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98468 kB' 'Slab: 267412 kB' 'SReclaimable: 98468 kB' 'SUnreclaim: 168944 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.692 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.692 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # continue 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.693 03:14:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.693 03:14:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.693 03:14:47 -- setup/common.sh@33 -- # echo 0 00:03:22.693 03:14:47 -- setup/common.sh@33 -- # return 0 00:03:22.693 03:14:47 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.693 03:14:47 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.693 03:14:47 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.693 03:14:47 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.693 03:14:47 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:22.693 node0=1024 expecting 1024 00:03:22.693 03:14:47 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:22.693 00:03:22.693 real 0m2.722s 00:03:22.693 user 0m1.092s 00:03:22.693 sys 0m1.543s 00:03:22.693 03:14:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:22.693 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:03:22.693 ************************************ 00:03:22.693 END TEST no_shrink_alloc 00:03:22.693 ************************************ 00:03:22.693 03:14:47 -- setup/hugepages.sh@217 -- # clear_hp 00:03:22.693 03:14:47 -- setup/hugepages.sh@37 -- # local node hp 00:03:22.693 03:14:47 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:22.693 03:14:47 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:22.693 03:14:47 -- setup/hugepages.sh@41 -- # echo 0 00:03:22.693 03:14:47 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:22.693 03:14:47 -- setup/hugepages.sh@41 -- # echo 0 00:03:22.693 03:14:47 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:22.693 03:14:47 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:22.693 03:14:47 -- setup/hugepages.sh@41 -- # echo 0 00:03:22.693 03:14:47 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:22.693 03:14:47 -- setup/hugepages.sh@41 -- # echo 0 00:03:22.693 03:14:47 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:22.693 03:14:47 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:22.693 00:03:22.693 real 0m11.869s 00:03:22.693 user 0m4.436s 00:03:22.693 sys 0m6.209s 00:03:22.693 03:14:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:22.693 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:03:22.693 ************************************ 00:03:22.693 END TEST hugepages 00:03:22.693 ************************************ 00:03:22.693 03:14:47 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:22.693 03:14:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.693 03:14:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.693 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:03:22.952 ************************************ 00:03:22.952 START TEST driver 00:03:22.952 ************************************ 00:03:22.952 03:14:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:22.952 * Looking for test storage... 00:03:22.952 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:22.952 03:14:47 -- setup/driver.sh@68 -- # setup reset 00:03:22.952 03:14:47 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:22.952 03:14:47 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:25.481 03:14:50 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:25.481 03:14:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:25.481 03:14:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:25.481 03:14:50 -- common/autotest_common.sh@10 -- # set +x 00:03:25.481 ************************************ 00:03:25.481 START TEST guess_driver 00:03:25.481 ************************************ 00:03:25.481 03:14:50 -- common/autotest_common.sh@1111 -- # guess_driver 00:03:25.481 03:14:50 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:25.481 03:14:50 -- setup/driver.sh@47 -- # local fail=0 00:03:25.481 03:14:50 -- setup/driver.sh@49 -- # pick_driver 00:03:25.481 03:14:50 -- setup/driver.sh@36 -- # vfio 00:03:25.481 03:14:50 -- setup/driver.sh@21 -- # local iommu_grups 00:03:25.481 03:14:50 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:25.481 03:14:50 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:25.481 03:14:50 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:25.481 03:14:50 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:25.481 03:14:50 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:25.481 03:14:50 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:25.481 03:14:50 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:25.481 03:14:50 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:25.481 03:14:50 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:25.481 03:14:50 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:25.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:25.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:25.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:25.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:25.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:25.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:25.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:25.481 03:14:50 -- setup/driver.sh@30 -- # return 0 00:03:25.481 03:14:50 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:25.481 03:14:50 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:25.481 03:14:50 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:25.481 03:14:50 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:25.481 Looking for driver=vfio-pci 00:03:25.481 03:14:50 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:25.481 03:14:50 -- setup/driver.sh@45 -- # setup output config 00:03:25.481 03:14:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:25.481 03:14:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.856 03:14:51 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.856 03:14:51 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.856 03:14:51 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.828 03:14:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.828 03:14:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.828 03:14:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.828 03:14:52 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:27.828 03:14:52 -- setup/driver.sh@65 -- # setup reset 00:03:27.828 03:14:52 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:27.828 03:14:52 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:30.368 00:03:30.368 real 0m4.773s 00:03:30.368 user 0m1.135s 00:03:30.368 sys 0m1.760s 00:03:30.368 03:14:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:30.368 03:14:55 -- common/autotest_common.sh@10 -- # set +x 00:03:30.368 ************************************ 00:03:30.368 END TEST guess_driver 00:03:30.368 ************************************ 00:03:30.368 00:03:30.368 real 0m7.380s 00:03:30.368 user 0m1.707s 00:03:30.368 sys 0m2.775s 00:03:30.368 03:14:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:30.368 03:14:55 -- common/autotest_common.sh@10 -- # set +x 00:03:30.368 ************************************ 00:03:30.368 END TEST driver 00:03:30.368 ************************************ 00:03:30.368 03:14:55 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:30.368 03:14:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:30.368 03:14:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:30.368 03:14:55 -- common/autotest_common.sh@10 -- # set +x 00:03:30.368 ************************************ 00:03:30.368 START TEST devices 00:03:30.368 ************************************ 00:03:30.368 03:14:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:30.368 * Looking for test storage... 00:03:30.368 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:30.368 03:14:55 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:30.368 03:14:55 -- setup/devices.sh@192 -- # setup reset 00:03:30.368 03:14:55 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:30.368 03:14:55 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:32.269 03:14:56 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:32.269 03:14:56 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:32.269 03:14:56 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:32.269 03:14:56 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:32.269 03:14:56 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:32.269 03:14:56 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:32.269 03:14:56 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:32.269 03:14:56 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:32.269 03:14:56 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:32.269 03:14:56 -- setup/devices.sh@196 -- # blocks=() 00:03:32.269 03:14:56 -- setup/devices.sh@196 -- # declare -a blocks 00:03:32.269 03:14:56 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:32.269 03:14:56 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:32.269 03:14:56 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:32.269 03:14:56 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:32.269 03:14:56 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:32.269 03:14:56 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:32.269 03:14:56 -- setup/devices.sh@202 -- # pci=0000:0b:00.0 00:03:32.269 03:14:56 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\0\b\:\0\0\.\0* ]] 00:03:32.269 03:14:56 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:32.269 03:14:56 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:03:32.269 03:14:56 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:32.269 No valid GPT data, bailing 00:03:32.269 03:14:56 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:32.269 03:14:56 -- scripts/common.sh@391 -- # pt= 00:03:32.269 03:14:56 -- scripts/common.sh@392 -- # return 1 00:03:32.269 03:14:56 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:32.269 03:14:56 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:32.269 03:14:56 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:32.269 03:14:56 -- setup/common.sh@80 -- # echo 1000204886016 00:03:32.269 03:14:56 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:32.269 03:14:56 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:32.269 03:14:56 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:0b:00.0 00:03:32.269 03:14:56 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:32.269 03:14:56 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:32.269 03:14:56 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:32.269 03:14:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:32.269 03:14:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:32.269 03:14:56 -- common/autotest_common.sh@10 -- # set +x 00:03:32.269 ************************************ 00:03:32.269 START TEST nvme_mount 00:03:32.269 ************************************ 00:03:32.269 03:14:57 -- common/autotest_common.sh@1111 -- # nvme_mount 00:03:32.269 03:14:57 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:32.269 03:14:57 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:32.269 03:14:57 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.269 03:14:57 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:32.269 03:14:57 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:32.269 03:14:57 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:32.269 03:14:57 -- setup/common.sh@40 -- # local part_no=1 00:03:32.269 03:14:57 -- setup/common.sh@41 -- # local size=1073741824 00:03:32.269 03:14:57 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:32.269 03:14:57 -- setup/common.sh@44 -- # parts=() 00:03:32.269 03:14:57 -- setup/common.sh@44 -- # local parts 00:03:32.269 03:14:57 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:32.269 03:14:57 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:32.269 03:14:57 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:32.269 03:14:57 -- setup/common.sh@46 -- # (( part++ )) 00:03:32.269 03:14:57 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:32.269 03:14:57 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:32.269 03:14:57 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:32.269 03:14:57 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:33.201 Creating new GPT entries in memory. 00:03:33.201 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:33.201 other utilities. 00:03:33.201 03:14:58 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:33.201 03:14:58 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:33.201 03:14:58 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:33.201 03:14:58 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:33.201 03:14:58 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:34.133 Creating new GPT entries in memory. 00:03:34.133 The operation has completed successfully. 00:03:34.133 03:14:59 -- setup/common.sh@57 -- # (( part++ )) 00:03:34.133 03:14:59 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:34.133 03:14:59 -- setup/common.sh@62 -- # wait 1321393 00:03:34.133 03:14:59 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.133 03:14:59 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:34.133 03:14:59 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.133 03:14:59 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:34.133 03:14:59 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:34.390 03:14:59 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.390 03:14:59 -- setup/devices.sh@105 -- # verify 0000:0b:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:34.390 03:14:59 -- setup/devices.sh@48 -- # local dev=0000:0b:00.0 00:03:34.390 03:14:59 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:34.390 03:14:59 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.390 03:14:59 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:34.390 03:14:59 -- setup/devices.sh@53 -- # local found=0 00:03:34.390 03:14:59 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:34.390 03:14:59 -- setup/devices.sh@56 -- # : 00:03:34.390 03:14:59 -- setup/devices.sh@59 -- # local pci status 00:03:34.390 03:14:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.390 03:14:59 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:0b:00.0 00:03:34.390 03:14:59 -- setup/devices.sh@47 -- # setup output config 00:03:34.390 03:14:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:34.390 03:14:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:35.321 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.321 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.321 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.321 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.321 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.321 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.321 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.321 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.321 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.321 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.321 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.321 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.321 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.321 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.322 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:0b:00.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:35.322 03:15:00 -- setup/devices.sh@63 -- # found=1 00:03:35.322 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.322 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.322 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.322 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.322 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.322 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.322 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.322 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.322 03:15:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:35.322 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.578 03:15:00 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:35.578 03:15:00 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:35.578 03:15:00 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.578 03:15:00 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:35.578 03:15:00 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:35.578 03:15:00 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:35.578 03:15:00 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.578 03:15:00 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.578 03:15:00 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:35.578 03:15:00 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:35.578 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:35.578 03:15:00 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:35.578 03:15:00 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:35.836 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:35.836 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:35.836 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:35.836 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:35.836 03:15:00 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:35.836 03:15:00 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:35.836 03:15:00 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.836 03:15:00 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:35.836 03:15:00 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:35.836 03:15:00 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.836 03:15:00 -- setup/devices.sh@116 -- # verify 0000:0b:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:35.836 03:15:00 -- setup/devices.sh@48 -- # local dev=0000:0b:00.0 00:03:35.836 03:15:00 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:35.836 03:15:00 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.836 03:15:00 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:35.836 03:15:00 -- setup/devices.sh@53 -- # local found=0 00:03:35.836 03:15:00 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:35.836 03:15:00 -- setup/devices.sh@56 -- # : 00:03:35.836 03:15:00 -- setup/devices.sh@59 -- # local pci status 00:03:35.836 03:15:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.836 03:15:00 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:0b:00.0 00:03:35.836 03:15:00 -- setup/devices.sh@47 -- # setup output config 00:03:35.836 03:15:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:35.836 03:15:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:36.770 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:36.770 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.770 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:36.770 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.770 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:36.770 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.770 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:36.770 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.770 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:36.770 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.770 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:36.770 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.770 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:36.770 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.770 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:36.770 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:0b:00.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.027 03:15:01 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:37.027 03:15:01 -- setup/devices.sh@63 -- # found=1 00:03:37.027 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.027 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.027 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.027 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.027 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.027 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.027 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.027 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.027 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:37.027 03:15:01 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:37.027 03:15:01 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.027 03:15:01 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:37.027 03:15:01 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.027 03:15:01 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.027 03:15:01 -- setup/devices.sh@125 -- # verify 0000:0b:00.0 data@nvme0n1 '' '' 00:03:37.027 03:15:01 -- setup/devices.sh@48 -- # local dev=0000:0b:00.0 00:03:37.027 03:15:01 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:37.027 03:15:01 -- setup/devices.sh@50 -- # local mount_point= 00:03:37.027 03:15:01 -- setup/devices.sh@51 -- # local test_file= 00:03:37.027 03:15:01 -- setup/devices.sh@53 -- # local found=0 00:03:37.027 03:15:01 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:37.027 03:15:01 -- setup/devices.sh@59 -- # local pci status 00:03:37.027 03:15:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.027 03:15:01 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:0b:00.0 00:03:37.027 03:15:01 -- setup/devices.sh@47 -- # setup output config 00:03:37.027 03:15:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:37.027 03:15:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:37.961 03:15:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.961 03:15:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.961 03:15:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.961 03:15:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.961 03:15:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.961 03:15:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.961 03:15:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.961 03:15:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.961 03:15:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.961 03:15:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.961 03:15:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.961 03:15:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.961 03:15:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.961 03:15:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.961 03:15:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:37.961 03:15:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.219 03:15:03 -- setup/devices.sh@62 -- # [[ 0000:0b:00.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:38.219 03:15:03 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:38.219 03:15:03 -- setup/devices.sh@63 -- # found=1 00:03:38.219 03:15:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.219 03:15:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:38.219 03:15:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.219 03:15:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:38.219 03:15:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.219 03:15:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:38.219 03:15:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.219 03:15:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:38.219 03:15:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.219 03:15:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:38.219 03:15:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.219 03:15:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:38.219 03:15:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.219 03:15:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:38.219 03:15:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.219 03:15:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:38.219 03:15:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.478 03:15:03 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:38.478 03:15:03 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:38.478 03:15:03 -- setup/devices.sh@68 -- # return 0 00:03:38.478 03:15:03 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:38.478 03:15:03 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.478 03:15:03 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:38.478 03:15:03 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:38.478 03:15:03 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:38.478 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:38.478 00:03:38.478 real 0m6.223s 00:03:38.478 user 0m1.430s 00:03:38.478 sys 0m2.342s 00:03:38.478 03:15:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:38.478 03:15:03 -- common/autotest_common.sh@10 -- # set +x 00:03:38.478 ************************************ 00:03:38.478 END TEST nvme_mount 00:03:38.478 ************************************ 00:03:38.478 03:15:03 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:38.478 03:15:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.478 03:15:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.478 03:15:03 -- common/autotest_common.sh@10 -- # set +x 00:03:38.478 ************************************ 00:03:38.478 START TEST dm_mount 00:03:38.478 ************************************ 00:03:38.478 03:15:03 -- common/autotest_common.sh@1111 -- # dm_mount 00:03:38.478 03:15:03 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:38.478 03:15:03 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:38.478 03:15:03 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:38.478 03:15:03 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:38.478 03:15:03 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:38.478 03:15:03 -- setup/common.sh@40 -- # local part_no=2 00:03:38.478 03:15:03 -- setup/common.sh@41 -- # local size=1073741824 00:03:38.478 03:15:03 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:38.478 03:15:03 -- setup/common.sh@44 -- # parts=() 00:03:38.478 03:15:03 -- setup/common.sh@44 -- # local parts 00:03:38.478 03:15:03 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:38.478 03:15:03 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:38.478 03:15:03 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:38.478 03:15:03 -- setup/common.sh@46 -- # (( part++ )) 00:03:38.478 03:15:03 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:38.478 03:15:03 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:38.478 03:15:03 -- setup/common.sh@46 -- # (( part++ )) 00:03:38.478 03:15:03 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:38.478 03:15:03 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:38.478 03:15:03 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:38.478 03:15:03 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:39.853 Creating new GPT entries in memory. 00:03:39.853 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:39.853 other utilities. 00:03:39.853 03:15:04 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:39.853 03:15:04 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:39.853 03:15:04 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:39.853 03:15:04 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:39.853 03:15:04 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:40.788 Creating new GPT entries in memory. 00:03:40.788 The operation has completed successfully. 00:03:40.788 03:15:05 -- setup/common.sh@57 -- # (( part++ )) 00:03:40.788 03:15:05 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:40.788 03:15:05 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:40.788 03:15:05 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:40.788 03:15:05 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:41.723 The operation has completed successfully. 00:03:41.723 03:15:06 -- setup/common.sh@57 -- # (( part++ )) 00:03:41.723 03:15:06 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:41.723 03:15:06 -- setup/common.sh@62 -- # wait 1323890 00:03:41.723 03:15:06 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:41.723 03:15:06 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.723 03:15:06 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:41.723 03:15:06 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:41.723 03:15:06 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:41.723 03:15:06 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:41.723 03:15:06 -- setup/devices.sh@161 -- # break 00:03:41.723 03:15:06 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:41.723 03:15:06 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:41.723 03:15:06 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:41.723 03:15:06 -- setup/devices.sh@166 -- # dm=dm-0 00:03:41.723 03:15:06 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:41.723 03:15:06 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:41.723 03:15:06 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.723 03:15:06 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:41.723 03:15:06 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.723 03:15:06 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:41.723 03:15:06 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:41.723 03:15:06 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.723 03:15:06 -- setup/devices.sh@174 -- # verify 0000:0b:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:41.723 03:15:06 -- setup/devices.sh@48 -- # local dev=0000:0b:00.0 00:03:41.723 03:15:06 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:41.723 03:15:06 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.723 03:15:06 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:41.723 03:15:06 -- setup/devices.sh@53 -- # local found=0 00:03:41.723 03:15:06 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:41.723 03:15:06 -- setup/devices.sh@56 -- # : 00:03:41.723 03:15:06 -- setup/devices.sh@59 -- # local pci status 00:03:41.723 03:15:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.723 03:15:06 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:0b:00.0 00:03:41.723 03:15:06 -- setup/devices.sh@47 -- # setup output config 00:03:41.723 03:15:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:41.723 03:15:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:42.656 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:0b:00.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:42.657 03:15:07 -- setup/devices.sh@63 -- # found=1 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.657 03:15:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:42.657 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.914 03:15:07 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:42.914 03:15:07 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:42.914 03:15:07 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.914 03:15:07 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:42.914 03:15:07 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:42.914 03:15:07 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.914 03:15:07 -- setup/devices.sh@184 -- # verify 0000:0b:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:42.914 03:15:07 -- setup/devices.sh@48 -- # local dev=0000:0b:00.0 00:03:42.914 03:15:07 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:42.914 03:15:07 -- setup/devices.sh@50 -- # local mount_point= 00:03:42.914 03:15:07 -- setup/devices.sh@51 -- # local test_file= 00:03:42.915 03:15:07 -- setup/devices.sh@53 -- # local found=0 00:03:42.915 03:15:07 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:42.915 03:15:07 -- setup/devices.sh@59 -- # local pci status 00:03:42.915 03:15:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.915 03:15:07 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:0b:00.0 00:03:42.915 03:15:07 -- setup/devices.sh@47 -- # setup output config 00:03:42.915 03:15:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:42.915 03:15:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:43.850 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:43.850 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.850 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:43.850 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.850 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:43.850 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.850 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:43.850 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.850 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:43.850 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.850 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:43.850 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.850 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:43.850 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.850 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:43.850 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.108 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:0b:00.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:44.108 03:15:08 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:44.108 03:15:08 -- setup/devices.sh@63 -- # found=1 00:03:44.108 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.108 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:44.108 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.108 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:44.108 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.108 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:44.108 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.108 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:44.108 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.108 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:44.108 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.108 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:44.108 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.108 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:44.108 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.108 03:15:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\0\b\:\0\0\.\0 ]] 00:03:44.108 03:15:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.108 03:15:09 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:44.108 03:15:09 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:44.108 03:15:09 -- setup/devices.sh@68 -- # return 0 00:03:44.109 03:15:09 -- setup/devices.sh@187 -- # cleanup_dm 00:03:44.109 03:15:09 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.109 03:15:09 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:44.109 03:15:09 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:44.109 03:15:09 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.109 03:15:09 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:44.109 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:44.109 03:15:09 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:44.109 03:15:09 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:44.109 00:03:44.109 real 0m5.693s 00:03:44.109 user 0m0.915s 00:03:44.109 sys 0m1.636s 00:03:44.109 03:15:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:44.109 03:15:09 -- common/autotest_common.sh@10 -- # set +x 00:03:44.109 ************************************ 00:03:44.109 END TEST dm_mount 00:03:44.109 ************************************ 00:03:44.366 03:15:09 -- setup/devices.sh@1 -- # cleanup 00:03:44.366 03:15:09 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:44.366 03:15:09 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.366 03:15:09 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.366 03:15:09 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:44.366 03:15:09 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:44.366 03:15:09 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:44.625 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:44.625 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:44.625 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:44.625 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:44.625 03:15:09 -- setup/devices.sh@12 -- # cleanup_dm 00:03:44.625 03:15:09 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.625 03:15:09 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:44.625 03:15:09 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.625 03:15:09 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:44.625 03:15:09 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:44.625 03:15:09 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:44.625 00:03:44.625 real 0m14.137s 00:03:44.625 user 0m3.132s 00:03:44.625 sys 0m5.141s 00:03:44.625 03:15:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:44.625 03:15:09 -- common/autotest_common.sh@10 -- # set +x 00:03:44.625 ************************************ 00:03:44.625 END TEST devices 00:03:44.625 ************************************ 00:03:44.625 00:03:44.625 real 0m44.508s 00:03:44.625 user 0m12.737s 00:03:44.625 sys 0m19.810s 00:03:44.625 03:15:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:44.625 03:15:09 -- common/autotest_common.sh@10 -- # set +x 00:03:44.625 ************************************ 00:03:44.625 END TEST setup.sh 00:03:44.625 ************************************ 00:03:44.625 03:15:09 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:45.561 Hugepages 00:03:45.561 node hugesize free / total 00:03:45.561 node0 1048576kB 0 / 0 00:03:45.561 node0 2048kB 2048 / 2048 00:03:45.561 node1 1048576kB 0 / 0 00:03:45.561 node1 2048kB 0 / 0 00:03:45.561 00:03:45.561 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:45.561 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:45.561 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:45.561 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:45.561 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:45.561 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:45.561 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:45.561 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:45.561 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:45.819 NVMe 0000:0b:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:03:45.819 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:45.819 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:45.819 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:45.819 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:45.819 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:45.819 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:45.819 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:45.819 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:45.819 03:15:10 -- spdk/autotest.sh@130 -- # uname -s 00:03:45.819 03:15:10 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:03:45.819 03:15:10 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:03:45.819 03:15:10 -- common/autotest_common.sh@1517 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:46.755 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:46.755 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:46.755 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:46.755 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:47.044 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:47.044 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:47.044 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:47.044 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:47.044 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:47.044 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:47.044 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:47.044 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:47.044 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:47.044 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:47.044 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:47.044 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:47.983 0000:0b:00.0 (8086 0a54): nvme -> vfio-pci 00:03:47.983 03:15:12 -- common/autotest_common.sh@1518 -- # sleep 1 00:03:49.359 03:15:13 -- common/autotest_common.sh@1519 -- # bdfs=() 00:03:49.359 03:15:13 -- common/autotest_common.sh@1519 -- # local bdfs 00:03:49.359 03:15:13 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:03:49.359 03:15:13 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:03:49.359 03:15:13 -- common/autotest_common.sh@1499 -- # bdfs=() 00:03:49.359 03:15:13 -- common/autotest_common.sh@1499 -- # local bdfs 00:03:49.359 03:15:13 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:49.359 03:15:13 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:49.359 03:15:13 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:03:49.359 03:15:13 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:03:49.359 03:15:13 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:0b:00.0 00:03:49.359 03:15:13 -- common/autotest_common.sh@1522 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:50.296 Waiting for block devices as requested 00:03:50.296 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:50.296 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:50.296 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:50.556 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:50.556 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:50.556 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:50.556 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:50.556 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:50.815 0000:0b:00.0 (8086 0a54): vfio-pci -> nvme 00:03:50.815 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:51.073 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:51.073 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:51.073 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:51.073 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:51.333 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:51.333 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:51.333 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:51.592 03:15:16 -- common/autotest_common.sh@1524 -- # for bdf in "${bdfs[@]}" 00:03:51.592 03:15:16 -- common/autotest_common.sh@1525 -- # get_nvme_ctrlr_from_bdf 0000:0b:00.0 00:03:51.592 03:15:16 -- common/autotest_common.sh@1488 -- # readlink -f /sys/class/nvme/nvme0 00:03:51.592 03:15:16 -- common/autotest_common.sh@1488 -- # grep 0000:0b:00.0/nvme/nvme 00:03:51.592 03:15:16 -- common/autotest_common.sh@1488 -- # bdf_sysfs_path=/sys/devices/pci0000:00/0000:00:03.2/0000:0b:00.0/nvme/nvme0 00:03:51.592 03:15:16 -- common/autotest_common.sh@1489 -- # [[ -z /sys/devices/pci0000:00/0000:00:03.2/0000:0b:00.0/nvme/nvme0 ]] 00:03:51.592 03:15:16 -- common/autotest_common.sh@1493 -- # basename /sys/devices/pci0000:00/0000:00:03.2/0000:0b:00.0/nvme/nvme0 00:03:51.592 03:15:16 -- common/autotest_common.sh@1493 -- # printf '%s\n' nvme0 00:03:51.592 03:15:16 -- common/autotest_common.sh@1525 -- # nvme_ctrlr=/dev/nvme0 00:03:51.592 03:15:16 -- common/autotest_common.sh@1526 -- # [[ -z /dev/nvme0 ]] 00:03:51.592 03:15:16 -- common/autotest_common.sh@1531 -- # nvme id-ctrl /dev/nvme0 00:03:51.592 03:15:16 -- common/autotest_common.sh@1531 -- # grep oacs 00:03:51.592 03:15:16 -- common/autotest_common.sh@1531 -- # cut -d: -f2 00:03:51.592 03:15:16 -- common/autotest_common.sh@1531 -- # oacs=' 0xf' 00:03:51.592 03:15:16 -- common/autotest_common.sh@1532 -- # oacs_ns_manage=8 00:03:51.592 03:15:16 -- common/autotest_common.sh@1534 -- # [[ 8 -ne 0 ]] 00:03:51.592 03:15:16 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:51.592 03:15:16 -- common/autotest_common.sh@1540 -- # grep unvmcap 00:03:51.592 03:15:16 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:51.592 03:15:16 -- common/autotest_common.sh@1540 -- # unvmcap=' 0' 00:03:51.592 03:15:16 -- common/autotest_common.sh@1541 -- # [[ 0 -eq 0 ]] 00:03:51.592 03:15:16 -- common/autotest_common.sh@1543 -- # continue 00:03:51.592 03:15:16 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:03:51.592 03:15:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:03:51.592 03:15:16 -- common/autotest_common.sh@10 -- # set +x 00:03:51.592 03:15:16 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:03:51.592 03:15:16 -- common/autotest_common.sh@710 -- # xtrace_disable 00:03:51.592 03:15:16 -- common/autotest_common.sh@10 -- # set +x 00:03:51.592 03:15:16 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:52.967 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:52.967 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:52.967 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:52.967 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:52.967 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:52.967 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:52.967 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:52.967 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:52.967 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:52.967 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:52.967 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:52.967 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:52.967 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:52.967 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:52.967 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:52.967 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:53.904 0000:0b:00.0 (8086 0a54): nvme -> vfio-pci 00:03:53.904 03:15:18 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:03:53.904 03:15:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:03:53.904 03:15:18 -- common/autotest_common.sh@10 -- # set +x 00:03:53.904 03:15:18 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:03:53.904 03:15:18 -- common/autotest_common.sh@1577 -- # mapfile -t bdfs 00:03:53.904 03:15:18 -- common/autotest_common.sh@1577 -- # get_nvme_bdfs_by_id 0x0a54 00:03:53.904 03:15:18 -- common/autotest_common.sh@1563 -- # bdfs=() 00:03:53.904 03:15:18 -- common/autotest_common.sh@1563 -- # local bdfs 00:03:53.904 03:15:18 -- common/autotest_common.sh@1565 -- # get_nvme_bdfs 00:03:53.904 03:15:18 -- common/autotest_common.sh@1499 -- # bdfs=() 00:03:53.904 03:15:18 -- common/autotest_common.sh@1499 -- # local bdfs 00:03:53.904 03:15:18 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:53.904 03:15:18 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:53.904 03:15:18 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:03:53.904 03:15:18 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:03:53.904 03:15:18 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:0b:00.0 00:03:53.904 03:15:18 -- common/autotest_common.sh@1565 -- # for bdf in $(get_nvme_bdfs) 00:03:53.904 03:15:18 -- common/autotest_common.sh@1566 -- # cat /sys/bus/pci/devices/0000:0b:00.0/device 00:03:53.904 03:15:18 -- common/autotest_common.sh@1566 -- # device=0x0a54 00:03:53.904 03:15:18 -- common/autotest_common.sh@1567 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:53.904 03:15:18 -- common/autotest_common.sh@1568 -- # bdfs+=($bdf) 00:03:53.904 03:15:18 -- common/autotest_common.sh@1572 -- # printf '%s\n' 0000:0b:00.0 00:03:53.904 03:15:18 -- common/autotest_common.sh@1578 -- # [[ -z 0000:0b:00.0 ]] 00:03:53.904 03:15:18 -- common/autotest_common.sh@1583 -- # spdk_tgt_pid=1329572 00:03:53.904 03:15:18 -- common/autotest_common.sh@1582 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:53.904 03:15:18 -- common/autotest_common.sh@1584 -- # waitforlisten 1329572 00:03:53.904 03:15:18 -- common/autotest_common.sh@817 -- # '[' -z 1329572 ']' 00:03:53.904 03:15:18 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:53.904 03:15:18 -- common/autotest_common.sh@822 -- # local max_retries=100 00:03:53.904 03:15:18 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:53.904 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:53.904 03:15:18 -- common/autotest_common.sh@826 -- # xtrace_disable 00:03:53.904 03:15:18 -- common/autotest_common.sh@10 -- # set +x 00:03:53.904 [2024-04-27 03:15:18.871365] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:03:53.904 [2024-04-27 03:15:18.871439] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1329572 ] 00:03:54.163 EAL: No free 2048 kB hugepages reported on node 1 00:03:54.163 [2024-04-27 03:15:18.932889] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:54.163 [2024-04-27 03:15:19.043278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:55.098 03:15:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:03:55.098 03:15:19 -- common/autotest_common.sh@850 -- # return 0 00:03:55.098 03:15:19 -- common/autotest_common.sh@1586 -- # bdf_id=0 00:03:55.098 03:15:19 -- common/autotest_common.sh@1587 -- # for bdf in "${bdfs[@]}" 00:03:55.098 03:15:19 -- common/autotest_common.sh@1588 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:0b:00.0 00:03:58.383 nvme0n1 00:03:58.383 03:15:22 -- common/autotest_common.sh@1590 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:58.383 [2024-04-27 03:15:23.105540] nvme_opal.c:2063:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:58.383 [2024-04-27 03:15:23.105607] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:58.383 request: 00:03:58.383 { 00:03:58.383 "nvme_ctrlr_name": "nvme0", 00:03:58.383 "password": "test", 00:03:58.383 "method": "bdev_nvme_opal_revert", 00:03:58.383 "req_id": 1 00:03:58.383 } 00:03:58.383 Got JSON-RPC error response 00:03:58.383 response: 00:03:58.383 { 00:03:58.383 "code": -32603, 00:03:58.383 "message": "Internal error" 00:03:58.383 } 00:03:58.383 03:15:23 -- common/autotest_common.sh@1590 -- # true 00:03:58.383 03:15:23 -- common/autotest_common.sh@1591 -- # (( ++bdf_id )) 00:03:58.383 03:15:23 -- common/autotest_common.sh@1594 -- # killprocess 1329572 00:03:58.383 03:15:23 -- common/autotest_common.sh@936 -- # '[' -z 1329572 ']' 00:03:58.383 03:15:23 -- common/autotest_common.sh@940 -- # kill -0 1329572 00:03:58.383 03:15:23 -- common/autotest_common.sh@941 -- # uname 00:03:58.383 03:15:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:58.383 03:15:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1329572 00:03:58.383 03:15:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:58.383 03:15:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:58.383 03:15:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1329572' 00:03:58.383 killing process with pid 1329572 00:03:58.383 03:15:23 -- common/autotest_common.sh@955 -- # kill 1329572 00:03:58.383 03:15:23 -- common/autotest_common.sh@960 -- # wait 1329572 00:04:00.283 03:15:24 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:04:00.283 03:15:24 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:04:00.283 03:15:24 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:00.283 03:15:24 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:00.283 03:15:24 -- spdk/autotest.sh@162 -- # timing_enter lib 00:04:00.283 03:15:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:00.283 03:15:24 -- common/autotest_common.sh@10 -- # set +x 00:04:00.283 03:15:24 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:00.283 03:15:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.283 03:15:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.283 03:15:24 -- common/autotest_common.sh@10 -- # set +x 00:04:00.283 ************************************ 00:04:00.283 START TEST env 00:04:00.283 ************************************ 00:04:00.283 03:15:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:00.283 * Looking for test storage... 00:04:00.283 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:00.283 03:15:25 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:00.283 03:15:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.283 03:15:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.283 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:04:00.283 ************************************ 00:04:00.283 START TEST env_memory 00:04:00.283 ************************************ 00:04:00.283 03:15:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:00.283 00:04:00.283 00:04:00.283 CUnit - A unit testing framework for C - Version 2.1-3 00:04:00.283 http://cunit.sourceforge.net/ 00:04:00.283 00:04:00.283 00:04:00.283 Suite: memory 00:04:00.283 Test: alloc and free memory map ...[2024-04-27 03:15:25.185388] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:00.283 passed 00:04:00.283 Test: mem map translation ...[2024-04-27 03:15:25.210064] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:00.283 [2024-04-27 03:15:25.210091] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:00.283 [2024-04-27 03:15:25.210148] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:00.283 [2024-04-27 03:15:25.210163] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:00.283 passed 00:04:00.542 Test: mem map registration ...[2024-04-27 03:15:25.262416] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:00.542 [2024-04-27 03:15:25.262441] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:00.542 passed 00:04:00.542 Test: mem map adjacent registrations ...passed 00:04:00.542 00:04:00.542 Run Summary: Type Total Ran Passed Failed Inactive 00:04:00.542 suites 1 1 n/a 0 0 00:04:00.542 tests 4 4 4 0 0 00:04:00.542 asserts 152 152 152 0 n/a 00:04:00.542 00:04:00.542 Elapsed time = 0.175 seconds 00:04:00.542 00:04:00.542 real 0m0.183s 00:04:00.542 user 0m0.176s 00:04:00.542 sys 0m0.006s 00:04:00.542 03:15:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:00.542 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:04:00.542 ************************************ 00:04:00.542 END TEST env_memory 00:04:00.542 ************************************ 00:04:00.542 03:15:25 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:00.542 03:15:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.542 03:15:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.542 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:04:00.542 ************************************ 00:04:00.542 START TEST env_vtophys 00:04:00.542 ************************************ 00:04:00.543 03:15:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:00.543 EAL: lib.eal log level changed from notice to debug 00:04:00.543 EAL: Detected lcore 0 as core 0 on socket 0 00:04:00.543 EAL: Detected lcore 1 as core 1 on socket 0 00:04:00.543 EAL: Detected lcore 2 as core 2 on socket 0 00:04:00.543 EAL: Detected lcore 3 as core 3 on socket 0 00:04:00.543 EAL: Detected lcore 4 as core 4 on socket 0 00:04:00.543 EAL: Detected lcore 5 as core 5 on socket 0 00:04:00.543 EAL: Detected lcore 6 as core 8 on socket 0 00:04:00.543 EAL: Detected lcore 7 as core 9 on socket 0 00:04:00.543 EAL: Detected lcore 8 as core 10 on socket 0 00:04:00.543 EAL: Detected lcore 9 as core 11 on socket 0 00:04:00.543 EAL: Detected lcore 10 as core 12 on socket 0 00:04:00.543 EAL: Detected lcore 11 as core 13 on socket 0 00:04:00.543 EAL: Detected lcore 12 as core 0 on socket 1 00:04:00.543 EAL: Detected lcore 13 as core 1 on socket 1 00:04:00.543 EAL: Detected lcore 14 as core 2 on socket 1 00:04:00.543 EAL: Detected lcore 15 as core 3 on socket 1 00:04:00.543 EAL: Detected lcore 16 as core 4 on socket 1 00:04:00.543 EAL: Detected lcore 17 as core 5 on socket 1 00:04:00.543 EAL: Detected lcore 18 as core 8 on socket 1 00:04:00.543 EAL: Detected lcore 19 as core 9 on socket 1 00:04:00.543 EAL: Detected lcore 20 as core 10 on socket 1 00:04:00.543 EAL: Detected lcore 21 as core 11 on socket 1 00:04:00.543 EAL: Detected lcore 22 as core 12 on socket 1 00:04:00.543 EAL: Detected lcore 23 as core 13 on socket 1 00:04:00.543 EAL: Detected lcore 24 as core 0 on socket 0 00:04:00.543 EAL: Detected lcore 25 as core 1 on socket 0 00:04:00.543 EAL: Detected lcore 26 as core 2 on socket 0 00:04:00.543 EAL: Detected lcore 27 as core 3 on socket 0 00:04:00.543 EAL: Detected lcore 28 as core 4 on socket 0 00:04:00.543 EAL: Detected lcore 29 as core 5 on socket 0 00:04:00.543 EAL: Detected lcore 30 as core 8 on socket 0 00:04:00.543 EAL: Detected lcore 31 as core 9 on socket 0 00:04:00.543 EAL: Detected lcore 32 as core 10 on socket 0 00:04:00.543 EAL: Detected lcore 33 as core 11 on socket 0 00:04:00.543 EAL: Detected lcore 34 as core 12 on socket 0 00:04:00.543 EAL: Detected lcore 35 as core 13 on socket 0 00:04:00.543 EAL: Detected lcore 36 as core 0 on socket 1 00:04:00.543 EAL: Detected lcore 37 as core 1 on socket 1 00:04:00.543 EAL: Detected lcore 38 as core 2 on socket 1 00:04:00.543 EAL: Detected lcore 39 as core 3 on socket 1 00:04:00.543 EAL: Detected lcore 40 as core 4 on socket 1 00:04:00.543 EAL: Detected lcore 41 as core 5 on socket 1 00:04:00.543 EAL: Detected lcore 42 as core 8 on socket 1 00:04:00.543 EAL: Detected lcore 43 as core 9 on socket 1 00:04:00.543 EAL: Detected lcore 44 as core 10 on socket 1 00:04:00.543 EAL: Detected lcore 45 as core 11 on socket 1 00:04:00.543 EAL: Detected lcore 46 as core 12 on socket 1 00:04:00.543 EAL: Detected lcore 47 as core 13 on socket 1 00:04:00.543 EAL: Maximum logical cores by configuration: 128 00:04:00.543 EAL: Detected CPU lcores: 48 00:04:00.543 EAL: Detected NUMA nodes: 2 00:04:00.543 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:00.543 EAL: Detected shared linkage of DPDK 00:04:00.543 EAL: No shared files mode enabled, IPC will be disabled 00:04:00.543 EAL: Bus pci wants IOVA as 'DC' 00:04:00.543 EAL: Buses did not request a specific IOVA mode. 00:04:00.543 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:00.543 EAL: Selected IOVA mode 'VA' 00:04:00.543 EAL: No free 2048 kB hugepages reported on node 1 00:04:00.543 EAL: Probing VFIO support... 00:04:00.543 EAL: IOMMU type 1 (Type 1) is supported 00:04:00.543 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:00.543 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:00.543 EAL: VFIO support initialized 00:04:00.543 EAL: Ask a virtual area of 0x2e000 bytes 00:04:00.543 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:00.543 EAL: Setting up physically contiguous memory... 00:04:00.543 EAL: Setting maximum number of open files to 524288 00:04:00.543 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:00.543 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:00.543 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:00.543 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.543 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:00.543 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.543 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.543 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:00.543 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:00.543 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.543 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:00.543 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.543 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.543 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:00.543 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:00.543 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.543 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:00.543 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.543 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.543 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:00.543 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:00.543 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.543 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:00.543 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.543 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.543 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:00.543 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:00.543 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:00.543 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.543 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:00.543 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.543 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.543 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:00.543 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:00.543 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.543 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:00.543 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.543 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.543 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:00.543 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:00.543 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.543 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:00.543 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.543 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.543 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:00.543 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:00.543 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.543 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:00.543 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.543 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.543 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:00.543 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:00.543 EAL: Hugepages will be freed exactly as allocated. 00:04:00.543 EAL: No shared files mode enabled, IPC is disabled 00:04:00.543 EAL: No shared files mode enabled, IPC is disabled 00:04:00.543 EAL: TSC frequency is ~2700000 KHz 00:04:00.543 EAL: Main lcore 0 is ready (tid=7f7193505a00;cpuset=[0]) 00:04:00.543 EAL: Trying to obtain current memory policy. 00:04:00.543 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.543 EAL: Restoring previous memory policy: 0 00:04:00.543 EAL: request: mp_malloc_sync 00:04:00.543 EAL: No shared files mode enabled, IPC is disabled 00:04:00.543 EAL: Heap on socket 0 was expanded by 2MB 00:04:00.543 EAL: No shared files mode enabled, IPC is disabled 00:04:00.543 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:00.543 EAL: Mem event callback 'spdk:(nil)' registered 00:04:00.802 00:04:00.802 00:04:00.802 CUnit - A unit testing framework for C - Version 2.1-3 00:04:00.802 http://cunit.sourceforge.net/ 00:04:00.802 00:04:00.802 00:04:00.802 Suite: components_suite 00:04:00.802 Test: vtophys_malloc_test ...passed 00:04:00.802 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:00.802 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.802 EAL: Restoring previous memory policy: 4 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was expanded by 4MB 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was shrunk by 4MB 00:04:00.802 EAL: Trying to obtain current memory policy. 00:04:00.802 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.802 EAL: Restoring previous memory policy: 4 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was expanded by 6MB 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was shrunk by 6MB 00:04:00.802 EAL: Trying to obtain current memory policy. 00:04:00.802 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.802 EAL: Restoring previous memory policy: 4 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was expanded by 10MB 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was shrunk by 10MB 00:04:00.802 EAL: Trying to obtain current memory policy. 00:04:00.802 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.802 EAL: Restoring previous memory policy: 4 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was expanded by 18MB 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was shrunk by 18MB 00:04:00.802 EAL: Trying to obtain current memory policy. 00:04:00.802 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.802 EAL: Restoring previous memory policy: 4 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was expanded by 34MB 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was shrunk by 34MB 00:04:00.802 EAL: Trying to obtain current memory policy. 00:04:00.802 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.802 EAL: Restoring previous memory policy: 4 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was expanded by 66MB 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was shrunk by 66MB 00:04:00.802 EAL: Trying to obtain current memory policy. 00:04:00.802 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.802 EAL: Restoring previous memory policy: 4 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was expanded by 130MB 00:04:00.802 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.802 EAL: request: mp_malloc_sync 00:04:00.802 EAL: No shared files mode enabled, IPC is disabled 00:04:00.802 EAL: Heap on socket 0 was shrunk by 130MB 00:04:00.802 EAL: Trying to obtain current memory policy. 00:04:00.802 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.803 EAL: Restoring previous memory policy: 4 00:04:00.803 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.803 EAL: request: mp_malloc_sync 00:04:00.803 EAL: No shared files mode enabled, IPC is disabled 00:04:00.803 EAL: Heap on socket 0 was expanded by 258MB 00:04:01.060 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.060 EAL: request: mp_malloc_sync 00:04:01.060 EAL: No shared files mode enabled, IPC is disabled 00:04:01.060 EAL: Heap on socket 0 was shrunk by 258MB 00:04:01.060 EAL: Trying to obtain current memory policy. 00:04:01.060 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.060 EAL: Restoring previous memory policy: 4 00:04:01.060 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.060 EAL: request: mp_malloc_sync 00:04:01.060 EAL: No shared files mode enabled, IPC is disabled 00:04:01.060 EAL: Heap on socket 0 was expanded by 514MB 00:04:01.317 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.317 EAL: request: mp_malloc_sync 00:04:01.317 EAL: No shared files mode enabled, IPC is disabled 00:04:01.317 EAL: Heap on socket 0 was shrunk by 514MB 00:04:01.317 EAL: Trying to obtain current memory policy. 00:04:01.317 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.575 EAL: Restoring previous memory policy: 4 00:04:01.576 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.576 EAL: request: mp_malloc_sync 00:04:01.576 EAL: No shared files mode enabled, IPC is disabled 00:04:01.576 EAL: Heap on socket 0 was expanded by 1026MB 00:04:01.833 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.091 EAL: request: mp_malloc_sync 00:04:02.091 EAL: No shared files mode enabled, IPC is disabled 00:04:02.091 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:02.091 passed 00:04:02.091 00:04:02.091 Run Summary: Type Total Ran Passed Failed Inactive 00:04:02.091 suites 1 1 n/a 0 0 00:04:02.091 tests 2 2 2 0 0 00:04:02.091 asserts 497 497 497 0 n/a 00:04:02.091 00:04:02.091 Elapsed time = 1.383 seconds 00:04:02.091 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.091 EAL: request: mp_malloc_sync 00:04:02.091 EAL: No shared files mode enabled, IPC is disabled 00:04:02.091 EAL: Heap on socket 0 was shrunk by 2MB 00:04:02.091 EAL: No shared files mode enabled, IPC is disabled 00:04:02.091 EAL: No shared files mode enabled, IPC is disabled 00:04:02.091 EAL: No shared files mode enabled, IPC is disabled 00:04:02.091 00:04:02.092 real 0m1.513s 00:04:02.092 user 0m0.869s 00:04:02.092 sys 0m0.595s 00:04:02.092 03:15:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:02.092 03:15:26 -- common/autotest_common.sh@10 -- # set +x 00:04:02.092 ************************************ 00:04:02.092 END TEST env_vtophys 00:04:02.092 ************************************ 00:04:02.092 03:15:26 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:02.092 03:15:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:02.092 03:15:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.092 03:15:26 -- common/autotest_common.sh@10 -- # set +x 00:04:02.350 ************************************ 00:04:02.350 START TEST env_pci 00:04:02.350 ************************************ 00:04:02.350 03:15:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:02.350 00:04:02.350 00:04:02.350 CUnit - A unit testing framework for C - Version 2.1-3 00:04:02.350 http://cunit.sourceforge.net/ 00:04:02.350 00:04:02.350 00:04:02.350 Suite: pci 00:04:02.350 Test: pci_hook ...[2024-04-27 03:15:27.083033] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1330614 has claimed it 00:04:02.350 EAL: Cannot find device (10000:00:01.0) 00:04:02.350 EAL: Failed to attach device on primary process 00:04:02.350 passed 00:04:02.350 00:04:02.350 Run Summary: Type Total Ran Passed Failed Inactive 00:04:02.350 suites 1 1 n/a 0 0 00:04:02.350 tests 1 1 1 0 0 00:04:02.350 asserts 25 25 25 0 n/a 00:04:02.350 00:04:02.350 Elapsed time = 0.022 seconds 00:04:02.350 00:04:02.350 real 0m0.033s 00:04:02.350 user 0m0.010s 00:04:02.350 sys 0m0.023s 00:04:02.350 03:15:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:02.350 03:15:27 -- common/autotest_common.sh@10 -- # set +x 00:04:02.350 ************************************ 00:04:02.350 END TEST env_pci 00:04:02.350 ************************************ 00:04:02.350 03:15:27 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:02.350 03:15:27 -- env/env.sh@15 -- # uname 00:04:02.350 03:15:27 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:02.350 03:15:27 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:02.350 03:15:27 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:02.350 03:15:27 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:02.350 03:15:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.350 03:15:27 -- common/autotest_common.sh@10 -- # set +x 00:04:02.350 ************************************ 00:04:02.350 START TEST env_dpdk_post_init 00:04:02.350 ************************************ 00:04:02.350 03:15:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:02.350 EAL: Detected CPU lcores: 48 00:04:02.350 EAL: Detected NUMA nodes: 2 00:04:02.350 EAL: Detected shared linkage of DPDK 00:04:02.350 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:02.350 EAL: Selected IOVA mode 'VA' 00:04:02.350 EAL: No free 2048 kB hugepages reported on node 1 00:04:02.350 EAL: VFIO support initialized 00:04:02.350 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:02.350 EAL: Using IOMMU type 1 (Type 1) 00:04:02.608 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:02.608 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:02.608 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:02.608 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:02.608 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:02.608 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:02.608 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:02.608 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:03.542 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:0b:00.0 (socket 0) 00:04:03.542 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:03.542 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:03.542 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:03.542 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:03.542 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:03.542 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:03.542 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:03.542 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:06.842 EAL: Releasing PCI mapped resource for 0000:0b:00.0 00:04:06.842 EAL: Calling pci_unmap_resource for 0000:0b:00.0 at 0x202001020000 00:04:06.842 Starting DPDK initialization... 00:04:06.842 Starting SPDK post initialization... 00:04:06.842 SPDK NVMe probe 00:04:06.842 Attaching to 0000:0b:00.0 00:04:06.842 Attached to 0000:0b:00.0 00:04:06.842 Cleaning up... 00:04:06.842 00:04:06.842 real 0m4.357s 00:04:06.842 user 0m3.221s 00:04:06.842 sys 0m0.189s 00:04:06.842 03:15:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:06.842 03:15:31 -- common/autotest_common.sh@10 -- # set +x 00:04:06.842 ************************************ 00:04:06.842 END TEST env_dpdk_post_init 00:04:06.842 ************************************ 00:04:06.842 03:15:31 -- env/env.sh@26 -- # uname 00:04:06.842 03:15:31 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:06.842 03:15:31 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:06.842 03:15:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.842 03:15:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.842 03:15:31 -- common/autotest_common.sh@10 -- # set +x 00:04:06.842 ************************************ 00:04:06.842 START TEST env_mem_callbacks 00:04:06.842 ************************************ 00:04:06.842 03:15:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:06.842 EAL: Detected CPU lcores: 48 00:04:06.842 EAL: Detected NUMA nodes: 2 00:04:06.842 EAL: Detected shared linkage of DPDK 00:04:06.842 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:06.842 EAL: Selected IOVA mode 'VA' 00:04:06.842 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.842 EAL: VFIO support initialized 00:04:06.842 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:06.842 00:04:06.842 00:04:06.842 CUnit - A unit testing framework for C - Version 2.1-3 00:04:06.842 http://cunit.sourceforge.net/ 00:04:06.842 00:04:06.842 00:04:06.842 Suite: memory 00:04:06.842 Test: test ... 00:04:06.842 register 0x200000200000 2097152 00:04:06.842 malloc 3145728 00:04:06.842 register 0x200000400000 4194304 00:04:06.842 buf 0x200000500000 len 3145728 PASSED 00:04:06.842 malloc 64 00:04:06.842 buf 0x2000004fff40 len 64 PASSED 00:04:06.842 malloc 4194304 00:04:06.842 register 0x200000800000 6291456 00:04:06.842 buf 0x200000a00000 len 4194304 PASSED 00:04:06.842 free 0x200000500000 3145728 00:04:06.842 free 0x2000004fff40 64 00:04:06.842 unregister 0x200000400000 4194304 PASSED 00:04:06.842 free 0x200000a00000 4194304 00:04:06.842 unregister 0x200000800000 6291456 PASSED 00:04:06.842 malloc 8388608 00:04:06.842 register 0x200000400000 10485760 00:04:06.842 buf 0x200000600000 len 8388608 PASSED 00:04:06.842 free 0x200000600000 8388608 00:04:06.842 unregister 0x200000400000 10485760 PASSED 00:04:06.842 passed 00:04:06.842 00:04:06.842 Run Summary: Type Total Ran Passed Failed Inactive 00:04:06.842 suites 1 1 n/a 0 0 00:04:06.842 tests 1 1 1 0 0 00:04:06.842 asserts 15 15 15 0 n/a 00:04:06.842 00:04:06.842 Elapsed time = 0.006 seconds 00:04:06.842 00:04:06.842 real 0m0.049s 00:04:06.842 user 0m0.016s 00:04:06.842 sys 0m0.033s 00:04:06.842 03:15:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:06.842 03:15:31 -- common/autotest_common.sh@10 -- # set +x 00:04:06.842 ************************************ 00:04:06.842 END TEST env_mem_callbacks 00:04:06.842 ************************************ 00:04:06.842 00:04:06.842 real 0m6.753s 00:04:06.842 user 0m4.547s 00:04:06.842 sys 0m1.166s 00:04:06.842 03:15:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:06.842 03:15:31 -- common/autotest_common.sh@10 -- # set +x 00:04:06.842 ************************************ 00:04:06.842 END TEST env 00:04:06.842 ************************************ 00:04:06.842 03:15:31 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:06.842 03:15:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.842 03:15:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.842 03:15:31 -- common/autotest_common.sh@10 -- # set +x 00:04:07.130 ************************************ 00:04:07.130 START TEST rpc 00:04:07.130 ************************************ 00:04:07.130 03:15:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:07.130 * Looking for test storage... 00:04:07.130 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:07.130 03:15:31 -- rpc/rpc.sh@65 -- # spdk_pid=1331298 00:04:07.130 03:15:31 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:07.130 03:15:31 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:07.130 03:15:31 -- rpc/rpc.sh@67 -- # waitforlisten 1331298 00:04:07.130 03:15:31 -- common/autotest_common.sh@817 -- # '[' -z 1331298 ']' 00:04:07.130 03:15:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:07.130 03:15:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:07.130 03:15:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:07.130 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:07.130 03:15:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:07.130 03:15:31 -- common/autotest_common.sh@10 -- # set +x 00:04:07.130 [2024-04-27 03:15:31.970945] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:07.130 [2024-04-27 03:15:31.971021] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1331298 ] 00:04:07.130 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.130 [2024-04-27 03:15:32.044275] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:07.388 [2024-04-27 03:15:32.166014] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:07.388 [2024-04-27 03:15:32.166089] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1331298' to capture a snapshot of events at runtime. 00:04:07.388 [2024-04-27 03:15:32.166106] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:04:07.388 [2024-04-27 03:15:32.166119] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:04:07.388 [2024-04-27 03:15:32.166131] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1331298 for offline analysis/debug. 00:04:07.388 [2024-04-27 03:15:32.166165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:07.954 03:15:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:07.954 03:15:32 -- common/autotest_common.sh@850 -- # return 0 00:04:07.954 03:15:32 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:07.954 03:15:32 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:07.954 03:15:32 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:07.954 03:15:32 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:07.954 03:15:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.954 03:15:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.954 03:15:32 -- common/autotest_common.sh@10 -- # set +x 00:04:08.212 ************************************ 00:04:08.212 START TEST rpc_integrity 00:04:08.212 ************************************ 00:04:08.212 03:15:33 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:04:08.212 03:15:33 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:08.212 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.212 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.212 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.212 03:15:33 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:08.212 03:15:33 -- rpc/rpc.sh@13 -- # jq length 00:04:08.212 03:15:33 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:08.212 03:15:33 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:08.212 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.212 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.212 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.212 03:15:33 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:08.212 03:15:33 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:08.212 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.212 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.212 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.212 03:15:33 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:08.212 { 00:04:08.212 "name": "Malloc0", 00:04:08.212 "aliases": [ 00:04:08.212 "9626833d-e983-4426-b5fa-25226a360cb1" 00:04:08.212 ], 00:04:08.212 "product_name": "Malloc disk", 00:04:08.212 "block_size": 512, 00:04:08.212 "num_blocks": 16384, 00:04:08.212 "uuid": "9626833d-e983-4426-b5fa-25226a360cb1", 00:04:08.212 "assigned_rate_limits": { 00:04:08.212 "rw_ios_per_sec": 0, 00:04:08.212 "rw_mbytes_per_sec": 0, 00:04:08.212 "r_mbytes_per_sec": 0, 00:04:08.212 "w_mbytes_per_sec": 0 00:04:08.212 }, 00:04:08.212 "claimed": false, 00:04:08.212 "zoned": false, 00:04:08.212 "supported_io_types": { 00:04:08.212 "read": true, 00:04:08.212 "write": true, 00:04:08.213 "unmap": true, 00:04:08.213 "write_zeroes": true, 00:04:08.213 "flush": true, 00:04:08.213 "reset": true, 00:04:08.213 "compare": false, 00:04:08.213 "compare_and_write": false, 00:04:08.213 "abort": true, 00:04:08.213 "nvme_admin": false, 00:04:08.213 "nvme_io": false 00:04:08.213 }, 00:04:08.213 "memory_domains": [ 00:04:08.213 { 00:04:08.213 "dma_device_id": "system", 00:04:08.213 "dma_device_type": 1 00:04:08.213 }, 00:04:08.213 { 00:04:08.213 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.213 "dma_device_type": 2 00:04:08.213 } 00:04:08.213 ], 00:04:08.213 "driver_specific": {} 00:04:08.213 } 00:04:08.213 ]' 00:04:08.213 03:15:33 -- rpc/rpc.sh@17 -- # jq length 00:04:08.213 03:15:33 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:08.213 03:15:33 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:08.213 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.213 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.213 [2024-04-27 03:15:33.113666] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:08.213 [2024-04-27 03:15:33.113716] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:08.213 [2024-04-27 03:15:33.113741] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xd63e70 00:04:08.213 [2024-04-27 03:15:33.113758] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:08.213 [2024-04-27 03:15:33.115308] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:08.213 [2024-04-27 03:15:33.115334] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:08.213 Passthru0 00:04:08.213 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.213 03:15:33 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:08.213 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.213 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.213 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.213 03:15:33 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:08.213 { 00:04:08.213 "name": "Malloc0", 00:04:08.213 "aliases": [ 00:04:08.213 "9626833d-e983-4426-b5fa-25226a360cb1" 00:04:08.213 ], 00:04:08.213 "product_name": "Malloc disk", 00:04:08.213 "block_size": 512, 00:04:08.213 "num_blocks": 16384, 00:04:08.213 "uuid": "9626833d-e983-4426-b5fa-25226a360cb1", 00:04:08.213 "assigned_rate_limits": { 00:04:08.213 "rw_ios_per_sec": 0, 00:04:08.213 "rw_mbytes_per_sec": 0, 00:04:08.213 "r_mbytes_per_sec": 0, 00:04:08.213 "w_mbytes_per_sec": 0 00:04:08.213 }, 00:04:08.213 "claimed": true, 00:04:08.213 "claim_type": "exclusive_write", 00:04:08.213 "zoned": false, 00:04:08.213 "supported_io_types": { 00:04:08.213 "read": true, 00:04:08.213 "write": true, 00:04:08.213 "unmap": true, 00:04:08.213 "write_zeroes": true, 00:04:08.213 "flush": true, 00:04:08.213 "reset": true, 00:04:08.213 "compare": false, 00:04:08.213 "compare_and_write": false, 00:04:08.213 "abort": true, 00:04:08.213 "nvme_admin": false, 00:04:08.213 "nvme_io": false 00:04:08.213 }, 00:04:08.213 "memory_domains": [ 00:04:08.213 { 00:04:08.213 "dma_device_id": "system", 00:04:08.213 "dma_device_type": 1 00:04:08.213 }, 00:04:08.213 { 00:04:08.213 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.213 "dma_device_type": 2 00:04:08.213 } 00:04:08.213 ], 00:04:08.213 "driver_specific": {} 00:04:08.213 }, 00:04:08.213 { 00:04:08.213 "name": "Passthru0", 00:04:08.213 "aliases": [ 00:04:08.213 "1052c555-e511-5b13-a857-844cf5c06ff1" 00:04:08.213 ], 00:04:08.213 "product_name": "passthru", 00:04:08.213 "block_size": 512, 00:04:08.213 "num_blocks": 16384, 00:04:08.213 "uuid": "1052c555-e511-5b13-a857-844cf5c06ff1", 00:04:08.213 "assigned_rate_limits": { 00:04:08.213 "rw_ios_per_sec": 0, 00:04:08.213 "rw_mbytes_per_sec": 0, 00:04:08.213 "r_mbytes_per_sec": 0, 00:04:08.213 "w_mbytes_per_sec": 0 00:04:08.213 }, 00:04:08.213 "claimed": false, 00:04:08.213 "zoned": false, 00:04:08.213 "supported_io_types": { 00:04:08.213 "read": true, 00:04:08.213 "write": true, 00:04:08.213 "unmap": true, 00:04:08.213 "write_zeroes": true, 00:04:08.213 "flush": true, 00:04:08.213 "reset": true, 00:04:08.213 "compare": false, 00:04:08.213 "compare_and_write": false, 00:04:08.213 "abort": true, 00:04:08.213 "nvme_admin": false, 00:04:08.213 "nvme_io": false 00:04:08.213 }, 00:04:08.213 "memory_domains": [ 00:04:08.213 { 00:04:08.213 "dma_device_id": "system", 00:04:08.213 "dma_device_type": 1 00:04:08.213 }, 00:04:08.213 { 00:04:08.213 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.213 "dma_device_type": 2 00:04:08.213 } 00:04:08.213 ], 00:04:08.213 "driver_specific": { 00:04:08.213 "passthru": { 00:04:08.213 "name": "Passthru0", 00:04:08.213 "base_bdev_name": "Malloc0" 00:04:08.213 } 00:04:08.213 } 00:04:08.213 } 00:04:08.213 ]' 00:04:08.213 03:15:33 -- rpc/rpc.sh@21 -- # jq length 00:04:08.213 03:15:33 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:08.213 03:15:33 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:08.213 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.213 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.213 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.213 03:15:33 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:08.213 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.213 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.213 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.213 03:15:33 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:08.213 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.213 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.470 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.470 03:15:33 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:08.470 03:15:33 -- rpc/rpc.sh@26 -- # jq length 00:04:08.470 03:15:33 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:08.470 00:04:08.470 real 0m0.230s 00:04:08.470 user 0m0.151s 00:04:08.470 sys 0m0.021s 00:04:08.470 03:15:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:08.470 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.470 ************************************ 00:04:08.470 END TEST rpc_integrity 00:04:08.470 ************************************ 00:04:08.470 03:15:33 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:08.470 03:15:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.470 03:15:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.470 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.470 ************************************ 00:04:08.470 START TEST rpc_plugins 00:04:08.470 ************************************ 00:04:08.471 03:15:33 -- common/autotest_common.sh@1111 -- # rpc_plugins 00:04:08.471 03:15:33 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:08.471 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.471 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.471 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.471 03:15:33 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:08.471 03:15:33 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:08.471 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.471 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.471 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.471 03:15:33 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:08.471 { 00:04:08.471 "name": "Malloc1", 00:04:08.471 "aliases": [ 00:04:08.471 "1b1115ce-4e71-493d-8e68-0e19bd6b1b7e" 00:04:08.471 ], 00:04:08.471 "product_name": "Malloc disk", 00:04:08.471 "block_size": 4096, 00:04:08.471 "num_blocks": 256, 00:04:08.471 "uuid": "1b1115ce-4e71-493d-8e68-0e19bd6b1b7e", 00:04:08.471 "assigned_rate_limits": { 00:04:08.471 "rw_ios_per_sec": 0, 00:04:08.471 "rw_mbytes_per_sec": 0, 00:04:08.471 "r_mbytes_per_sec": 0, 00:04:08.471 "w_mbytes_per_sec": 0 00:04:08.471 }, 00:04:08.471 "claimed": false, 00:04:08.471 "zoned": false, 00:04:08.471 "supported_io_types": { 00:04:08.471 "read": true, 00:04:08.471 "write": true, 00:04:08.471 "unmap": true, 00:04:08.471 "write_zeroes": true, 00:04:08.471 "flush": true, 00:04:08.471 "reset": true, 00:04:08.471 "compare": false, 00:04:08.471 "compare_and_write": false, 00:04:08.471 "abort": true, 00:04:08.471 "nvme_admin": false, 00:04:08.471 "nvme_io": false 00:04:08.471 }, 00:04:08.471 "memory_domains": [ 00:04:08.471 { 00:04:08.471 "dma_device_id": "system", 00:04:08.471 "dma_device_type": 1 00:04:08.471 }, 00:04:08.471 { 00:04:08.471 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.471 "dma_device_type": 2 00:04:08.471 } 00:04:08.471 ], 00:04:08.471 "driver_specific": {} 00:04:08.471 } 00:04:08.471 ]' 00:04:08.471 03:15:33 -- rpc/rpc.sh@32 -- # jq length 00:04:08.471 03:15:33 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:08.471 03:15:33 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:08.471 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.471 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.471 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.471 03:15:33 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:08.471 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.471 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.471 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.471 03:15:33 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:08.471 03:15:33 -- rpc/rpc.sh@36 -- # jq length 00:04:08.728 03:15:33 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:08.728 00:04:08.728 real 0m0.115s 00:04:08.728 user 0m0.072s 00:04:08.728 sys 0m0.012s 00:04:08.728 03:15:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:08.728 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.728 ************************************ 00:04:08.728 END TEST rpc_plugins 00:04:08.728 ************************************ 00:04:08.728 03:15:33 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:08.728 03:15:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.728 03:15:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.728 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.728 ************************************ 00:04:08.728 START TEST rpc_trace_cmd_test 00:04:08.728 ************************************ 00:04:08.728 03:15:33 -- common/autotest_common.sh@1111 -- # rpc_trace_cmd_test 00:04:08.728 03:15:33 -- rpc/rpc.sh@40 -- # local info 00:04:08.728 03:15:33 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:08.728 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.728 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.728 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.728 03:15:33 -- rpc/rpc.sh@42 -- # info='{ 00:04:08.728 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1331298", 00:04:08.728 "tpoint_group_mask": "0x8", 00:04:08.728 "iscsi_conn": { 00:04:08.728 "mask": "0x2", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "scsi": { 00:04:08.728 "mask": "0x4", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "bdev": { 00:04:08.728 "mask": "0x8", 00:04:08.728 "tpoint_mask": "0xffffffffffffffff" 00:04:08.728 }, 00:04:08.728 "nvmf_rdma": { 00:04:08.728 "mask": "0x10", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "nvmf_tcp": { 00:04:08.728 "mask": "0x20", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "ftl": { 00:04:08.728 "mask": "0x40", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "blobfs": { 00:04:08.728 "mask": "0x80", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "dsa": { 00:04:08.728 "mask": "0x200", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "thread": { 00:04:08.728 "mask": "0x400", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "nvme_pcie": { 00:04:08.728 "mask": "0x800", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "iaa": { 00:04:08.728 "mask": "0x1000", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "nvme_tcp": { 00:04:08.728 "mask": "0x2000", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "bdev_nvme": { 00:04:08.728 "mask": "0x4000", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 }, 00:04:08.728 "sock": { 00:04:08.728 "mask": "0x8000", 00:04:08.728 "tpoint_mask": "0x0" 00:04:08.728 } 00:04:08.728 }' 00:04:08.728 03:15:33 -- rpc/rpc.sh@43 -- # jq length 00:04:08.728 03:15:33 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:04:08.728 03:15:33 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:08.728 03:15:33 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:08.728 03:15:33 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:08.989 03:15:33 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:08.989 03:15:33 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:08.989 03:15:33 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:08.989 03:15:33 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:08.989 03:15:33 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:08.989 00:04:08.989 real 0m0.200s 00:04:08.989 user 0m0.178s 00:04:08.989 sys 0m0.013s 00:04:08.989 03:15:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:08.989 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.989 ************************************ 00:04:08.989 END TEST rpc_trace_cmd_test 00:04:08.989 ************************************ 00:04:08.989 03:15:33 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:08.989 03:15:33 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:08.989 03:15:33 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:08.989 03:15:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.989 03:15:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.989 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.989 ************************************ 00:04:08.989 START TEST rpc_daemon_integrity 00:04:08.989 ************************************ 00:04:08.989 03:15:33 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:04:08.989 03:15:33 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:08.989 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.989 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:08.989 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:08.989 03:15:33 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:08.989 03:15:33 -- rpc/rpc.sh@13 -- # jq length 00:04:08.989 03:15:33 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:08.989 03:15:33 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:08.989 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:08.989 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:09.246 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:09.246 03:15:33 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:09.246 03:15:33 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:09.246 03:15:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:09.246 03:15:33 -- common/autotest_common.sh@10 -- # set +x 00:04:09.246 03:15:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:09.246 03:15:33 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:09.246 { 00:04:09.246 "name": "Malloc2", 00:04:09.246 "aliases": [ 00:04:09.246 "71bb63fb-05b4-4fcb-a983-9d1ff1b83d0f" 00:04:09.246 ], 00:04:09.246 "product_name": "Malloc disk", 00:04:09.246 "block_size": 512, 00:04:09.246 "num_blocks": 16384, 00:04:09.246 "uuid": "71bb63fb-05b4-4fcb-a983-9d1ff1b83d0f", 00:04:09.246 "assigned_rate_limits": { 00:04:09.246 "rw_ios_per_sec": 0, 00:04:09.246 "rw_mbytes_per_sec": 0, 00:04:09.246 "r_mbytes_per_sec": 0, 00:04:09.246 "w_mbytes_per_sec": 0 00:04:09.246 }, 00:04:09.246 "claimed": false, 00:04:09.246 "zoned": false, 00:04:09.246 "supported_io_types": { 00:04:09.246 "read": true, 00:04:09.246 "write": true, 00:04:09.246 "unmap": true, 00:04:09.246 "write_zeroes": true, 00:04:09.246 "flush": true, 00:04:09.246 "reset": true, 00:04:09.246 "compare": false, 00:04:09.246 "compare_and_write": false, 00:04:09.246 "abort": true, 00:04:09.246 "nvme_admin": false, 00:04:09.246 "nvme_io": false 00:04:09.246 }, 00:04:09.246 "memory_domains": [ 00:04:09.246 { 00:04:09.246 "dma_device_id": "system", 00:04:09.246 "dma_device_type": 1 00:04:09.246 }, 00:04:09.246 { 00:04:09.246 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:09.246 "dma_device_type": 2 00:04:09.246 } 00:04:09.246 ], 00:04:09.246 "driver_specific": {} 00:04:09.246 } 00:04:09.246 ]' 00:04:09.246 03:15:33 -- rpc/rpc.sh@17 -- # jq length 00:04:09.246 03:15:34 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:09.247 03:15:34 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:09.247 03:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:09.247 03:15:34 -- common/autotest_common.sh@10 -- # set +x 00:04:09.247 [2024-04-27 03:15:34.025091] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:09.247 [2024-04-27 03:15:34.025137] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:09.247 [2024-04-27 03:15:34.025167] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xd63980 00:04:09.247 [2024-04-27 03:15:34.025185] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:09.247 [2024-04-27 03:15:34.026587] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:09.247 [2024-04-27 03:15:34.026630] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:09.247 Passthru0 00:04:09.247 03:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:09.247 03:15:34 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:09.247 03:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:09.247 03:15:34 -- common/autotest_common.sh@10 -- # set +x 00:04:09.247 03:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:09.247 03:15:34 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:09.247 { 00:04:09.247 "name": "Malloc2", 00:04:09.247 "aliases": [ 00:04:09.247 "71bb63fb-05b4-4fcb-a983-9d1ff1b83d0f" 00:04:09.247 ], 00:04:09.247 "product_name": "Malloc disk", 00:04:09.247 "block_size": 512, 00:04:09.247 "num_blocks": 16384, 00:04:09.247 "uuid": "71bb63fb-05b4-4fcb-a983-9d1ff1b83d0f", 00:04:09.247 "assigned_rate_limits": { 00:04:09.247 "rw_ios_per_sec": 0, 00:04:09.247 "rw_mbytes_per_sec": 0, 00:04:09.247 "r_mbytes_per_sec": 0, 00:04:09.247 "w_mbytes_per_sec": 0 00:04:09.247 }, 00:04:09.247 "claimed": true, 00:04:09.247 "claim_type": "exclusive_write", 00:04:09.247 "zoned": false, 00:04:09.247 "supported_io_types": { 00:04:09.247 "read": true, 00:04:09.247 "write": true, 00:04:09.247 "unmap": true, 00:04:09.247 "write_zeroes": true, 00:04:09.247 "flush": true, 00:04:09.247 "reset": true, 00:04:09.247 "compare": false, 00:04:09.247 "compare_and_write": false, 00:04:09.247 "abort": true, 00:04:09.247 "nvme_admin": false, 00:04:09.247 "nvme_io": false 00:04:09.247 }, 00:04:09.247 "memory_domains": [ 00:04:09.247 { 00:04:09.247 "dma_device_id": "system", 00:04:09.247 "dma_device_type": 1 00:04:09.247 }, 00:04:09.247 { 00:04:09.247 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:09.247 "dma_device_type": 2 00:04:09.247 } 00:04:09.247 ], 00:04:09.247 "driver_specific": {} 00:04:09.247 }, 00:04:09.247 { 00:04:09.247 "name": "Passthru0", 00:04:09.247 "aliases": [ 00:04:09.247 "fd1425f8-3967-5361-9aa0-9f0c335f6908" 00:04:09.247 ], 00:04:09.247 "product_name": "passthru", 00:04:09.247 "block_size": 512, 00:04:09.247 "num_blocks": 16384, 00:04:09.247 "uuid": "fd1425f8-3967-5361-9aa0-9f0c335f6908", 00:04:09.247 "assigned_rate_limits": { 00:04:09.247 "rw_ios_per_sec": 0, 00:04:09.247 "rw_mbytes_per_sec": 0, 00:04:09.247 "r_mbytes_per_sec": 0, 00:04:09.247 "w_mbytes_per_sec": 0 00:04:09.247 }, 00:04:09.247 "claimed": false, 00:04:09.247 "zoned": false, 00:04:09.247 "supported_io_types": { 00:04:09.247 "read": true, 00:04:09.247 "write": true, 00:04:09.247 "unmap": true, 00:04:09.247 "write_zeroes": true, 00:04:09.247 "flush": true, 00:04:09.247 "reset": true, 00:04:09.247 "compare": false, 00:04:09.247 "compare_and_write": false, 00:04:09.247 "abort": true, 00:04:09.247 "nvme_admin": false, 00:04:09.247 "nvme_io": false 00:04:09.247 }, 00:04:09.247 "memory_domains": [ 00:04:09.247 { 00:04:09.247 "dma_device_id": "system", 00:04:09.247 "dma_device_type": 1 00:04:09.247 }, 00:04:09.247 { 00:04:09.247 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:09.247 "dma_device_type": 2 00:04:09.247 } 00:04:09.247 ], 00:04:09.247 "driver_specific": { 00:04:09.247 "passthru": { 00:04:09.247 "name": "Passthru0", 00:04:09.247 "base_bdev_name": "Malloc2" 00:04:09.247 } 00:04:09.247 } 00:04:09.247 } 00:04:09.247 ]' 00:04:09.247 03:15:34 -- rpc/rpc.sh@21 -- # jq length 00:04:09.247 03:15:34 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:09.247 03:15:34 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:09.247 03:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:09.247 03:15:34 -- common/autotest_common.sh@10 -- # set +x 00:04:09.247 03:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:09.247 03:15:34 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:09.247 03:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:09.247 03:15:34 -- common/autotest_common.sh@10 -- # set +x 00:04:09.247 03:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:09.247 03:15:34 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:09.247 03:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:09.247 03:15:34 -- common/autotest_common.sh@10 -- # set +x 00:04:09.247 03:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:09.247 03:15:34 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:09.247 03:15:34 -- rpc/rpc.sh@26 -- # jq length 00:04:09.247 03:15:34 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:09.247 00:04:09.247 real 0m0.223s 00:04:09.247 user 0m0.150s 00:04:09.247 sys 0m0.016s 00:04:09.247 03:15:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:09.247 03:15:34 -- common/autotest_common.sh@10 -- # set +x 00:04:09.247 ************************************ 00:04:09.247 END TEST rpc_daemon_integrity 00:04:09.247 ************************************ 00:04:09.247 03:15:34 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:09.247 03:15:34 -- rpc/rpc.sh@84 -- # killprocess 1331298 00:04:09.247 03:15:34 -- common/autotest_common.sh@936 -- # '[' -z 1331298 ']' 00:04:09.247 03:15:34 -- common/autotest_common.sh@940 -- # kill -0 1331298 00:04:09.247 03:15:34 -- common/autotest_common.sh@941 -- # uname 00:04:09.247 03:15:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:09.247 03:15:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1331298 00:04:09.247 03:15:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:09.247 03:15:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:09.247 03:15:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1331298' 00:04:09.247 killing process with pid 1331298 00:04:09.247 03:15:34 -- common/autotest_common.sh@955 -- # kill 1331298 00:04:09.247 03:15:34 -- common/autotest_common.sh@960 -- # wait 1331298 00:04:09.813 00:04:09.813 real 0m2.759s 00:04:09.813 user 0m3.507s 00:04:09.813 sys 0m0.794s 00:04:09.813 03:15:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:09.813 03:15:34 -- common/autotest_common.sh@10 -- # set +x 00:04:09.813 ************************************ 00:04:09.813 END TEST rpc 00:04:09.813 ************************************ 00:04:09.813 03:15:34 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:09.813 03:15:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.813 03:15:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.813 03:15:34 -- common/autotest_common.sh@10 -- # set +x 00:04:09.813 ************************************ 00:04:09.813 START TEST skip_rpc 00:04:09.813 ************************************ 00:04:09.813 03:15:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:10.070 * Looking for test storage... 00:04:10.070 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:10.070 03:15:34 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:04:10.070 03:15:34 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/log.txt 00:04:10.070 03:15:34 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:04:10.070 03:15:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.070 03:15:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.070 03:15:34 -- common/autotest_common.sh@10 -- # set +x 00:04:10.070 ************************************ 00:04:10.070 START TEST skip_rpc 00:04:10.070 ************************************ 00:04:10.070 03:15:34 -- common/autotest_common.sh@1111 -- # test_skip_rpc 00:04:10.070 03:15:34 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=1331905 00:04:10.070 03:15:34 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:04:10.070 03:15:34 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:10.070 03:15:34 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:04:10.071 [2024-04-27 03:15:34.957387] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:10.071 [2024-04-27 03:15:34.957469] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1331905 ] 00:04:10.071 EAL: No free 2048 kB hugepages reported on node 1 00:04:10.071 [2024-04-27 03:15:35.015923] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:10.328 [2024-04-27 03:15:35.135402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:15.591 03:15:39 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:04:15.591 03:15:39 -- common/autotest_common.sh@638 -- # local es=0 00:04:15.591 03:15:39 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd spdk_get_version 00:04:15.591 03:15:39 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:04:15.591 03:15:39 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:15.591 03:15:39 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:04:15.591 03:15:39 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:15.591 03:15:39 -- common/autotest_common.sh@641 -- # rpc_cmd spdk_get_version 00:04:15.591 03:15:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.591 03:15:39 -- common/autotest_common.sh@10 -- # set +x 00:04:15.591 03:15:39 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:04:15.591 03:15:39 -- common/autotest_common.sh@641 -- # es=1 00:04:15.591 03:15:39 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:04:15.591 03:15:39 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:04:15.591 03:15:39 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:04:15.591 03:15:39 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:04:15.591 03:15:39 -- rpc/skip_rpc.sh@23 -- # killprocess 1331905 00:04:15.591 03:15:39 -- common/autotest_common.sh@936 -- # '[' -z 1331905 ']' 00:04:15.591 03:15:39 -- common/autotest_common.sh@940 -- # kill -0 1331905 00:04:15.591 03:15:39 -- common/autotest_common.sh@941 -- # uname 00:04:15.591 03:15:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:15.591 03:15:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1331905 00:04:15.591 03:15:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:15.591 03:15:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:15.591 03:15:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1331905' 00:04:15.591 killing process with pid 1331905 00:04:15.591 03:15:39 -- common/autotest_common.sh@955 -- # kill 1331905 00:04:15.591 03:15:39 -- common/autotest_common.sh@960 -- # wait 1331905 00:04:15.591 00:04:15.591 real 0m5.491s 00:04:15.591 user 0m5.176s 00:04:15.591 sys 0m0.318s 00:04:15.591 03:15:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:15.591 03:15:40 -- common/autotest_common.sh@10 -- # set +x 00:04:15.591 ************************************ 00:04:15.591 END TEST skip_rpc 00:04:15.591 ************************************ 00:04:15.591 03:15:40 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:04:15.591 03:15:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.591 03:15:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.591 03:15:40 -- common/autotest_common.sh@10 -- # set +x 00:04:15.591 ************************************ 00:04:15.591 START TEST skip_rpc_with_json 00:04:15.591 ************************************ 00:04:15.591 03:15:40 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_json 00:04:15.591 03:15:40 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:04:15.591 03:15:40 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=1332605 00:04:15.591 03:15:40 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:15.591 03:15:40 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:15.591 03:15:40 -- rpc/skip_rpc.sh@31 -- # waitforlisten 1332605 00:04:15.591 03:15:40 -- common/autotest_common.sh@817 -- # '[' -z 1332605 ']' 00:04:15.591 03:15:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:15.591 03:15:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:15.591 03:15:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:15.591 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:15.591 03:15:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:15.591 03:15:40 -- common/autotest_common.sh@10 -- # set +x 00:04:15.591 [2024-04-27 03:15:40.558197] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:15.591 [2024-04-27 03:15:40.558327] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1332605 ] 00:04:15.850 EAL: No free 2048 kB hugepages reported on node 1 00:04:15.850 [2024-04-27 03:15:40.617002] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:15.850 [2024-04-27 03:15:40.725962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:16.109 03:15:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:16.109 03:15:40 -- common/autotest_common.sh@850 -- # return 0 00:04:16.109 03:15:40 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:04:16.109 03:15:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.109 03:15:40 -- common/autotest_common.sh@10 -- # set +x 00:04:16.109 [2024-04-27 03:15:40.982502] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:04:16.109 request: 00:04:16.109 { 00:04:16.109 "trtype": "tcp", 00:04:16.109 "method": "nvmf_get_transports", 00:04:16.109 "req_id": 1 00:04:16.109 } 00:04:16.109 Got JSON-RPC error response 00:04:16.109 response: 00:04:16.109 { 00:04:16.109 "code": -19, 00:04:16.109 "message": "No such device" 00:04:16.109 } 00:04:16.109 03:15:40 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:04:16.109 03:15:40 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:04:16.109 03:15:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.109 03:15:40 -- common/autotest_common.sh@10 -- # set +x 00:04:16.109 [2024-04-27 03:15:40.990643] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:16.109 03:15:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.109 03:15:40 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:04:16.109 03:15:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.109 03:15:40 -- common/autotest_common.sh@10 -- # set +x 00:04:16.367 03:15:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.367 03:15:41 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:04:16.367 { 00:04:16.367 "subsystems": [ 00:04:16.367 { 00:04:16.367 "subsystem": "vfio_user_target", 00:04:16.367 "config": null 00:04:16.367 }, 00:04:16.367 { 00:04:16.367 "subsystem": "keyring", 00:04:16.367 "config": [] 00:04:16.367 }, 00:04:16.367 { 00:04:16.367 "subsystem": "iobuf", 00:04:16.367 "config": [ 00:04:16.367 { 00:04:16.367 "method": "iobuf_set_options", 00:04:16.367 "params": { 00:04:16.368 "small_pool_count": 8192, 00:04:16.368 "large_pool_count": 1024, 00:04:16.368 "small_bufsize": 8192, 00:04:16.368 "large_bufsize": 135168 00:04:16.368 } 00:04:16.368 } 00:04:16.368 ] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "sock", 00:04:16.368 "config": [ 00:04:16.368 { 00:04:16.368 "method": "sock_impl_set_options", 00:04:16.368 "params": { 00:04:16.368 "impl_name": "posix", 00:04:16.368 "recv_buf_size": 2097152, 00:04:16.368 "send_buf_size": 2097152, 00:04:16.368 "enable_recv_pipe": true, 00:04:16.368 "enable_quickack": false, 00:04:16.368 "enable_placement_id": 0, 00:04:16.368 "enable_zerocopy_send_server": true, 00:04:16.368 "enable_zerocopy_send_client": false, 00:04:16.368 "zerocopy_threshold": 0, 00:04:16.368 "tls_version": 0, 00:04:16.368 "enable_ktls": false 00:04:16.368 } 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "method": "sock_impl_set_options", 00:04:16.368 "params": { 00:04:16.368 "impl_name": "ssl", 00:04:16.368 "recv_buf_size": 4096, 00:04:16.368 "send_buf_size": 4096, 00:04:16.368 "enable_recv_pipe": true, 00:04:16.368 "enable_quickack": false, 00:04:16.368 "enable_placement_id": 0, 00:04:16.368 "enable_zerocopy_send_server": true, 00:04:16.368 "enable_zerocopy_send_client": false, 00:04:16.368 "zerocopy_threshold": 0, 00:04:16.368 "tls_version": 0, 00:04:16.368 "enable_ktls": false 00:04:16.368 } 00:04:16.368 } 00:04:16.368 ] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "vmd", 00:04:16.368 "config": [] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "accel", 00:04:16.368 "config": [ 00:04:16.368 { 00:04:16.368 "method": "accel_set_options", 00:04:16.368 "params": { 00:04:16.368 "small_cache_size": 128, 00:04:16.368 "large_cache_size": 16, 00:04:16.368 "task_count": 2048, 00:04:16.368 "sequence_count": 2048, 00:04:16.368 "buf_count": 2048 00:04:16.368 } 00:04:16.368 } 00:04:16.368 ] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "bdev", 00:04:16.368 "config": [ 00:04:16.368 { 00:04:16.368 "method": "bdev_set_options", 00:04:16.368 "params": { 00:04:16.368 "bdev_io_pool_size": 65535, 00:04:16.368 "bdev_io_cache_size": 256, 00:04:16.368 "bdev_auto_examine": true, 00:04:16.368 "iobuf_small_cache_size": 128, 00:04:16.368 "iobuf_large_cache_size": 16 00:04:16.368 } 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "method": "bdev_raid_set_options", 00:04:16.368 "params": { 00:04:16.368 "process_window_size_kb": 1024 00:04:16.368 } 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "method": "bdev_iscsi_set_options", 00:04:16.368 "params": { 00:04:16.368 "timeout_sec": 30 00:04:16.368 } 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "method": "bdev_nvme_set_options", 00:04:16.368 "params": { 00:04:16.368 "action_on_timeout": "none", 00:04:16.368 "timeout_us": 0, 00:04:16.368 "timeout_admin_us": 0, 00:04:16.368 "keep_alive_timeout_ms": 10000, 00:04:16.368 "arbitration_burst": 0, 00:04:16.368 "low_priority_weight": 0, 00:04:16.368 "medium_priority_weight": 0, 00:04:16.368 "high_priority_weight": 0, 00:04:16.368 "nvme_adminq_poll_period_us": 10000, 00:04:16.368 "nvme_ioq_poll_period_us": 0, 00:04:16.368 "io_queue_requests": 0, 00:04:16.368 "delay_cmd_submit": true, 00:04:16.368 "transport_retry_count": 4, 00:04:16.368 "bdev_retry_count": 3, 00:04:16.368 "transport_ack_timeout": 0, 00:04:16.368 "ctrlr_loss_timeout_sec": 0, 00:04:16.368 "reconnect_delay_sec": 0, 00:04:16.368 "fast_io_fail_timeout_sec": 0, 00:04:16.368 "disable_auto_failback": false, 00:04:16.368 "generate_uuids": false, 00:04:16.368 "transport_tos": 0, 00:04:16.368 "nvme_error_stat": false, 00:04:16.368 "rdma_srq_size": 0, 00:04:16.368 "io_path_stat": false, 00:04:16.368 "allow_accel_sequence": false, 00:04:16.368 "rdma_max_cq_size": 0, 00:04:16.368 "rdma_cm_event_timeout_ms": 0, 00:04:16.368 "dhchap_digests": [ 00:04:16.368 "sha256", 00:04:16.368 "sha384", 00:04:16.368 "sha512" 00:04:16.368 ], 00:04:16.368 "dhchap_dhgroups": [ 00:04:16.368 "null", 00:04:16.368 "ffdhe2048", 00:04:16.368 "ffdhe3072", 00:04:16.368 "ffdhe4096", 00:04:16.368 "ffdhe6144", 00:04:16.368 "ffdhe8192" 00:04:16.368 ] 00:04:16.368 } 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "method": "bdev_nvme_set_hotplug", 00:04:16.368 "params": { 00:04:16.368 "period_us": 100000, 00:04:16.368 "enable": false 00:04:16.368 } 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "method": "bdev_wait_for_examine" 00:04:16.368 } 00:04:16.368 ] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "scsi", 00:04:16.368 "config": null 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "scheduler", 00:04:16.368 "config": [ 00:04:16.368 { 00:04:16.368 "method": "framework_set_scheduler", 00:04:16.368 "params": { 00:04:16.368 "name": "static" 00:04:16.368 } 00:04:16.368 } 00:04:16.368 ] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "vhost_scsi", 00:04:16.368 "config": [] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "vhost_blk", 00:04:16.368 "config": [] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "ublk", 00:04:16.368 "config": [] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "nbd", 00:04:16.368 "config": [] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "nvmf", 00:04:16.368 "config": [ 00:04:16.368 { 00:04:16.368 "method": "nvmf_set_config", 00:04:16.368 "params": { 00:04:16.368 "discovery_filter": "match_any", 00:04:16.368 "admin_cmd_passthru": { 00:04:16.368 "identify_ctrlr": false 00:04:16.368 } 00:04:16.368 } 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "method": "nvmf_set_max_subsystems", 00:04:16.368 "params": { 00:04:16.368 "max_subsystems": 1024 00:04:16.368 } 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "method": "nvmf_set_crdt", 00:04:16.368 "params": { 00:04:16.368 "crdt1": 0, 00:04:16.368 "crdt2": 0, 00:04:16.368 "crdt3": 0 00:04:16.368 } 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "method": "nvmf_create_transport", 00:04:16.368 "params": { 00:04:16.368 "trtype": "TCP", 00:04:16.368 "max_queue_depth": 128, 00:04:16.368 "max_io_qpairs_per_ctrlr": 127, 00:04:16.368 "in_capsule_data_size": 4096, 00:04:16.368 "max_io_size": 131072, 00:04:16.368 "io_unit_size": 131072, 00:04:16.368 "max_aq_depth": 128, 00:04:16.368 "num_shared_buffers": 511, 00:04:16.368 "buf_cache_size": 4294967295, 00:04:16.368 "dif_insert_or_strip": false, 00:04:16.368 "zcopy": false, 00:04:16.368 "c2h_success": true, 00:04:16.368 "sock_priority": 0, 00:04:16.368 "abort_timeout_sec": 1, 00:04:16.368 "ack_timeout": 0, 00:04:16.368 "data_wr_pool_size": 0 00:04:16.368 } 00:04:16.368 } 00:04:16.368 ] 00:04:16.368 }, 00:04:16.368 { 00:04:16.368 "subsystem": "iscsi", 00:04:16.368 "config": [ 00:04:16.368 { 00:04:16.368 "method": "iscsi_set_options", 00:04:16.368 "params": { 00:04:16.368 "node_base": "iqn.2016-06.io.spdk", 00:04:16.368 "max_sessions": 128, 00:04:16.368 "max_connections_per_session": 2, 00:04:16.368 "max_queue_depth": 64, 00:04:16.368 "default_time2wait": 2, 00:04:16.368 "default_time2retain": 20, 00:04:16.368 "first_burst_length": 8192, 00:04:16.368 "immediate_data": true, 00:04:16.368 "allow_duplicated_isid": false, 00:04:16.368 "error_recovery_level": 0, 00:04:16.368 "nop_timeout": 60, 00:04:16.368 "nop_in_interval": 30, 00:04:16.368 "disable_chap": false, 00:04:16.368 "require_chap": false, 00:04:16.368 "mutual_chap": false, 00:04:16.368 "chap_group": 0, 00:04:16.368 "max_large_datain_per_connection": 64, 00:04:16.368 "max_r2t_per_connection": 4, 00:04:16.368 "pdu_pool_size": 36864, 00:04:16.368 "immediate_data_pool_size": 16384, 00:04:16.368 "data_out_pool_size": 2048 00:04:16.368 } 00:04:16.368 } 00:04:16.368 ] 00:04:16.368 } 00:04:16.368 ] 00:04:16.368 } 00:04:16.368 03:15:41 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:04:16.368 03:15:41 -- rpc/skip_rpc.sh@40 -- # killprocess 1332605 00:04:16.368 03:15:41 -- common/autotest_common.sh@936 -- # '[' -z 1332605 ']' 00:04:16.368 03:15:41 -- common/autotest_common.sh@940 -- # kill -0 1332605 00:04:16.368 03:15:41 -- common/autotest_common.sh@941 -- # uname 00:04:16.368 03:15:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:16.368 03:15:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1332605 00:04:16.368 03:15:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:16.368 03:15:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:16.368 03:15:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1332605' 00:04:16.368 killing process with pid 1332605 00:04:16.368 03:15:41 -- common/autotest_common.sh@955 -- # kill 1332605 00:04:16.368 03:15:41 -- common/autotest_common.sh@960 -- # wait 1332605 00:04:16.935 03:15:41 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=1332745 00:04:16.935 03:15:41 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:04:16.935 03:15:41 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:04:22.197 03:15:46 -- rpc/skip_rpc.sh@50 -- # killprocess 1332745 00:04:22.197 03:15:46 -- common/autotest_common.sh@936 -- # '[' -z 1332745 ']' 00:04:22.197 03:15:46 -- common/autotest_common.sh@940 -- # kill -0 1332745 00:04:22.197 03:15:46 -- common/autotest_common.sh@941 -- # uname 00:04:22.197 03:15:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:22.197 03:15:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1332745 00:04:22.197 03:15:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:22.197 03:15:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:22.197 03:15:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1332745' 00:04:22.197 killing process with pid 1332745 00:04:22.197 03:15:46 -- common/autotest_common.sh@955 -- # kill 1332745 00:04:22.197 03:15:46 -- common/autotest_common.sh@960 -- # wait 1332745 00:04:22.197 03:15:47 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/log.txt 00:04:22.197 03:15:47 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/log.txt 00:04:22.197 00:04:22.197 real 0m6.621s 00:04:22.197 user 0m6.209s 00:04:22.197 sys 0m0.693s 00:04:22.197 03:15:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:22.197 03:15:47 -- common/autotest_common.sh@10 -- # set +x 00:04:22.197 ************************************ 00:04:22.197 END TEST skip_rpc_with_json 00:04:22.197 ************************************ 00:04:22.198 03:15:47 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:04:22.198 03:15:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.198 03:15:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.198 03:15:47 -- common/autotest_common.sh@10 -- # set +x 00:04:22.455 ************************************ 00:04:22.455 START TEST skip_rpc_with_delay 00:04:22.455 ************************************ 00:04:22.455 03:15:47 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_delay 00:04:22.455 03:15:47 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:22.455 03:15:47 -- common/autotest_common.sh@638 -- # local es=0 00:04:22.455 03:15:47 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:22.455 03:15:47 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:22.455 03:15:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:22.455 03:15:47 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:22.455 03:15:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:22.455 03:15:47 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:22.455 03:15:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:22.455 03:15:47 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:22.455 03:15:47 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:04:22.455 03:15:47 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:22.455 [2024-04-27 03:15:47.299388] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:04:22.455 [2024-04-27 03:15:47.299507] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:04:22.455 03:15:47 -- common/autotest_common.sh@641 -- # es=1 00:04:22.455 03:15:47 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:04:22.455 03:15:47 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:04:22.455 03:15:47 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:04:22.455 00:04:22.455 real 0m0.064s 00:04:22.455 user 0m0.043s 00:04:22.455 sys 0m0.021s 00:04:22.455 03:15:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:22.455 03:15:47 -- common/autotest_common.sh@10 -- # set +x 00:04:22.455 ************************************ 00:04:22.455 END TEST skip_rpc_with_delay 00:04:22.455 ************************************ 00:04:22.455 03:15:47 -- rpc/skip_rpc.sh@77 -- # uname 00:04:22.455 03:15:47 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:04:22.455 03:15:47 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:04:22.455 03:15:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.455 03:15:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.455 03:15:47 -- common/autotest_common.sh@10 -- # set +x 00:04:22.455 ************************************ 00:04:22.455 START TEST exit_on_failed_rpc_init 00:04:22.455 ************************************ 00:04:22.455 03:15:47 -- common/autotest_common.sh@1111 -- # test_exit_on_failed_rpc_init 00:04:22.455 03:15:47 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=1333475 00:04:22.455 03:15:47 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:22.455 03:15:47 -- rpc/skip_rpc.sh@63 -- # waitforlisten 1333475 00:04:22.455 03:15:47 -- common/autotest_common.sh@817 -- # '[' -z 1333475 ']' 00:04:22.455 03:15:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:22.455 03:15:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:22.455 03:15:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:22.455 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:22.455 03:15:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:22.455 03:15:47 -- common/autotest_common.sh@10 -- # set +x 00:04:22.714 [2024-04-27 03:15:47.474727] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:22.714 [2024-04-27 03:15:47.474810] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1333475 ] 00:04:22.714 EAL: No free 2048 kB hugepages reported on node 1 00:04:22.714 [2024-04-27 03:15:47.533697] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:22.714 [2024-04-27 03:15:47.649645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:23.648 03:15:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:23.648 03:15:48 -- common/autotest_common.sh@850 -- # return 0 00:04:23.648 03:15:48 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:23.648 03:15:48 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:23.648 03:15:48 -- common/autotest_common.sh@638 -- # local es=0 00:04:23.648 03:15:48 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:23.648 03:15:48 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:23.648 03:15:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:23.648 03:15:48 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:23.648 03:15:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:23.648 03:15:48 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:23.648 03:15:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:23.648 03:15:48 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:23.648 03:15:48 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:04:23.648 03:15:48 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:23.648 [2024-04-27 03:15:48.455858] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:23.648 [2024-04-27 03:15:48.455959] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1333612 ] 00:04:23.648 EAL: No free 2048 kB hugepages reported on node 1 00:04:23.648 [2024-04-27 03:15:48.517101] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:23.906 [2024-04-27 03:15:48.633133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:23.906 [2024-04-27 03:15:48.633264] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:04:23.906 [2024-04-27 03:15:48.633318] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:04:23.906 [2024-04-27 03:15:48.633336] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:23.906 03:15:48 -- common/autotest_common.sh@641 -- # es=234 00:04:23.906 03:15:48 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:04:23.906 03:15:48 -- common/autotest_common.sh@650 -- # es=106 00:04:23.906 03:15:48 -- common/autotest_common.sh@651 -- # case "$es" in 00:04:23.906 03:15:48 -- common/autotest_common.sh@658 -- # es=1 00:04:23.906 03:15:48 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:04:23.906 03:15:48 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:04:23.906 03:15:48 -- rpc/skip_rpc.sh@70 -- # killprocess 1333475 00:04:23.906 03:15:48 -- common/autotest_common.sh@936 -- # '[' -z 1333475 ']' 00:04:23.906 03:15:48 -- common/autotest_common.sh@940 -- # kill -0 1333475 00:04:23.906 03:15:48 -- common/autotest_common.sh@941 -- # uname 00:04:23.906 03:15:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:23.906 03:15:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1333475 00:04:23.906 03:15:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:23.906 03:15:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:23.906 03:15:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1333475' 00:04:23.906 killing process with pid 1333475 00:04:23.906 03:15:48 -- common/autotest_common.sh@955 -- # kill 1333475 00:04:23.906 03:15:48 -- common/autotest_common.sh@960 -- # wait 1333475 00:04:24.472 00:04:24.472 real 0m1.804s 00:04:24.472 user 0m2.164s 00:04:24.472 sys 0m0.477s 00:04:24.472 03:15:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:24.472 03:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:24.472 ************************************ 00:04:24.472 END TEST exit_on_failed_rpc_init 00:04:24.472 ************************************ 00:04:24.472 03:15:49 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:04:24.472 00:04:24.472 real 0m14.498s 00:04:24.472 user 0m13.806s 00:04:24.472 sys 0m1.783s 00:04:24.472 03:15:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:24.472 03:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:24.472 ************************************ 00:04:24.472 END TEST skip_rpc 00:04:24.472 ************************************ 00:04:24.472 03:15:49 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:24.472 03:15:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:24.472 03:15:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:24.472 03:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:24.472 ************************************ 00:04:24.472 START TEST rpc_client 00:04:24.472 ************************************ 00:04:24.472 03:15:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:24.472 * Looking for test storage... 00:04:24.472 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:24.472 03:15:49 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:24.472 OK 00:04:24.730 03:15:49 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:24.730 00:04:24.730 real 0m0.067s 00:04:24.730 user 0m0.031s 00:04:24.731 sys 0m0.041s 00:04:24.731 03:15:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:24.731 03:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:24.731 ************************************ 00:04:24.731 END TEST rpc_client 00:04:24.731 ************************************ 00:04:24.731 03:15:49 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:24.731 03:15:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:24.731 03:15:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:24.731 03:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:24.731 ************************************ 00:04:24.731 START TEST json_config 00:04:24.731 ************************************ 00:04:24.731 03:15:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:24.731 03:15:49 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:24.731 03:15:49 -- nvmf/common.sh@7 -- # uname -s 00:04:24.731 03:15:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:24.731 03:15:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:24.731 03:15:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:24.731 03:15:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:24.731 03:15:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:24.731 03:15:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:24.731 03:15:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:24.731 03:15:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:24.731 03:15:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:24.731 03:15:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:24.731 03:15:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:04:24.731 03:15:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:04:24.731 03:15:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:24.731 03:15:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:24.731 03:15:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:24.731 03:15:49 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:24.731 03:15:49 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:24.731 03:15:49 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:24.731 03:15:49 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:24.731 03:15:49 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:24.731 03:15:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:24.731 03:15:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:24.731 03:15:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:24.731 03:15:49 -- paths/export.sh@5 -- # export PATH 00:04:24.731 03:15:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:24.731 03:15:49 -- nvmf/common.sh@47 -- # : 0 00:04:24.731 03:15:49 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:04:24.731 03:15:49 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:04:24.731 03:15:49 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:24.731 03:15:49 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:24.731 03:15:49 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:24.731 03:15:49 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:04:24.731 03:15:49 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:04:24.731 03:15:49 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:04:24.731 03:15:49 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/common.sh 00:04:24.731 03:15:49 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:04:24.731 03:15:49 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:04:24.731 03:15:49 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:04:24.731 03:15:49 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:24.731 03:15:49 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:04:24.731 03:15:49 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:04:24.731 03:15:49 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:24.731 03:15:49 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:04:24.731 03:15:49 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:24.731 03:15:49 -- json_config/json_config.sh@33 -- # declare -A app_params 00:04:24.731 03:15:49 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:24.731 03:15:49 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:04:24.731 03:15:49 -- json_config/json_config.sh@40 -- # last_event_id=0 00:04:24.731 03:15:49 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:24.731 03:15:49 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:04:24.731 INFO: JSON configuration test init 00:04:24.731 03:15:49 -- json_config/json_config.sh@357 -- # json_config_test_init 00:04:24.731 03:15:49 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:04:24.731 03:15:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:24.731 03:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:24.731 03:15:49 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:04:24.731 03:15:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:24.731 03:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:24.731 03:15:49 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:04:24.731 03:15:49 -- json_config/common.sh@9 -- # local app=target 00:04:24.731 03:15:49 -- json_config/common.sh@10 -- # shift 00:04:24.731 03:15:49 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:24.731 03:15:49 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:24.731 03:15:49 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:24.732 03:15:49 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:24.732 03:15:49 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:24.732 03:15:49 -- json_config/common.sh@22 -- # app_pid["$app"]=1333878 00:04:24.732 03:15:49 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:24.732 03:15:49 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:24.732 Waiting for target to run... 00:04:24.732 03:15:49 -- json_config/common.sh@25 -- # waitforlisten 1333878 /var/tmp/spdk_tgt.sock 00:04:24.732 03:15:49 -- common/autotest_common.sh@817 -- # '[' -z 1333878 ']' 00:04:24.732 03:15:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:24.732 03:15:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:24.732 03:15:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:24.732 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:24.732 03:15:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:24.732 03:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:24.732 [2024-04-27 03:15:49.657317] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:24.732 [2024-04-27 03:15:49.657404] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1333878 ] 00:04:24.732 EAL: No free 2048 kB hugepages reported on node 1 00:04:25.298 [2024-04-27 03:15:49.998234] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:25.298 [2024-04-27 03:15:50.083755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:25.862 03:15:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:25.862 03:15:50 -- common/autotest_common.sh@850 -- # return 0 00:04:25.862 03:15:50 -- json_config/common.sh@26 -- # echo '' 00:04:25.862 00:04:25.862 03:15:50 -- json_config/json_config.sh@269 -- # create_accel_config 00:04:25.862 03:15:50 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:04:25.862 03:15:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:25.862 03:15:50 -- common/autotest_common.sh@10 -- # set +x 00:04:25.862 03:15:50 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:04:25.862 03:15:50 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:04:25.862 03:15:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:25.862 03:15:50 -- common/autotest_common.sh@10 -- # set +x 00:04:25.862 03:15:50 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:25.862 03:15:50 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:04:25.862 03:15:50 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:29.145 03:15:53 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:04:29.145 03:15:53 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:04:29.145 03:15:53 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:29.145 03:15:53 -- common/autotest_common.sh@10 -- # set +x 00:04:29.145 03:15:53 -- json_config/json_config.sh@45 -- # local ret=0 00:04:29.145 03:15:53 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:29.145 03:15:53 -- json_config/json_config.sh@46 -- # local enabled_types 00:04:29.145 03:15:53 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:04:29.145 03:15:53 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:29.146 03:15:53 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:04:29.146 03:15:53 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:29.146 03:15:53 -- json_config/json_config.sh@48 -- # local get_types 00:04:29.146 03:15:53 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:29.146 03:15:53 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:04:29.146 03:15:53 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:29.146 03:15:53 -- common/autotest_common.sh@10 -- # set +x 00:04:29.146 03:15:54 -- json_config/json_config.sh@55 -- # return 0 00:04:29.146 03:15:54 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:04:29.146 03:15:54 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:04:29.146 03:15:54 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:04:29.146 03:15:54 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:04:29.146 03:15:54 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:04:29.146 03:15:54 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:04:29.146 03:15:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:29.146 03:15:54 -- common/autotest_common.sh@10 -- # set +x 00:04:29.146 03:15:54 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:29.146 03:15:54 -- json_config/json_config.sh@233 -- # [[ tcp == \r\d\m\a ]] 00:04:29.146 03:15:54 -- json_config/json_config.sh@237 -- # [[ -z 127.0.0.1 ]] 00:04:29.146 03:15:54 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:29.146 03:15:54 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:29.404 MallocForNvmf0 00:04:29.404 03:15:54 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:29.404 03:15:54 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:29.721 MallocForNvmf1 00:04:29.721 03:15:54 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:29.721 03:15:54 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:30.010 [2024-04-27 03:15:54.724728] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:30.010 03:15:54 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:30.010 03:15:54 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:30.268 03:15:54 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:30.268 03:15:54 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:30.268 03:15:55 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:30.268 03:15:55 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:30.526 03:15:55 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:30.526 03:15:55 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:30.784 [2024-04-27 03:15:55.659770] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:30.784 03:15:55 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:04:30.784 03:15:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:30.784 03:15:55 -- common/autotest_common.sh@10 -- # set +x 00:04:30.784 03:15:55 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:04:30.784 03:15:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:30.784 03:15:55 -- common/autotest_common.sh@10 -- # set +x 00:04:30.784 03:15:55 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:04:30.784 03:15:55 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:30.784 03:15:55 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:31.041 MallocBdevForConfigChangeCheck 00:04:31.041 03:15:55 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:04:31.041 03:15:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:31.041 03:15:55 -- common/autotest_common.sh@10 -- # set +x 00:04:31.041 03:15:55 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:04:31.041 03:15:55 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:31.607 03:15:56 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:04:31.607 INFO: shutting down applications... 00:04:31.607 03:15:56 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:04:31.607 03:15:56 -- json_config/json_config.sh@368 -- # json_config_clear target 00:04:31.607 03:15:56 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:04:31.607 03:15:56 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:32.980 Calling clear_iscsi_subsystem 00:04:32.980 Calling clear_nvmf_subsystem 00:04:32.980 Calling clear_nbd_subsystem 00:04:32.980 Calling clear_ublk_subsystem 00:04:32.980 Calling clear_vhost_blk_subsystem 00:04:32.980 Calling clear_vhost_scsi_subsystem 00:04:32.980 Calling clear_bdev_subsystem 00:04:32.980 03:15:57 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:32.980 03:15:57 -- json_config/json_config.sh@343 -- # count=100 00:04:32.980 03:15:57 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:04:32.980 03:15:57 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:32.980 03:15:57 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:32.980 03:15:57 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:33.546 03:15:58 -- json_config/json_config.sh@345 -- # break 00:04:33.546 03:15:58 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:04:33.546 03:15:58 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:04:33.546 03:15:58 -- json_config/common.sh@31 -- # local app=target 00:04:33.546 03:15:58 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:04:33.546 03:15:58 -- json_config/common.sh@35 -- # [[ -n 1333878 ]] 00:04:33.546 03:15:58 -- json_config/common.sh@38 -- # kill -SIGINT 1333878 00:04:33.546 03:15:58 -- json_config/common.sh@40 -- # (( i = 0 )) 00:04:33.546 03:15:58 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:33.546 03:15:58 -- json_config/common.sh@41 -- # kill -0 1333878 00:04:33.546 03:15:58 -- json_config/common.sh@45 -- # sleep 0.5 00:04:34.113 03:15:58 -- json_config/common.sh@40 -- # (( i++ )) 00:04:34.113 03:15:58 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:34.113 03:15:58 -- json_config/common.sh@41 -- # kill -0 1333878 00:04:34.113 03:15:58 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:04:34.113 03:15:58 -- json_config/common.sh@43 -- # break 00:04:34.113 03:15:58 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:04:34.113 03:15:58 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:04:34.113 SPDK target shutdown done 00:04:34.113 03:15:58 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:04:34.113 INFO: relaunching applications... 00:04:34.113 03:15:58 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:34.113 03:15:58 -- json_config/common.sh@9 -- # local app=target 00:04:34.113 03:15:58 -- json_config/common.sh@10 -- # shift 00:04:34.113 03:15:58 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:34.113 03:15:58 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:34.113 03:15:58 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:34.113 03:15:58 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:34.113 03:15:58 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:34.113 03:15:58 -- json_config/common.sh@22 -- # app_pid["$app"]=1335067 00:04:34.114 03:15:58 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:34.114 03:15:58 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:34.114 Waiting for target to run... 00:04:34.114 03:15:58 -- json_config/common.sh@25 -- # waitforlisten 1335067 /var/tmp/spdk_tgt.sock 00:04:34.114 03:15:58 -- common/autotest_common.sh@817 -- # '[' -z 1335067 ']' 00:04:34.114 03:15:58 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:34.114 03:15:58 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:34.114 03:15:58 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:34.114 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:34.114 03:15:58 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:34.114 03:15:58 -- common/autotest_common.sh@10 -- # set +x 00:04:34.114 [2024-04-27 03:15:58.869144] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:34.114 [2024-04-27 03:15:58.869219] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1335067 ] 00:04:34.114 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.681 [2024-04-27 03:15:59.360671] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:34.681 [2024-04-27 03:15:59.459385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:37.963 [2024-04-27 03:16:02.494180] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:37.963 [2024-04-27 03:16:02.526658] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:38.528 03:16:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:38.528 03:16:03 -- common/autotest_common.sh@850 -- # return 0 00:04:38.528 03:16:03 -- json_config/common.sh@26 -- # echo '' 00:04:38.528 00:04:38.528 03:16:03 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:04:38.529 03:16:03 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:38.529 INFO: Checking if target configuration is the same... 00:04:38.529 03:16:03 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:38.529 03:16:03 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:04:38.529 03:16:03 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:38.529 + '[' 2 -ne 2 ']' 00:04:38.529 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:38.529 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:38.529 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:38.529 +++ basename /dev/fd/62 00:04:38.529 ++ mktemp /tmp/62.XXX 00:04:38.529 + tmp_file_1=/tmp/62.fJV 00:04:38.529 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:38.529 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:38.529 + tmp_file_2=/tmp/spdk_tgt_config.json.77N 00:04:38.529 + ret=0 00:04:38.529 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:38.786 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:38.786 + diff -u /tmp/62.fJV /tmp/spdk_tgt_config.json.77N 00:04:38.786 + echo 'INFO: JSON config files are the same' 00:04:38.786 INFO: JSON config files are the same 00:04:38.786 + rm /tmp/62.fJV /tmp/spdk_tgt_config.json.77N 00:04:38.786 + exit 0 00:04:38.786 03:16:03 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:04:38.786 03:16:03 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:38.786 INFO: changing configuration and checking if this can be detected... 00:04:38.786 03:16:03 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:38.786 03:16:03 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:39.044 03:16:03 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:39.044 03:16:03 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:04:39.044 03:16:03 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:39.044 + '[' 2 -ne 2 ']' 00:04:39.044 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:39.044 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:39.044 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:39.044 +++ basename /dev/fd/62 00:04:39.044 ++ mktemp /tmp/62.XXX 00:04:39.044 + tmp_file_1=/tmp/62.o3E 00:04:39.044 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:39.044 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:39.044 + tmp_file_2=/tmp/spdk_tgt_config.json.D9o 00:04:39.044 + ret=0 00:04:39.044 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:39.609 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:39.609 + diff -u /tmp/62.o3E /tmp/spdk_tgt_config.json.D9o 00:04:39.609 + ret=1 00:04:39.609 + echo '=== Start of file: /tmp/62.o3E ===' 00:04:39.609 + cat /tmp/62.o3E 00:04:39.609 + echo '=== End of file: /tmp/62.o3E ===' 00:04:39.609 + echo '' 00:04:39.609 + echo '=== Start of file: /tmp/spdk_tgt_config.json.D9o ===' 00:04:39.609 + cat /tmp/spdk_tgt_config.json.D9o 00:04:39.609 + echo '=== End of file: /tmp/spdk_tgt_config.json.D9o ===' 00:04:39.609 + echo '' 00:04:39.609 + rm /tmp/62.o3E /tmp/spdk_tgt_config.json.D9o 00:04:39.609 + exit 1 00:04:39.609 03:16:04 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:04:39.609 INFO: configuration change detected. 00:04:39.609 03:16:04 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:04:39.609 03:16:04 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:04:39.609 03:16:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:39.609 03:16:04 -- common/autotest_common.sh@10 -- # set +x 00:04:39.610 03:16:04 -- json_config/json_config.sh@307 -- # local ret=0 00:04:39.610 03:16:04 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:04:39.610 03:16:04 -- json_config/json_config.sh@317 -- # [[ -n 1335067 ]] 00:04:39.610 03:16:04 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:04:39.610 03:16:04 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:04:39.610 03:16:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:39.610 03:16:04 -- common/autotest_common.sh@10 -- # set +x 00:04:39.610 03:16:04 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:04:39.610 03:16:04 -- json_config/json_config.sh@193 -- # uname -s 00:04:39.610 03:16:04 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:04:39.610 03:16:04 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:04:39.610 03:16:04 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:04:39.610 03:16:04 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:04:39.610 03:16:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:39.610 03:16:04 -- common/autotest_common.sh@10 -- # set +x 00:04:39.610 03:16:04 -- json_config/json_config.sh@323 -- # killprocess 1335067 00:04:39.610 03:16:04 -- common/autotest_common.sh@936 -- # '[' -z 1335067 ']' 00:04:39.610 03:16:04 -- common/autotest_common.sh@940 -- # kill -0 1335067 00:04:39.610 03:16:04 -- common/autotest_common.sh@941 -- # uname 00:04:39.610 03:16:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:39.610 03:16:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1335067 00:04:39.610 03:16:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:39.610 03:16:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:39.610 03:16:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1335067' 00:04:39.610 killing process with pid 1335067 00:04:39.610 03:16:04 -- common/autotest_common.sh@955 -- # kill 1335067 00:04:39.610 03:16:04 -- common/autotest_common.sh@960 -- # wait 1335067 00:04:41.509 03:16:06 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:41.509 03:16:06 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:04:41.509 03:16:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:41.509 03:16:06 -- common/autotest_common.sh@10 -- # set +x 00:04:41.509 03:16:06 -- json_config/json_config.sh@328 -- # return 0 00:04:41.509 03:16:06 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:04:41.509 INFO: Success 00:04:41.509 00:04:41.509 real 0m16.483s 00:04:41.509 user 0m18.377s 00:04:41.509 sys 0m1.954s 00:04:41.509 03:16:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:41.509 03:16:06 -- common/autotest_common.sh@10 -- # set +x 00:04:41.509 ************************************ 00:04:41.509 END TEST json_config 00:04:41.509 ************************************ 00:04:41.510 03:16:06 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:41.510 03:16:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.510 03:16:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.510 03:16:06 -- common/autotest_common.sh@10 -- # set +x 00:04:41.510 ************************************ 00:04:41.510 START TEST json_config_extra_key 00:04:41.510 ************************************ 00:04:41.510 03:16:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:41.510 03:16:06 -- nvmf/common.sh@7 -- # uname -s 00:04:41.510 03:16:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:41.510 03:16:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:41.510 03:16:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:41.510 03:16:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:41.510 03:16:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:41.510 03:16:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:41.510 03:16:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:41.510 03:16:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:41.510 03:16:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:41.510 03:16:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:41.510 03:16:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:04:41.510 03:16:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:04:41.510 03:16:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:41.510 03:16:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:41.510 03:16:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:41.510 03:16:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:41.510 03:16:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:41.510 03:16:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:41.510 03:16:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:41.510 03:16:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:41.510 03:16:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:41.510 03:16:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:41.510 03:16:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:41.510 03:16:06 -- paths/export.sh@5 -- # export PATH 00:04:41.510 03:16:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:41.510 03:16:06 -- nvmf/common.sh@47 -- # : 0 00:04:41.510 03:16:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:04:41.510 03:16:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:04:41.510 03:16:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:41.510 03:16:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:41.510 03:16:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:41.510 03:16:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:04:41.510 03:16:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:04:41.510 03:16:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/common.sh 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:04:41.510 INFO: launching applications... 00:04:41.510 03:16:06 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:41.510 03:16:06 -- json_config/common.sh@9 -- # local app=target 00:04:41.510 03:16:06 -- json_config/common.sh@10 -- # shift 00:04:41.510 03:16:06 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:41.510 03:16:06 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:41.510 03:16:06 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:41.510 03:16:06 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:41.510 03:16:06 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:41.510 03:16:06 -- json_config/common.sh@22 -- # app_pid["$app"]=1336112 00:04:41.510 03:16:06 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:41.510 03:16:06 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:41.510 Waiting for target to run... 00:04:41.510 03:16:06 -- json_config/common.sh@25 -- # waitforlisten 1336112 /var/tmp/spdk_tgt.sock 00:04:41.510 03:16:06 -- common/autotest_common.sh@817 -- # '[' -z 1336112 ']' 00:04:41.510 03:16:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:41.510 03:16:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:41.510 03:16:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:41.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:41.510 03:16:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:41.510 03:16:06 -- common/autotest_common.sh@10 -- # set +x 00:04:41.510 [2024-04-27 03:16:06.264579] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:41.510 [2024-04-27 03:16:06.264658] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1336112 ] 00:04:41.510 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.077 [2024-04-27 03:16:06.772359] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:42.077 [2024-04-27 03:16:06.878547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.335 03:16:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:42.335 03:16:07 -- common/autotest_common.sh@850 -- # return 0 00:04:42.335 03:16:07 -- json_config/common.sh@26 -- # echo '' 00:04:42.335 00:04:42.335 03:16:07 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:04:42.335 INFO: shutting down applications... 00:04:42.335 03:16:07 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:04:42.335 03:16:07 -- json_config/common.sh@31 -- # local app=target 00:04:42.335 03:16:07 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:04:42.335 03:16:07 -- json_config/common.sh@35 -- # [[ -n 1336112 ]] 00:04:42.335 03:16:07 -- json_config/common.sh@38 -- # kill -SIGINT 1336112 00:04:42.335 03:16:07 -- json_config/common.sh@40 -- # (( i = 0 )) 00:04:42.335 03:16:07 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:42.335 03:16:07 -- json_config/common.sh@41 -- # kill -0 1336112 00:04:42.335 03:16:07 -- json_config/common.sh@45 -- # sleep 0.5 00:04:42.901 03:16:07 -- json_config/common.sh@40 -- # (( i++ )) 00:04:42.901 03:16:07 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:42.901 03:16:07 -- json_config/common.sh@41 -- # kill -0 1336112 00:04:42.901 03:16:07 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:04:42.901 03:16:07 -- json_config/common.sh@43 -- # break 00:04:42.901 03:16:07 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:04:42.901 03:16:07 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:04:42.901 SPDK target shutdown done 00:04:42.901 03:16:07 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:04:42.901 Success 00:04:42.901 00:04:42.901 real 0m1.545s 00:04:42.901 user 0m1.391s 00:04:42.901 sys 0m0.600s 00:04:42.901 03:16:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:42.901 03:16:07 -- common/autotest_common.sh@10 -- # set +x 00:04:42.901 ************************************ 00:04:42.901 END TEST json_config_extra_key 00:04:42.901 ************************************ 00:04:42.901 03:16:07 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:42.901 03:16:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.901 03:16:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.901 03:16:07 -- common/autotest_common.sh@10 -- # set +x 00:04:42.901 ************************************ 00:04:42.901 START TEST alias_rpc 00:04:42.901 ************************************ 00:04:42.901 03:16:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:42.901 * Looking for test storage... 00:04:43.159 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:43.159 03:16:07 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:43.159 03:16:07 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1336312 00:04:43.159 03:16:07 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:43.159 03:16:07 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1336312 00:04:43.159 03:16:07 -- common/autotest_common.sh@817 -- # '[' -z 1336312 ']' 00:04:43.159 03:16:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:43.159 03:16:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:43.159 03:16:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:43.159 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:43.159 03:16:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:43.159 03:16:07 -- common/autotest_common.sh@10 -- # set +x 00:04:43.159 [2024-04-27 03:16:07.933546] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:43.159 [2024-04-27 03:16:07.933627] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1336312 ] 00:04:43.159 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.159 [2024-04-27 03:16:08.005520] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:43.159 [2024-04-27 03:16:08.131871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.093 03:16:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:44.093 03:16:08 -- common/autotest_common.sh@850 -- # return 0 00:04:44.093 03:16:08 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:44.351 03:16:09 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1336312 00:04:44.351 03:16:09 -- common/autotest_common.sh@936 -- # '[' -z 1336312 ']' 00:04:44.351 03:16:09 -- common/autotest_common.sh@940 -- # kill -0 1336312 00:04:44.351 03:16:09 -- common/autotest_common.sh@941 -- # uname 00:04:44.351 03:16:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:44.351 03:16:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1336312 00:04:44.351 03:16:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:44.351 03:16:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:44.351 03:16:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1336312' 00:04:44.351 killing process with pid 1336312 00:04:44.351 03:16:09 -- common/autotest_common.sh@955 -- # kill 1336312 00:04:44.351 03:16:09 -- common/autotest_common.sh@960 -- # wait 1336312 00:04:44.917 00:04:44.917 real 0m1.762s 00:04:44.917 user 0m1.979s 00:04:44.917 sys 0m0.481s 00:04:44.917 03:16:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:44.917 03:16:09 -- common/autotest_common.sh@10 -- # set +x 00:04:44.917 ************************************ 00:04:44.917 END TEST alias_rpc 00:04:44.917 ************************************ 00:04:44.917 03:16:09 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:04:44.917 03:16:09 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:44.917 03:16:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.917 03:16:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.917 03:16:09 -- common/autotest_common.sh@10 -- # set +x 00:04:44.917 ************************************ 00:04:44.917 START TEST spdkcli_tcp 00:04:44.917 ************************************ 00:04:44.917 03:16:09 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:44.917 * Looking for test storage... 00:04:44.917 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:44.917 03:16:09 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:44.917 03:16:09 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:44.917 03:16:09 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:44.917 03:16:09 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:44.917 03:16:09 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:44.917 03:16:09 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:44.917 03:16:09 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:44.917 03:16:09 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:44.917 03:16:09 -- common/autotest_common.sh@10 -- # set +x 00:04:44.917 03:16:09 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1336632 00:04:44.917 03:16:09 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:44.917 03:16:09 -- spdkcli/tcp.sh@27 -- # waitforlisten 1336632 00:04:44.917 03:16:09 -- common/autotest_common.sh@817 -- # '[' -z 1336632 ']' 00:04:44.917 03:16:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:44.917 03:16:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:44.917 03:16:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:44.917 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:44.917 03:16:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:44.918 03:16:09 -- common/autotest_common.sh@10 -- # set +x 00:04:44.918 [2024-04-27 03:16:09.827121] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:44.918 [2024-04-27 03:16:09.827211] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1336632 ] 00:04:44.918 EAL: No free 2048 kB hugepages reported on node 1 00:04:44.918 [2024-04-27 03:16:09.883517] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:45.176 [2024-04-27 03:16:09.986390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:45.176 [2024-04-27 03:16:09.986394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.434 03:16:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:45.434 03:16:10 -- common/autotest_common.sh@850 -- # return 0 00:04:45.434 03:16:10 -- spdkcli/tcp.sh@31 -- # socat_pid=1336642 00:04:45.434 03:16:10 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:45.434 03:16:10 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:45.693 [ 00:04:45.693 "bdev_malloc_delete", 00:04:45.693 "bdev_malloc_create", 00:04:45.693 "bdev_null_resize", 00:04:45.693 "bdev_null_delete", 00:04:45.693 "bdev_null_create", 00:04:45.693 "bdev_nvme_cuse_unregister", 00:04:45.693 "bdev_nvme_cuse_register", 00:04:45.693 "bdev_opal_new_user", 00:04:45.693 "bdev_opal_set_lock_state", 00:04:45.693 "bdev_opal_delete", 00:04:45.693 "bdev_opal_get_info", 00:04:45.693 "bdev_opal_create", 00:04:45.693 "bdev_nvme_opal_revert", 00:04:45.693 "bdev_nvme_opal_init", 00:04:45.693 "bdev_nvme_send_cmd", 00:04:45.693 "bdev_nvme_get_path_iostat", 00:04:45.693 "bdev_nvme_get_mdns_discovery_info", 00:04:45.693 "bdev_nvme_stop_mdns_discovery", 00:04:45.693 "bdev_nvme_start_mdns_discovery", 00:04:45.693 "bdev_nvme_set_multipath_policy", 00:04:45.693 "bdev_nvme_set_preferred_path", 00:04:45.693 "bdev_nvme_get_io_paths", 00:04:45.693 "bdev_nvme_remove_error_injection", 00:04:45.693 "bdev_nvme_add_error_injection", 00:04:45.693 "bdev_nvme_get_discovery_info", 00:04:45.693 "bdev_nvme_stop_discovery", 00:04:45.693 "bdev_nvme_start_discovery", 00:04:45.693 "bdev_nvme_get_controller_health_info", 00:04:45.693 "bdev_nvme_disable_controller", 00:04:45.693 "bdev_nvme_enable_controller", 00:04:45.693 "bdev_nvme_reset_controller", 00:04:45.693 "bdev_nvme_get_transport_statistics", 00:04:45.693 "bdev_nvme_apply_firmware", 00:04:45.693 "bdev_nvme_detach_controller", 00:04:45.693 "bdev_nvme_get_controllers", 00:04:45.693 "bdev_nvme_attach_controller", 00:04:45.693 "bdev_nvme_set_hotplug", 00:04:45.693 "bdev_nvme_set_options", 00:04:45.693 "bdev_passthru_delete", 00:04:45.693 "bdev_passthru_create", 00:04:45.693 "bdev_lvol_grow_lvstore", 00:04:45.693 "bdev_lvol_get_lvols", 00:04:45.693 "bdev_lvol_get_lvstores", 00:04:45.693 "bdev_lvol_delete", 00:04:45.693 "bdev_lvol_set_read_only", 00:04:45.693 "bdev_lvol_resize", 00:04:45.693 "bdev_lvol_decouple_parent", 00:04:45.693 "bdev_lvol_inflate", 00:04:45.693 "bdev_lvol_rename", 00:04:45.693 "bdev_lvol_clone_bdev", 00:04:45.693 "bdev_lvol_clone", 00:04:45.693 "bdev_lvol_snapshot", 00:04:45.693 "bdev_lvol_create", 00:04:45.693 "bdev_lvol_delete_lvstore", 00:04:45.693 "bdev_lvol_rename_lvstore", 00:04:45.693 "bdev_lvol_create_lvstore", 00:04:45.693 "bdev_raid_set_options", 00:04:45.693 "bdev_raid_remove_base_bdev", 00:04:45.693 "bdev_raid_add_base_bdev", 00:04:45.693 "bdev_raid_delete", 00:04:45.693 "bdev_raid_create", 00:04:45.693 "bdev_raid_get_bdevs", 00:04:45.693 "bdev_error_inject_error", 00:04:45.693 "bdev_error_delete", 00:04:45.693 "bdev_error_create", 00:04:45.693 "bdev_split_delete", 00:04:45.693 "bdev_split_create", 00:04:45.693 "bdev_delay_delete", 00:04:45.693 "bdev_delay_create", 00:04:45.693 "bdev_delay_update_latency", 00:04:45.693 "bdev_zone_block_delete", 00:04:45.693 "bdev_zone_block_create", 00:04:45.693 "blobfs_create", 00:04:45.693 "blobfs_detect", 00:04:45.693 "blobfs_set_cache_size", 00:04:45.693 "bdev_aio_delete", 00:04:45.693 "bdev_aio_rescan", 00:04:45.693 "bdev_aio_create", 00:04:45.693 "bdev_ftl_set_property", 00:04:45.693 "bdev_ftl_get_properties", 00:04:45.693 "bdev_ftl_get_stats", 00:04:45.693 "bdev_ftl_unmap", 00:04:45.693 "bdev_ftl_unload", 00:04:45.693 "bdev_ftl_delete", 00:04:45.693 "bdev_ftl_load", 00:04:45.693 "bdev_ftl_create", 00:04:45.693 "bdev_virtio_attach_controller", 00:04:45.693 "bdev_virtio_scsi_get_devices", 00:04:45.693 "bdev_virtio_detach_controller", 00:04:45.693 "bdev_virtio_blk_set_hotplug", 00:04:45.693 "bdev_iscsi_delete", 00:04:45.693 "bdev_iscsi_create", 00:04:45.693 "bdev_iscsi_set_options", 00:04:45.693 "accel_error_inject_error", 00:04:45.693 "ioat_scan_accel_module", 00:04:45.693 "dsa_scan_accel_module", 00:04:45.693 "iaa_scan_accel_module", 00:04:45.693 "vfu_virtio_create_scsi_endpoint", 00:04:45.693 "vfu_virtio_scsi_remove_target", 00:04:45.693 "vfu_virtio_scsi_add_target", 00:04:45.693 "vfu_virtio_create_blk_endpoint", 00:04:45.693 "vfu_virtio_delete_endpoint", 00:04:45.693 "keyring_file_remove_key", 00:04:45.693 "keyring_file_add_key", 00:04:45.694 "iscsi_get_histogram", 00:04:45.694 "iscsi_enable_histogram", 00:04:45.694 "iscsi_set_options", 00:04:45.694 "iscsi_get_auth_groups", 00:04:45.694 "iscsi_auth_group_remove_secret", 00:04:45.694 "iscsi_auth_group_add_secret", 00:04:45.694 "iscsi_delete_auth_group", 00:04:45.694 "iscsi_create_auth_group", 00:04:45.694 "iscsi_set_discovery_auth", 00:04:45.694 "iscsi_get_options", 00:04:45.694 "iscsi_target_node_request_logout", 00:04:45.694 "iscsi_target_node_set_redirect", 00:04:45.694 "iscsi_target_node_set_auth", 00:04:45.694 "iscsi_target_node_add_lun", 00:04:45.694 "iscsi_get_stats", 00:04:45.694 "iscsi_get_connections", 00:04:45.694 "iscsi_portal_group_set_auth", 00:04:45.694 "iscsi_start_portal_group", 00:04:45.694 "iscsi_delete_portal_group", 00:04:45.694 "iscsi_create_portal_group", 00:04:45.694 "iscsi_get_portal_groups", 00:04:45.694 "iscsi_delete_target_node", 00:04:45.694 "iscsi_target_node_remove_pg_ig_maps", 00:04:45.694 "iscsi_target_node_add_pg_ig_maps", 00:04:45.694 "iscsi_create_target_node", 00:04:45.694 "iscsi_get_target_nodes", 00:04:45.694 "iscsi_delete_initiator_group", 00:04:45.694 "iscsi_initiator_group_remove_initiators", 00:04:45.694 "iscsi_initiator_group_add_initiators", 00:04:45.694 "iscsi_create_initiator_group", 00:04:45.694 "iscsi_get_initiator_groups", 00:04:45.694 "nvmf_set_crdt", 00:04:45.694 "nvmf_set_config", 00:04:45.694 "nvmf_set_max_subsystems", 00:04:45.694 "nvmf_subsystem_get_listeners", 00:04:45.694 "nvmf_subsystem_get_qpairs", 00:04:45.694 "nvmf_subsystem_get_controllers", 00:04:45.694 "nvmf_get_stats", 00:04:45.694 "nvmf_get_transports", 00:04:45.694 "nvmf_create_transport", 00:04:45.694 "nvmf_get_targets", 00:04:45.694 "nvmf_delete_target", 00:04:45.694 "nvmf_create_target", 00:04:45.694 "nvmf_subsystem_allow_any_host", 00:04:45.694 "nvmf_subsystem_remove_host", 00:04:45.694 "nvmf_subsystem_add_host", 00:04:45.694 "nvmf_ns_remove_host", 00:04:45.694 "nvmf_ns_add_host", 00:04:45.694 "nvmf_subsystem_remove_ns", 00:04:45.694 "nvmf_subsystem_add_ns", 00:04:45.694 "nvmf_subsystem_listener_set_ana_state", 00:04:45.694 "nvmf_discovery_get_referrals", 00:04:45.694 "nvmf_discovery_remove_referral", 00:04:45.694 "nvmf_discovery_add_referral", 00:04:45.694 "nvmf_subsystem_remove_listener", 00:04:45.694 "nvmf_subsystem_add_listener", 00:04:45.694 "nvmf_delete_subsystem", 00:04:45.694 "nvmf_create_subsystem", 00:04:45.694 "nvmf_get_subsystems", 00:04:45.694 "env_dpdk_get_mem_stats", 00:04:45.694 "nbd_get_disks", 00:04:45.694 "nbd_stop_disk", 00:04:45.694 "nbd_start_disk", 00:04:45.694 "ublk_recover_disk", 00:04:45.694 "ublk_get_disks", 00:04:45.694 "ublk_stop_disk", 00:04:45.694 "ublk_start_disk", 00:04:45.694 "ublk_destroy_target", 00:04:45.694 "ublk_create_target", 00:04:45.694 "virtio_blk_create_transport", 00:04:45.694 "virtio_blk_get_transports", 00:04:45.694 "vhost_controller_set_coalescing", 00:04:45.694 "vhost_get_controllers", 00:04:45.694 "vhost_delete_controller", 00:04:45.694 "vhost_create_blk_controller", 00:04:45.694 "vhost_scsi_controller_remove_target", 00:04:45.694 "vhost_scsi_controller_add_target", 00:04:45.694 "vhost_start_scsi_controller", 00:04:45.694 "vhost_create_scsi_controller", 00:04:45.694 "thread_set_cpumask", 00:04:45.694 "framework_get_scheduler", 00:04:45.694 "framework_set_scheduler", 00:04:45.694 "framework_get_reactors", 00:04:45.694 "thread_get_io_channels", 00:04:45.694 "thread_get_pollers", 00:04:45.694 "thread_get_stats", 00:04:45.694 "framework_monitor_context_switch", 00:04:45.694 "spdk_kill_instance", 00:04:45.694 "log_enable_timestamps", 00:04:45.694 "log_get_flags", 00:04:45.694 "log_clear_flag", 00:04:45.694 "log_set_flag", 00:04:45.694 "log_get_level", 00:04:45.694 "log_set_level", 00:04:45.694 "log_get_print_level", 00:04:45.694 "log_set_print_level", 00:04:45.694 "framework_enable_cpumask_locks", 00:04:45.694 "framework_disable_cpumask_locks", 00:04:45.694 "framework_wait_init", 00:04:45.694 "framework_start_init", 00:04:45.694 "scsi_get_devices", 00:04:45.694 "bdev_get_histogram", 00:04:45.694 "bdev_enable_histogram", 00:04:45.694 "bdev_set_qos_limit", 00:04:45.694 "bdev_set_qd_sampling_period", 00:04:45.694 "bdev_get_bdevs", 00:04:45.694 "bdev_reset_iostat", 00:04:45.694 "bdev_get_iostat", 00:04:45.694 "bdev_examine", 00:04:45.694 "bdev_wait_for_examine", 00:04:45.694 "bdev_set_options", 00:04:45.694 "notify_get_notifications", 00:04:45.694 "notify_get_types", 00:04:45.694 "accel_get_stats", 00:04:45.694 "accel_set_options", 00:04:45.694 "accel_set_driver", 00:04:45.694 "accel_crypto_key_destroy", 00:04:45.694 "accel_crypto_keys_get", 00:04:45.694 "accel_crypto_key_create", 00:04:45.694 "accel_assign_opc", 00:04:45.694 "accel_get_module_info", 00:04:45.694 "accel_get_opc_assignments", 00:04:45.694 "vmd_rescan", 00:04:45.694 "vmd_remove_device", 00:04:45.694 "vmd_enable", 00:04:45.694 "sock_get_default_impl", 00:04:45.694 "sock_set_default_impl", 00:04:45.694 "sock_impl_set_options", 00:04:45.694 "sock_impl_get_options", 00:04:45.694 "iobuf_get_stats", 00:04:45.694 "iobuf_set_options", 00:04:45.694 "keyring_get_keys", 00:04:45.694 "framework_get_pci_devices", 00:04:45.694 "framework_get_config", 00:04:45.694 "framework_get_subsystems", 00:04:45.694 "vfu_tgt_set_base_path", 00:04:45.694 "trace_get_info", 00:04:45.694 "trace_get_tpoint_group_mask", 00:04:45.694 "trace_disable_tpoint_group", 00:04:45.694 "trace_enable_tpoint_group", 00:04:45.694 "trace_clear_tpoint_mask", 00:04:45.694 "trace_set_tpoint_mask", 00:04:45.694 "spdk_get_version", 00:04:45.694 "rpc_get_methods" 00:04:45.694 ] 00:04:45.694 03:16:10 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:45.694 03:16:10 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:45.694 03:16:10 -- common/autotest_common.sh@10 -- # set +x 00:04:45.694 03:16:10 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:45.694 03:16:10 -- spdkcli/tcp.sh@38 -- # killprocess 1336632 00:04:45.694 03:16:10 -- common/autotest_common.sh@936 -- # '[' -z 1336632 ']' 00:04:45.694 03:16:10 -- common/autotest_common.sh@940 -- # kill -0 1336632 00:04:45.694 03:16:10 -- common/autotest_common.sh@941 -- # uname 00:04:45.694 03:16:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:45.694 03:16:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1336632 00:04:45.694 03:16:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:45.694 03:16:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:45.694 03:16:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1336632' 00:04:45.694 killing process with pid 1336632 00:04:45.694 03:16:10 -- common/autotest_common.sh@955 -- # kill 1336632 00:04:45.694 03:16:10 -- common/autotest_common.sh@960 -- # wait 1336632 00:04:46.261 00:04:46.261 real 0m1.298s 00:04:46.261 user 0m2.263s 00:04:46.261 sys 0m0.449s 00:04:46.261 03:16:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:46.261 03:16:11 -- common/autotest_common.sh@10 -- # set +x 00:04:46.261 ************************************ 00:04:46.261 END TEST spdkcli_tcp 00:04:46.261 ************************************ 00:04:46.261 03:16:11 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:46.261 03:16:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.261 03:16:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.261 03:16:11 -- common/autotest_common.sh@10 -- # set +x 00:04:46.261 ************************************ 00:04:46.261 START TEST dpdk_mem_utility 00:04:46.261 ************************************ 00:04:46.261 03:16:11 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:46.261 * Looking for test storage... 00:04:46.261 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:46.261 03:16:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:46.261 03:16:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1336848 00:04:46.261 03:16:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:46.261 03:16:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1336848 00:04:46.261 03:16:11 -- common/autotest_common.sh@817 -- # '[' -z 1336848 ']' 00:04:46.261 03:16:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:46.261 03:16:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:46.261 03:16:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:46.261 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:46.261 03:16:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:46.261 03:16:11 -- common/autotest_common.sh@10 -- # set +x 00:04:46.520 [2024-04-27 03:16:11.253653] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:46.520 [2024-04-27 03:16:11.253739] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1336848 ] 00:04:46.520 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.520 [2024-04-27 03:16:11.309883] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:46.520 [2024-04-27 03:16:11.410520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.778 03:16:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:46.778 03:16:11 -- common/autotest_common.sh@850 -- # return 0 00:04:46.778 03:16:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:46.778 03:16:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:46.778 03:16:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:46.778 03:16:11 -- common/autotest_common.sh@10 -- # set +x 00:04:46.778 { 00:04:46.778 "filename": "/tmp/spdk_mem_dump.txt" 00:04:46.778 } 00:04:46.778 03:16:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:46.778 03:16:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:46.778 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:46.778 1 heaps totaling size 814.000000 MiB 00:04:46.778 size: 814.000000 MiB heap id: 0 00:04:46.778 end heaps---------- 00:04:46.778 8 mempools totaling size 598.116089 MiB 00:04:46.778 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:46.778 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:46.778 size: 84.521057 MiB name: bdev_io_1336848 00:04:46.778 size: 51.011292 MiB name: evtpool_1336848 00:04:46.778 size: 50.003479 MiB name: msgpool_1336848 00:04:46.778 size: 21.763794 MiB name: PDU_Pool 00:04:46.778 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:46.778 size: 0.026123 MiB name: Session_Pool 00:04:46.778 end mempools------- 00:04:46.778 6 memzones totaling size 4.142822 MiB 00:04:46.778 size: 1.000366 MiB name: RG_ring_0_1336848 00:04:46.778 size: 1.000366 MiB name: RG_ring_1_1336848 00:04:46.778 size: 1.000366 MiB name: RG_ring_4_1336848 00:04:46.778 size: 1.000366 MiB name: RG_ring_5_1336848 00:04:46.778 size: 0.125366 MiB name: RG_ring_2_1336848 00:04:46.778 size: 0.015991 MiB name: RG_ring_3_1336848 00:04:46.778 end memzones------- 00:04:46.778 03:16:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:47.037 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:47.037 list of free elements. size: 12.519348 MiB 00:04:47.037 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:47.037 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:47.037 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:47.037 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:47.037 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:47.037 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:47.037 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:47.037 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:47.037 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:47.037 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:47.037 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:47.037 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:47.037 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:47.037 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:47.037 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:47.037 list of standard malloc elements. size: 199.218079 MiB 00:04:47.037 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:47.037 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:47.037 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:47.037 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:47.037 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:47.037 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:47.037 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:47.037 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:47.037 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:47.037 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:47.037 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:47.037 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:47.037 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:47.037 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:47.037 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:47.037 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:47.037 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:47.037 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:47.037 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:47.037 list of memzone associated elements. size: 602.262573 MiB 00:04:47.037 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:47.037 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:47.037 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:47.037 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:47.037 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:47.037 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1336848_0 00:04:47.037 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:47.037 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1336848_0 00:04:47.037 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:47.037 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1336848_0 00:04:47.037 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:47.037 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:47.037 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:47.037 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:47.037 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:47.037 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1336848 00:04:47.037 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:47.037 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1336848 00:04:47.037 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:47.037 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1336848 00:04:47.037 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:47.037 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:47.037 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:47.037 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:47.037 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:47.037 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:47.037 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:47.037 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:47.037 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:47.037 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1336848 00:04:47.037 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:47.037 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1336848 00:04:47.037 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:47.038 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1336848 00:04:47.038 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:47.038 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1336848 00:04:47.038 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:47.038 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1336848 00:04:47.038 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:47.038 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:47.038 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:47.038 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:47.038 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:47.038 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:47.038 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:47.038 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1336848 00:04:47.038 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:47.038 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:47.038 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:47.038 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:47.038 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:47.038 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1336848 00:04:47.038 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:47.038 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:47.038 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:47.038 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1336848 00:04:47.038 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:47.038 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1336848 00:04:47.038 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:47.038 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:47.038 03:16:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:47.038 03:16:11 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1336848 00:04:47.038 03:16:11 -- common/autotest_common.sh@936 -- # '[' -z 1336848 ']' 00:04:47.038 03:16:11 -- common/autotest_common.sh@940 -- # kill -0 1336848 00:04:47.038 03:16:11 -- common/autotest_common.sh@941 -- # uname 00:04:47.038 03:16:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:47.038 03:16:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1336848 00:04:47.038 03:16:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:47.038 03:16:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:47.038 03:16:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1336848' 00:04:47.038 killing process with pid 1336848 00:04:47.038 03:16:11 -- common/autotest_common.sh@955 -- # kill 1336848 00:04:47.038 03:16:11 -- common/autotest_common.sh@960 -- # wait 1336848 00:04:47.296 00:04:47.296 real 0m1.104s 00:04:47.296 user 0m1.069s 00:04:47.296 sys 0m0.400s 00:04:47.296 03:16:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:47.296 03:16:12 -- common/autotest_common.sh@10 -- # set +x 00:04:47.296 ************************************ 00:04:47.296 END TEST dpdk_mem_utility 00:04:47.296 ************************************ 00:04:47.555 03:16:12 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:47.555 03:16:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.555 03:16:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.555 03:16:12 -- common/autotest_common.sh@10 -- # set +x 00:04:47.555 ************************************ 00:04:47.555 START TEST event 00:04:47.555 ************************************ 00:04:47.555 03:16:12 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:47.555 * Looking for test storage... 00:04:47.555 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:47.555 03:16:12 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:47.555 03:16:12 -- bdev/nbd_common.sh@6 -- # set -e 00:04:47.555 03:16:12 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:47.555 03:16:12 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:47.555 03:16:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.555 03:16:12 -- common/autotest_common.sh@10 -- # set +x 00:04:47.844 ************************************ 00:04:47.844 START TEST event_perf 00:04:47.844 ************************************ 00:04:47.844 03:16:12 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:47.844 Running I/O for 1 seconds...[2024-04-27 03:16:12.548939] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:47.844 [2024-04-27 03:16:12.549008] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1337049 ] 00:04:47.844 EAL: No free 2048 kB hugepages reported on node 1 00:04:47.844 [2024-04-27 03:16:12.613672] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:47.844 [2024-04-27 03:16:12.731455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:47.844 [2024-04-27 03:16:12.731521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:47.844 [2024-04-27 03:16:12.731621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.844 [2024-04-27 03:16:12.731618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:49.217 Running I/O for 1 seconds... 00:04:49.217 lcore 0: 232352 00:04:49.217 lcore 1: 232351 00:04:49.217 lcore 2: 232351 00:04:49.217 lcore 3: 232352 00:04:49.217 done. 00:04:49.217 00:04:49.217 real 0m1.318s 00:04:49.217 user 0m4.228s 00:04:49.217 sys 0m0.084s 00:04:49.217 03:16:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:49.217 03:16:13 -- common/autotest_common.sh@10 -- # set +x 00:04:49.217 ************************************ 00:04:49.217 END TEST event_perf 00:04:49.217 ************************************ 00:04:49.217 03:16:13 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:49.217 03:16:13 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:49.217 03:16:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.217 03:16:13 -- common/autotest_common.sh@10 -- # set +x 00:04:49.217 ************************************ 00:04:49.217 START TEST event_reactor 00:04:49.217 ************************************ 00:04:49.217 03:16:13 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:49.217 [2024-04-27 03:16:13.983090] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:49.217 [2024-04-27 03:16:13.983148] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1337340 ] 00:04:49.217 EAL: No free 2048 kB hugepages reported on node 1 00:04:49.217 [2024-04-27 03:16:14.046294] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:49.217 [2024-04-27 03:16:14.160484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:50.589 test_start 00:04:50.589 oneshot 00:04:50.589 tick 100 00:04:50.589 tick 100 00:04:50.589 tick 250 00:04:50.589 tick 100 00:04:50.589 tick 100 00:04:50.589 tick 100 00:04:50.589 tick 250 00:04:50.589 tick 500 00:04:50.589 tick 100 00:04:50.589 tick 100 00:04:50.589 tick 250 00:04:50.589 tick 100 00:04:50.589 tick 100 00:04:50.589 test_end 00:04:50.589 00:04:50.589 real 0m1.309s 00:04:50.589 user 0m1.224s 00:04:50.589 sys 0m0.080s 00:04:50.589 03:16:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:50.589 03:16:15 -- common/autotest_common.sh@10 -- # set +x 00:04:50.589 ************************************ 00:04:50.589 END TEST event_reactor 00:04:50.589 ************************************ 00:04:50.589 03:16:15 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:50.589 03:16:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:50.589 03:16:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.589 03:16:15 -- common/autotest_common.sh@10 -- # set +x 00:04:50.589 ************************************ 00:04:50.589 START TEST event_reactor_perf 00:04:50.589 ************************************ 00:04:50.589 03:16:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:50.589 [2024-04-27 03:16:15.416052] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:50.589 [2024-04-27 03:16:15.416120] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1337502 ] 00:04:50.589 EAL: No free 2048 kB hugepages reported on node 1 00:04:50.589 [2024-04-27 03:16:15.479061] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:50.846 [2024-04-27 03:16:15.594637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.778 test_start 00:04:51.778 test_end 00:04:51.778 Performance: 354745 events per second 00:04:51.778 00:04:51.778 real 0m1.312s 00:04:51.778 user 0m1.233s 00:04:51.778 sys 0m0.075s 00:04:51.778 03:16:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:51.778 03:16:16 -- common/autotest_common.sh@10 -- # set +x 00:04:51.778 ************************************ 00:04:51.778 END TEST event_reactor_perf 00:04:51.778 ************************************ 00:04:51.778 03:16:16 -- event/event.sh@49 -- # uname -s 00:04:51.778 03:16:16 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:51.778 03:16:16 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:51.778 03:16:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.778 03:16:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.778 03:16:16 -- common/autotest_common.sh@10 -- # set +x 00:04:52.036 ************************************ 00:04:52.036 START TEST event_scheduler 00:04:52.036 ************************************ 00:04:52.036 03:16:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:52.036 * Looking for test storage... 00:04:52.036 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:52.036 03:16:16 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:52.036 03:16:16 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1337698 00:04:52.036 03:16:16 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:52.036 03:16:16 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:52.036 03:16:16 -- scheduler/scheduler.sh@37 -- # waitforlisten 1337698 00:04:52.036 03:16:16 -- common/autotest_common.sh@817 -- # '[' -z 1337698 ']' 00:04:52.036 03:16:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:52.036 03:16:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:52.036 03:16:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:52.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:52.036 03:16:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:52.036 03:16:16 -- common/autotest_common.sh@10 -- # set +x 00:04:52.036 [2024-04-27 03:16:16.947092] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:52.036 [2024-04-27 03:16:16.947177] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1337698 ] 00:04:52.036 EAL: No free 2048 kB hugepages reported on node 1 00:04:52.036 [2024-04-27 03:16:17.003944] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:52.294 [2024-04-27 03:16:17.111222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:52.294 [2024-04-27 03:16:17.111293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:52.294 [2024-04-27 03:16:17.111324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:52.294 [2024-04-27 03:16:17.111327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:52.294 03:16:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:52.294 03:16:17 -- common/autotest_common.sh@850 -- # return 0 00:04:52.294 03:16:17 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:52.294 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.294 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.294 POWER: Env isn't set yet! 00:04:52.294 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:52.294 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:52.294 POWER: Cannot get available frequencies of lcore 0 00:04:52.294 POWER: Attempting to initialise PSTAT power management... 00:04:52.294 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:52.294 POWER: Initialized successfully for lcore 0 power management 00:04:52.294 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:52.294 POWER: Initialized successfully for lcore 1 power management 00:04:52.294 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:52.294 POWER: Initialized successfully for lcore 2 power management 00:04:52.294 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:52.294 POWER: Initialized successfully for lcore 3 power management 00:04:52.294 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.294 03:16:17 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:52.294 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.294 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 [2024-04-27 03:16:17.319199] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:52.552 03:16:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:52.552 03:16:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 ************************************ 00:04:52.552 START TEST scheduler_create_thread 00:04:52.552 ************************************ 00:04:52.552 03:16:17 -- common/autotest_common.sh@1111 -- # scheduler_create_thread 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 2 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 3 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 4 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 5 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 6 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 7 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 8 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 9 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 10 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:52.552 03:16:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:52.552 03:16:17 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:52.552 03:16:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:52.552 03:16:17 -- common/autotest_common.sh@10 -- # set +x 00:04:54.447 03:16:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:54.447 03:16:18 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:54.447 03:16:18 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:54.447 03:16:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:54.447 03:16:18 -- common/autotest_common.sh@10 -- # set +x 00:04:55.382 03:16:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:55.382 00:04:55.382 real 0m2.618s 00:04:55.382 user 0m0.013s 00:04:55.382 sys 0m0.001s 00:04:55.382 03:16:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:55.382 03:16:20 -- common/autotest_common.sh@10 -- # set +x 00:04:55.382 ************************************ 00:04:55.382 END TEST scheduler_create_thread 00:04:55.382 ************************************ 00:04:55.382 03:16:20 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:55.382 03:16:20 -- scheduler/scheduler.sh@46 -- # killprocess 1337698 00:04:55.382 03:16:20 -- common/autotest_common.sh@936 -- # '[' -z 1337698 ']' 00:04:55.382 03:16:20 -- common/autotest_common.sh@940 -- # kill -0 1337698 00:04:55.382 03:16:20 -- common/autotest_common.sh@941 -- # uname 00:04:55.382 03:16:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:55.382 03:16:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1337698 00:04:55.382 03:16:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:55.382 03:16:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:55.382 03:16:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1337698' 00:04:55.382 killing process with pid 1337698 00:04:55.382 03:16:20 -- common/autotest_common.sh@955 -- # kill 1337698 00:04:55.382 03:16:20 -- common/autotest_common.sh@960 -- # wait 1337698 00:04:55.639 [2024-04-27 03:16:20.514737] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:55.897 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:55.897 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:55.897 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:55.897 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:55.897 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:55.897 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:55.897 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:55.898 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:55.898 00:04:55.898 real 0m3.927s 00:04:55.898 user 0m5.992s 00:04:55.898 sys 0m0.375s 00:04:55.898 03:16:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:55.898 03:16:20 -- common/autotest_common.sh@10 -- # set +x 00:04:55.898 ************************************ 00:04:55.898 END TEST event_scheduler 00:04:55.898 ************************************ 00:04:55.898 03:16:20 -- event/event.sh@51 -- # modprobe -n nbd 00:04:55.898 03:16:20 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:55.898 03:16:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:55.898 03:16:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.898 03:16:20 -- common/autotest_common.sh@10 -- # set +x 00:04:56.156 ************************************ 00:04:56.156 START TEST app_repeat 00:04:56.156 ************************************ 00:04:56.156 03:16:20 -- common/autotest_common.sh@1111 -- # app_repeat_test 00:04:56.156 03:16:20 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.156 03:16:20 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.156 03:16:20 -- event/event.sh@13 -- # local nbd_list 00:04:56.156 03:16:20 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:56.156 03:16:20 -- event/event.sh@14 -- # local bdev_list 00:04:56.156 03:16:20 -- event/event.sh@15 -- # local repeat_times=4 00:04:56.156 03:16:20 -- event/event.sh@17 -- # modprobe nbd 00:04:56.156 03:16:20 -- event/event.sh@19 -- # repeat_pid=1338278 00:04:56.156 03:16:20 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:56.156 03:16:20 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:56.156 03:16:20 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1338278' 00:04:56.156 Process app_repeat pid: 1338278 00:04:56.156 03:16:20 -- event/event.sh@23 -- # for i in {0..2} 00:04:56.156 03:16:20 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:56.156 spdk_app_start Round 0 00:04:56.156 03:16:20 -- event/event.sh@25 -- # waitforlisten 1338278 /var/tmp/spdk-nbd.sock 00:04:56.156 03:16:20 -- common/autotest_common.sh@817 -- # '[' -z 1338278 ']' 00:04:56.156 03:16:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:56.156 03:16:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:56.156 03:16:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:56.156 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:56.156 03:16:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:56.157 03:16:20 -- common/autotest_common.sh@10 -- # set +x 00:04:56.157 [2024-04-27 03:16:20.934047] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:04:56.157 [2024-04-27 03:16:20.934111] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1338278 ] 00:04:56.157 EAL: No free 2048 kB hugepages reported on node 1 00:04:56.157 [2024-04-27 03:16:20.997385] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:56.157 [2024-04-27 03:16:21.108648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:56.157 [2024-04-27 03:16:21.108653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.415 03:16:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:56.415 03:16:21 -- common/autotest_common.sh@850 -- # return 0 00:04:56.415 03:16:21 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:56.673 Malloc0 00:04:56.673 03:16:21 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:56.931 Malloc1 00:04:56.931 03:16:21 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@12 -- # local i 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:56.931 03:16:21 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:57.209 /dev/nbd0 00:04:57.209 03:16:22 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:57.209 03:16:22 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:57.209 03:16:22 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:04:57.209 03:16:22 -- common/autotest_common.sh@855 -- # local i 00:04:57.209 03:16:22 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:04:57.209 03:16:22 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:04:57.209 03:16:22 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:04:57.209 03:16:22 -- common/autotest_common.sh@859 -- # break 00:04:57.209 03:16:22 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:04:57.209 03:16:22 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:04:57.209 03:16:22 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:57.209 1+0 records in 00:04:57.209 1+0 records out 00:04:57.209 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000185203 s, 22.1 MB/s 00:04:57.209 03:16:22 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.209 03:16:22 -- common/autotest_common.sh@872 -- # size=4096 00:04:57.209 03:16:22 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.209 03:16:22 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:04:57.209 03:16:22 -- common/autotest_common.sh@875 -- # return 0 00:04:57.209 03:16:22 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:57.209 03:16:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:57.209 03:16:22 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:57.467 /dev/nbd1 00:04:57.467 03:16:22 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:57.467 03:16:22 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:57.467 03:16:22 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:04:57.467 03:16:22 -- common/autotest_common.sh@855 -- # local i 00:04:57.467 03:16:22 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:04:57.467 03:16:22 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:04:57.467 03:16:22 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:04:57.467 03:16:22 -- common/autotest_common.sh@859 -- # break 00:04:57.467 03:16:22 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:04:57.467 03:16:22 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:04:57.467 03:16:22 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:57.467 1+0 records in 00:04:57.467 1+0 records out 00:04:57.467 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000207062 s, 19.8 MB/s 00:04:57.467 03:16:22 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.467 03:16:22 -- common/autotest_common.sh@872 -- # size=4096 00:04:57.467 03:16:22 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.467 03:16:22 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:04:57.467 03:16:22 -- common/autotest_common.sh@875 -- # return 0 00:04:57.467 03:16:22 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:57.467 03:16:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:57.467 03:16:22 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:57.467 03:16:22 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.467 03:16:22 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:57.725 03:16:22 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:57.725 { 00:04:57.725 "nbd_device": "/dev/nbd0", 00:04:57.725 "bdev_name": "Malloc0" 00:04:57.725 }, 00:04:57.725 { 00:04:57.725 "nbd_device": "/dev/nbd1", 00:04:57.725 "bdev_name": "Malloc1" 00:04:57.725 } 00:04:57.725 ]' 00:04:57.725 03:16:22 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:57.725 { 00:04:57.725 "nbd_device": "/dev/nbd0", 00:04:57.725 "bdev_name": "Malloc0" 00:04:57.725 }, 00:04:57.725 { 00:04:57.725 "nbd_device": "/dev/nbd1", 00:04:57.725 "bdev_name": "Malloc1" 00:04:57.725 } 00:04:57.725 ]' 00:04:57.725 03:16:22 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:57.725 03:16:22 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:57.725 /dev/nbd1' 00:04:57.725 03:16:22 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:57.725 /dev/nbd1' 00:04:57.725 03:16:22 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:57.725 03:16:22 -- bdev/nbd_common.sh@65 -- # count=2 00:04:57.725 03:16:22 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:57.725 03:16:22 -- bdev/nbd_common.sh@95 -- # count=2 00:04:57.725 03:16:22 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:57.726 256+0 records in 00:04:57.726 256+0 records out 00:04:57.726 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00504006 s, 208 MB/s 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:57.726 256+0 records in 00:04:57.726 256+0 records out 00:04:57.726 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229853 s, 45.6 MB/s 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:57.726 256+0 records in 00:04:57.726 256+0 records out 00:04:57.726 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245632 s, 42.7 MB/s 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@51 -- # local i 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:57.726 03:16:22 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:57.983 03:16:22 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:57.983 03:16:22 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:57.983 03:16:22 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:57.983 03:16:22 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:57.983 03:16:22 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:57.983 03:16:22 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:57.983 03:16:22 -- bdev/nbd_common.sh@41 -- # break 00:04:57.983 03:16:22 -- bdev/nbd_common.sh@45 -- # return 0 00:04:57.983 03:16:22 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:57.983 03:16:22 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@41 -- # break 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@45 -- # return 0 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:58.240 03:16:23 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:58.498 03:16:23 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:58.498 03:16:23 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:58.498 03:16:23 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:58.758 03:16:23 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:58.758 03:16:23 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:58.758 03:16:23 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:58.758 03:16:23 -- bdev/nbd_common.sh@65 -- # true 00:04:58.758 03:16:23 -- bdev/nbd_common.sh@65 -- # count=0 00:04:58.758 03:16:23 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:58.758 03:16:23 -- bdev/nbd_common.sh@104 -- # count=0 00:04:58.758 03:16:23 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:58.758 03:16:23 -- bdev/nbd_common.sh@109 -- # return 0 00:04:58.758 03:16:23 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:59.017 03:16:23 -- event/event.sh@35 -- # sleep 3 00:04:59.275 [2024-04-27 03:16:24.011001] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:59.275 [2024-04-27 03:16:24.119079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.275 [2024-04-27 03:16:24.119081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:59.275 [2024-04-27 03:16:24.180151] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:59.275 [2024-04-27 03:16:24.180238] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:01.802 03:16:26 -- event/event.sh@23 -- # for i in {0..2} 00:05:01.802 03:16:26 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:01.802 spdk_app_start Round 1 00:05:01.802 03:16:26 -- event/event.sh@25 -- # waitforlisten 1338278 /var/tmp/spdk-nbd.sock 00:05:01.802 03:16:26 -- common/autotest_common.sh@817 -- # '[' -z 1338278 ']' 00:05:01.802 03:16:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:01.802 03:16:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:01.802 03:16:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:01.802 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:01.802 03:16:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:01.802 03:16:26 -- common/autotest_common.sh@10 -- # set +x 00:05:02.060 03:16:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:02.060 03:16:26 -- common/autotest_common.sh@850 -- # return 0 00:05:02.060 03:16:26 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:02.318 Malloc0 00:05:02.318 03:16:27 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:02.576 Malloc1 00:05:02.576 03:16:27 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@12 -- # local i 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.576 03:16:27 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:02.834 /dev/nbd0 00:05:02.834 03:16:27 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:02.834 03:16:27 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:02.834 03:16:27 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:05:02.834 03:16:27 -- common/autotest_common.sh@855 -- # local i 00:05:02.834 03:16:27 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:02.834 03:16:27 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:02.834 03:16:27 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:05:02.834 03:16:27 -- common/autotest_common.sh@859 -- # break 00:05:02.834 03:16:27 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:02.834 03:16:27 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:02.834 03:16:27 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:02.834 1+0 records in 00:05:02.834 1+0 records out 00:05:02.834 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00019677 s, 20.8 MB/s 00:05:02.834 03:16:27 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.834 03:16:27 -- common/autotest_common.sh@872 -- # size=4096 00:05:02.834 03:16:27 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.834 03:16:27 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:02.834 03:16:27 -- common/autotest_common.sh@875 -- # return 0 00:05:02.834 03:16:27 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:02.834 03:16:27 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.834 03:16:27 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:03.092 /dev/nbd1 00:05:03.092 03:16:27 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:03.092 03:16:27 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:03.092 03:16:27 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:05:03.092 03:16:27 -- common/autotest_common.sh@855 -- # local i 00:05:03.092 03:16:27 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:03.092 03:16:27 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:03.092 03:16:27 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:05:03.092 03:16:27 -- common/autotest_common.sh@859 -- # break 00:05:03.092 03:16:27 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:03.092 03:16:27 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:03.092 03:16:27 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:03.092 1+0 records in 00:05:03.092 1+0 records out 00:05:03.092 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000166563 s, 24.6 MB/s 00:05:03.092 03:16:28 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:03.092 03:16:28 -- common/autotest_common.sh@872 -- # size=4096 00:05:03.092 03:16:28 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:03.092 03:16:28 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:03.092 03:16:28 -- common/autotest_common.sh@875 -- # return 0 00:05:03.092 03:16:28 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:03.092 03:16:28 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:03.092 03:16:28 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:03.092 03:16:28 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.092 03:16:28 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:03.350 03:16:28 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:03.350 { 00:05:03.350 "nbd_device": "/dev/nbd0", 00:05:03.350 "bdev_name": "Malloc0" 00:05:03.350 }, 00:05:03.350 { 00:05:03.350 "nbd_device": "/dev/nbd1", 00:05:03.350 "bdev_name": "Malloc1" 00:05:03.350 } 00:05:03.350 ]' 00:05:03.350 03:16:28 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:03.350 { 00:05:03.350 "nbd_device": "/dev/nbd0", 00:05:03.350 "bdev_name": "Malloc0" 00:05:03.350 }, 00:05:03.350 { 00:05:03.350 "nbd_device": "/dev/nbd1", 00:05:03.350 "bdev_name": "Malloc1" 00:05:03.350 } 00:05:03.350 ]' 00:05:03.350 03:16:28 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:03.350 03:16:28 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:03.350 /dev/nbd1' 00:05:03.350 03:16:28 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:03.350 /dev/nbd1' 00:05:03.350 03:16:28 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:03.350 03:16:28 -- bdev/nbd_common.sh@65 -- # count=2 00:05:03.350 03:16:28 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@95 -- # count=2 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:03.351 256+0 records in 00:05:03.351 256+0 records out 00:05:03.351 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00376411 s, 279 MB/s 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:03.351 03:16:28 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:03.609 256+0 records in 00:05:03.609 256+0 records out 00:05:03.609 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242122 s, 43.3 MB/s 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:03.609 256+0 records in 00:05:03.609 256+0 records out 00:05:03.609 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225031 s, 46.6 MB/s 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@51 -- # local i 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:03.609 03:16:28 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:03.867 03:16:28 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:03.867 03:16:28 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:03.867 03:16:28 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:03.867 03:16:28 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:03.867 03:16:28 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:03.867 03:16:28 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:03.867 03:16:28 -- bdev/nbd_common.sh@41 -- # break 00:05:03.867 03:16:28 -- bdev/nbd_common.sh@45 -- # return 0 00:05:03.867 03:16:28 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:03.867 03:16:28 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@41 -- # break 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@45 -- # return 0 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:04.125 03:16:28 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@65 -- # true 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@65 -- # count=0 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@104 -- # count=0 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:04.383 03:16:29 -- bdev/nbd_common.sh@109 -- # return 0 00:05:04.383 03:16:29 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:04.641 03:16:29 -- event/event.sh@35 -- # sleep 3 00:05:04.899 [2024-04-27 03:16:29.721547] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:04.899 [2024-04-27 03:16:29.832566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:04.899 [2024-04-27 03:16:29.832571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:05.210 [2024-04-27 03:16:29.895638] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:05.210 [2024-04-27 03:16:29.895727] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:07.745 03:16:32 -- event/event.sh@23 -- # for i in {0..2} 00:05:07.745 03:16:32 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:07.745 spdk_app_start Round 2 00:05:07.745 03:16:32 -- event/event.sh@25 -- # waitforlisten 1338278 /var/tmp/spdk-nbd.sock 00:05:07.745 03:16:32 -- common/autotest_common.sh@817 -- # '[' -z 1338278 ']' 00:05:07.745 03:16:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:07.745 03:16:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:07.745 03:16:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:07.745 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:07.745 03:16:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:07.745 03:16:32 -- common/autotest_common.sh@10 -- # set +x 00:05:07.745 03:16:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:07.745 03:16:32 -- common/autotest_common.sh@850 -- # return 0 00:05:07.745 03:16:32 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:08.003 Malloc0 00:05:08.003 03:16:32 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:08.261 Malloc1 00:05:08.261 03:16:33 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@12 -- # local i 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:08.261 03:16:33 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:08.518 /dev/nbd0 00:05:08.518 03:16:33 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:08.518 03:16:33 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:08.518 03:16:33 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:05:08.518 03:16:33 -- common/autotest_common.sh@855 -- # local i 00:05:08.518 03:16:33 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:08.518 03:16:33 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:08.518 03:16:33 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:05:08.518 03:16:33 -- common/autotest_common.sh@859 -- # break 00:05:08.518 03:16:33 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:08.518 03:16:33 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:08.518 03:16:33 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:08.776 1+0 records in 00:05:08.776 1+0 records out 00:05:08.776 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000194529 s, 21.1 MB/s 00:05:08.776 03:16:33 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:08.776 03:16:33 -- common/autotest_common.sh@872 -- # size=4096 00:05:08.776 03:16:33 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:08.776 03:16:33 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:08.776 03:16:33 -- common/autotest_common.sh@875 -- # return 0 00:05:08.776 03:16:33 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:08.776 03:16:33 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:08.776 03:16:33 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:08.776 /dev/nbd1 00:05:09.033 03:16:33 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:09.034 03:16:33 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:09.034 03:16:33 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:05:09.034 03:16:33 -- common/autotest_common.sh@855 -- # local i 00:05:09.034 03:16:33 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:09.034 03:16:33 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:09.034 03:16:33 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:05:09.034 03:16:33 -- common/autotest_common.sh@859 -- # break 00:05:09.034 03:16:33 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:09.034 03:16:33 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:09.034 03:16:33 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:09.034 1+0 records in 00:05:09.034 1+0 records out 00:05:09.034 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000223998 s, 18.3 MB/s 00:05:09.034 03:16:33 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:09.034 03:16:33 -- common/autotest_common.sh@872 -- # size=4096 00:05:09.034 03:16:33 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:09.034 03:16:33 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:09.034 03:16:33 -- common/autotest_common.sh@875 -- # return 0 00:05:09.034 03:16:33 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:09.034 03:16:33 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:09.034 03:16:33 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:09.034 03:16:33 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:09.034 03:16:33 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:09.292 { 00:05:09.292 "nbd_device": "/dev/nbd0", 00:05:09.292 "bdev_name": "Malloc0" 00:05:09.292 }, 00:05:09.292 { 00:05:09.292 "nbd_device": "/dev/nbd1", 00:05:09.292 "bdev_name": "Malloc1" 00:05:09.292 } 00:05:09.292 ]' 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:09.292 { 00:05:09.292 "nbd_device": "/dev/nbd0", 00:05:09.292 "bdev_name": "Malloc0" 00:05:09.292 }, 00:05:09.292 { 00:05:09.292 "nbd_device": "/dev/nbd1", 00:05:09.292 "bdev_name": "Malloc1" 00:05:09.292 } 00:05:09.292 ]' 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:09.292 /dev/nbd1' 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:09.292 /dev/nbd1' 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@65 -- # count=2 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@95 -- # count=2 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:09.292 256+0 records in 00:05:09.292 256+0 records out 00:05:09.292 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00464654 s, 226 MB/s 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:09.292 256+0 records in 00:05:09.292 256+0 records out 00:05:09.292 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237442 s, 44.2 MB/s 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:09.292 256+0 records in 00:05:09.292 256+0 records out 00:05:09.292 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232007 s, 45.2 MB/s 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@51 -- # local i 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:09.292 03:16:34 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:09.550 03:16:34 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:09.550 03:16:34 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:09.550 03:16:34 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:09.550 03:16:34 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:09.550 03:16:34 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:09.550 03:16:34 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:09.550 03:16:34 -- bdev/nbd_common.sh@41 -- # break 00:05:09.550 03:16:34 -- bdev/nbd_common.sh@45 -- # return 0 00:05:09.550 03:16:34 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:09.550 03:16:34 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@41 -- # break 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@45 -- # return 0 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:09.808 03:16:34 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@65 -- # true 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@65 -- # count=0 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@104 -- # count=0 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:10.066 03:16:34 -- bdev/nbd_common.sh@109 -- # return 0 00:05:10.066 03:16:34 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:10.324 03:16:35 -- event/event.sh@35 -- # sleep 3 00:05:10.582 [2024-04-27 03:16:35.489586] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:10.841 [2024-04-27 03:16:35.600602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.841 [2024-04-27 03:16:35.600606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:10.841 [2024-04-27 03:16:35.663207] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:10.841 [2024-04-27 03:16:35.663327] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:13.367 03:16:38 -- event/event.sh@38 -- # waitforlisten 1338278 /var/tmp/spdk-nbd.sock 00:05:13.367 03:16:38 -- common/autotest_common.sh@817 -- # '[' -z 1338278 ']' 00:05:13.367 03:16:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:13.367 03:16:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:13.367 03:16:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:13.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:13.367 03:16:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:13.367 03:16:38 -- common/autotest_common.sh@10 -- # set +x 00:05:13.625 03:16:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:13.625 03:16:38 -- common/autotest_common.sh@850 -- # return 0 00:05:13.625 03:16:38 -- event/event.sh@39 -- # killprocess 1338278 00:05:13.625 03:16:38 -- common/autotest_common.sh@936 -- # '[' -z 1338278 ']' 00:05:13.625 03:16:38 -- common/autotest_common.sh@940 -- # kill -0 1338278 00:05:13.625 03:16:38 -- common/autotest_common.sh@941 -- # uname 00:05:13.625 03:16:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:13.625 03:16:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1338278 00:05:13.625 03:16:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:13.625 03:16:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:13.625 03:16:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1338278' 00:05:13.625 killing process with pid 1338278 00:05:13.625 03:16:38 -- common/autotest_common.sh@955 -- # kill 1338278 00:05:13.625 03:16:38 -- common/autotest_common.sh@960 -- # wait 1338278 00:05:13.883 spdk_app_start is called in Round 0. 00:05:13.883 Shutdown signal received, stop current app iteration 00:05:13.883 Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 reinitialization... 00:05:13.883 spdk_app_start is called in Round 1. 00:05:13.883 Shutdown signal received, stop current app iteration 00:05:13.883 Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 reinitialization... 00:05:13.883 spdk_app_start is called in Round 2. 00:05:13.883 Shutdown signal received, stop current app iteration 00:05:13.883 Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 reinitialization... 00:05:13.883 spdk_app_start is called in Round 3. 00:05:13.883 Shutdown signal received, stop current app iteration 00:05:13.883 03:16:38 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:13.883 03:16:38 -- event/event.sh@42 -- # return 0 00:05:13.883 00:05:13.883 real 0m17.813s 00:05:13.883 user 0m38.452s 00:05:13.883 sys 0m3.157s 00:05:13.883 03:16:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:13.883 03:16:38 -- common/autotest_common.sh@10 -- # set +x 00:05:13.883 ************************************ 00:05:13.883 END TEST app_repeat 00:05:13.883 ************************************ 00:05:13.883 03:16:38 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:13.883 03:16:38 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:13.883 03:16:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.883 03:16:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.883 03:16:38 -- common/autotest_common.sh@10 -- # set +x 00:05:13.883 ************************************ 00:05:13.883 START TEST cpu_locks 00:05:13.883 ************************************ 00:05:13.883 03:16:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:14.142 * Looking for test storage... 00:05:14.142 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:14.142 03:16:38 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:14.142 03:16:38 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:14.142 03:16:38 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:14.142 03:16:38 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:14.142 03:16:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.142 03:16:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.142 03:16:38 -- common/autotest_common.sh@10 -- # set +x 00:05:14.142 ************************************ 00:05:14.142 START TEST default_locks 00:05:14.142 ************************************ 00:05:14.142 03:16:38 -- common/autotest_common.sh@1111 -- # default_locks 00:05:14.142 03:16:39 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1340647 00:05:14.142 03:16:39 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:14.142 03:16:39 -- event/cpu_locks.sh@47 -- # waitforlisten 1340647 00:05:14.142 03:16:39 -- common/autotest_common.sh@817 -- # '[' -z 1340647 ']' 00:05:14.142 03:16:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.142 03:16:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:14.142 03:16:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.142 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.142 03:16:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:14.142 03:16:39 -- common/autotest_common.sh@10 -- # set +x 00:05:14.142 [2024-04-27 03:16:39.050929] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:14.142 [2024-04-27 03:16:39.051005] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1340647 ] 00:05:14.142 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.142 [2024-04-27 03:16:39.107260] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.400 [2024-04-27 03:16:39.219283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.332 03:16:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:15.332 03:16:39 -- common/autotest_common.sh@850 -- # return 0 00:05:15.332 03:16:39 -- event/cpu_locks.sh@49 -- # locks_exist 1340647 00:05:15.332 03:16:39 -- event/cpu_locks.sh@22 -- # lslocks -p 1340647 00:05:15.332 03:16:39 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:15.332 lslocks: write error 00:05:15.332 03:16:40 -- event/cpu_locks.sh@50 -- # killprocess 1340647 00:05:15.332 03:16:40 -- common/autotest_common.sh@936 -- # '[' -z 1340647 ']' 00:05:15.332 03:16:40 -- common/autotest_common.sh@940 -- # kill -0 1340647 00:05:15.332 03:16:40 -- common/autotest_common.sh@941 -- # uname 00:05:15.332 03:16:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:15.332 03:16:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1340647 00:05:15.332 03:16:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:15.332 03:16:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:15.332 03:16:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1340647' 00:05:15.332 killing process with pid 1340647 00:05:15.332 03:16:40 -- common/autotest_common.sh@955 -- # kill 1340647 00:05:15.332 03:16:40 -- common/autotest_common.sh@960 -- # wait 1340647 00:05:15.897 03:16:40 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1340647 00:05:15.897 03:16:40 -- common/autotest_common.sh@638 -- # local es=0 00:05:15.897 03:16:40 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 1340647 00:05:15.897 03:16:40 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:05:15.897 03:16:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:15.897 03:16:40 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:05:15.897 03:16:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:15.897 03:16:40 -- common/autotest_common.sh@641 -- # waitforlisten 1340647 00:05:15.897 03:16:40 -- common/autotest_common.sh@817 -- # '[' -z 1340647 ']' 00:05:15.897 03:16:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:15.897 03:16:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:15.897 03:16:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:15.897 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:15.897 03:16:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:15.897 03:16:40 -- common/autotest_common.sh@10 -- # set +x 00:05:15.897 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (1340647) - No such process 00:05:15.897 ERROR: process (pid: 1340647) is no longer running 00:05:15.897 03:16:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:15.897 03:16:40 -- common/autotest_common.sh@850 -- # return 1 00:05:15.897 03:16:40 -- common/autotest_common.sh@641 -- # es=1 00:05:15.897 03:16:40 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:15.897 03:16:40 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:15.897 03:16:40 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:15.897 03:16:40 -- event/cpu_locks.sh@54 -- # no_locks 00:05:15.897 03:16:40 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:15.897 03:16:40 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:15.897 03:16:40 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:15.897 00:05:15.897 real 0m1.749s 00:05:15.897 user 0m1.873s 00:05:15.897 sys 0m0.553s 00:05:15.897 03:16:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:15.897 03:16:40 -- common/autotest_common.sh@10 -- # set +x 00:05:15.897 ************************************ 00:05:15.897 END TEST default_locks 00:05:15.897 ************************************ 00:05:15.897 03:16:40 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:15.897 03:16:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:15.897 03:16:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:15.897 03:16:40 -- common/autotest_common.sh@10 -- # set +x 00:05:15.897 ************************************ 00:05:15.897 START TEST default_locks_via_rpc 00:05:15.897 ************************************ 00:05:15.897 03:16:40 -- common/autotest_common.sh@1111 -- # default_locks_via_rpc 00:05:16.155 03:16:40 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1340922 00:05:16.155 03:16:40 -- event/cpu_locks.sh@63 -- # waitforlisten 1340922 00:05:16.155 03:16:40 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:16.155 03:16:40 -- common/autotest_common.sh@817 -- # '[' -z 1340922 ']' 00:05:16.155 03:16:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:16.155 03:16:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:16.155 03:16:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:16.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:16.155 03:16:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:16.155 03:16:40 -- common/autotest_common.sh@10 -- # set +x 00:05:16.155 [2024-04-27 03:16:40.922663] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:16.155 [2024-04-27 03:16:40.922750] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1340922 ] 00:05:16.155 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.155 [2024-04-27 03:16:40.982647] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.155 [2024-04-27 03:16:41.092581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.413 03:16:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:16.413 03:16:41 -- common/autotest_common.sh@850 -- # return 0 00:05:16.413 03:16:41 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:16.413 03:16:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:16.413 03:16:41 -- common/autotest_common.sh@10 -- # set +x 00:05:16.413 03:16:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:16.413 03:16:41 -- event/cpu_locks.sh@67 -- # no_locks 00:05:16.413 03:16:41 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:16.413 03:16:41 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:16.413 03:16:41 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:16.413 03:16:41 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:16.413 03:16:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:16.413 03:16:41 -- common/autotest_common.sh@10 -- # set +x 00:05:16.413 03:16:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:16.413 03:16:41 -- event/cpu_locks.sh@71 -- # locks_exist 1340922 00:05:16.413 03:16:41 -- event/cpu_locks.sh@22 -- # lslocks -p 1340922 00:05:16.413 03:16:41 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:16.978 03:16:41 -- event/cpu_locks.sh@73 -- # killprocess 1340922 00:05:16.978 03:16:41 -- common/autotest_common.sh@936 -- # '[' -z 1340922 ']' 00:05:16.978 03:16:41 -- common/autotest_common.sh@940 -- # kill -0 1340922 00:05:16.978 03:16:41 -- common/autotest_common.sh@941 -- # uname 00:05:16.978 03:16:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.978 03:16:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1340922 00:05:16.978 03:16:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:16.978 03:16:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:16.978 03:16:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1340922' 00:05:16.978 killing process with pid 1340922 00:05:16.978 03:16:41 -- common/autotest_common.sh@955 -- # kill 1340922 00:05:16.978 03:16:41 -- common/autotest_common.sh@960 -- # wait 1340922 00:05:17.236 00:05:17.236 real 0m1.271s 00:05:17.236 user 0m1.202s 00:05:17.236 sys 0m0.542s 00:05:17.236 03:16:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:17.236 03:16:42 -- common/autotest_common.sh@10 -- # set +x 00:05:17.236 ************************************ 00:05:17.236 END TEST default_locks_via_rpc 00:05:17.236 ************************************ 00:05:17.236 03:16:42 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:17.236 03:16:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:17.236 03:16:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:17.236 03:16:42 -- common/autotest_common.sh@10 -- # set +x 00:05:17.494 ************************************ 00:05:17.494 START TEST non_locking_app_on_locked_coremask 00:05:17.494 ************************************ 00:05:17.494 03:16:42 -- common/autotest_common.sh@1111 -- # non_locking_app_on_locked_coremask 00:05:17.494 03:16:42 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1341123 00:05:17.494 03:16:42 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:17.494 03:16:42 -- event/cpu_locks.sh@81 -- # waitforlisten 1341123 /var/tmp/spdk.sock 00:05:17.494 03:16:42 -- common/autotest_common.sh@817 -- # '[' -z 1341123 ']' 00:05:17.494 03:16:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:17.494 03:16:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:17.494 03:16:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:17.494 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:17.494 03:16:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:17.494 03:16:42 -- common/autotest_common.sh@10 -- # set +x 00:05:17.494 [2024-04-27 03:16:42.306933] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:17.494 [2024-04-27 03:16:42.307040] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1341123 ] 00:05:17.494 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.494 [2024-04-27 03:16:42.363925] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.494 [2024-04-27 03:16:42.468778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.061 03:16:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:18.061 03:16:42 -- common/autotest_common.sh@850 -- # return 0 00:05:18.061 03:16:42 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1341126 00:05:18.061 03:16:42 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:18.061 03:16:42 -- event/cpu_locks.sh@85 -- # waitforlisten 1341126 /var/tmp/spdk2.sock 00:05:18.061 03:16:42 -- common/autotest_common.sh@817 -- # '[' -z 1341126 ']' 00:05:18.061 03:16:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:18.061 03:16:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:18.061 03:16:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:18.061 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:18.061 03:16:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:18.061 03:16:42 -- common/autotest_common.sh@10 -- # set +x 00:05:18.061 [2024-04-27 03:16:42.782574] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:18.062 [2024-04-27 03:16:42.782656] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1341126 ] 00:05:18.062 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.062 [2024-04-27 03:16:42.864914] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:18.062 [2024-04-27 03:16:42.864956] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.319 [2024-04-27 03:16:43.092236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.884 03:16:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:18.884 03:16:43 -- common/autotest_common.sh@850 -- # return 0 00:05:18.884 03:16:43 -- event/cpu_locks.sh@87 -- # locks_exist 1341123 00:05:18.884 03:16:43 -- event/cpu_locks.sh@22 -- # lslocks -p 1341123 00:05:18.884 03:16:43 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:19.449 lslocks: write error 00:05:19.449 03:16:44 -- event/cpu_locks.sh@89 -- # killprocess 1341123 00:05:19.449 03:16:44 -- common/autotest_common.sh@936 -- # '[' -z 1341123 ']' 00:05:19.449 03:16:44 -- common/autotest_common.sh@940 -- # kill -0 1341123 00:05:19.449 03:16:44 -- common/autotest_common.sh@941 -- # uname 00:05:19.449 03:16:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:19.449 03:16:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1341123 00:05:19.449 03:16:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:19.449 03:16:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:19.449 03:16:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1341123' 00:05:19.449 killing process with pid 1341123 00:05:19.449 03:16:44 -- common/autotest_common.sh@955 -- # kill 1341123 00:05:19.449 03:16:44 -- common/autotest_common.sh@960 -- # wait 1341123 00:05:20.381 03:16:45 -- event/cpu_locks.sh@90 -- # killprocess 1341126 00:05:20.381 03:16:45 -- common/autotest_common.sh@936 -- # '[' -z 1341126 ']' 00:05:20.381 03:16:45 -- common/autotest_common.sh@940 -- # kill -0 1341126 00:05:20.381 03:16:45 -- common/autotest_common.sh@941 -- # uname 00:05:20.381 03:16:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:20.381 03:16:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1341126 00:05:20.381 03:16:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:20.381 03:16:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:20.381 03:16:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1341126' 00:05:20.381 killing process with pid 1341126 00:05:20.381 03:16:45 -- common/autotest_common.sh@955 -- # kill 1341126 00:05:20.381 03:16:45 -- common/autotest_common.sh@960 -- # wait 1341126 00:05:20.947 00:05:20.947 real 0m3.418s 00:05:20.947 user 0m3.556s 00:05:20.947 sys 0m1.056s 00:05:20.947 03:16:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:20.947 03:16:45 -- common/autotest_common.sh@10 -- # set +x 00:05:20.947 ************************************ 00:05:20.947 END TEST non_locking_app_on_locked_coremask 00:05:20.947 ************************************ 00:05:20.947 03:16:45 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:20.947 03:16:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:20.947 03:16:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.947 03:16:45 -- common/autotest_common.sh@10 -- # set +x 00:05:20.947 ************************************ 00:05:20.947 START TEST locking_app_on_unlocked_coremask 00:05:20.947 ************************************ 00:05:20.947 03:16:45 -- common/autotest_common.sh@1111 -- # locking_app_on_unlocked_coremask 00:05:20.947 03:16:45 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1341563 00:05:20.947 03:16:45 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:20.947 03:16:45 -- event/cpu_locks.sh@99 -- # waitforlisten 1341563 /var/tmp/spdk.sock 00:05:20.947 03:16:45 -- common/autotest_common.sh@817 -- # '[' -z 1341563 ']' 00:05:20.947 03:16:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:20.947 03:16:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:20.947 03:16:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:20.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:20.947 03:16:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:20.947 03:16:45 -- common/autotest_common.sh@10 -- # set +x 00:05:20.947 [2024-04-27 03:16:45.860885] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:20.947 [2024-04-27 03:16:45.860969] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1341563 ] 00:05:20.947 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.947 [2024-04-27 03:16:45.921698] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:20.947 [2024-04-27 03:16:45.921736] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.204 [2024-04-27 03:16:46.032975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.137 03:16:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:22.137 03:16:46 -- common/autotest_common.sh@850 -- # return 0 00:05:22.137 03:16:46 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1341701 00:05:22.137 03:16:46 -- event/cpu_locks.sh@103 -- # waitforlisten 1341701 /var/tmp/spdk2.sock 00:05:22.137 03:16:46 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:22.137 03:16:46 -- common/autotest_common.sh@817 -- # '[' -z 1341701 ']' 00:05:22.137 03:16:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:22.137 03:16:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:22.137 03:16:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:22.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:22.137 03:16:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:22.137 03:16:46 -- common/autotest_common.sh@10 -- # set +x 00:05:22.137 [2024-04-27 03:16:46.827146] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:22.137 [2024-04-27 03:16:46.827228] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1341701 ] 00:05:22.137 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.137 [2024-04-27 03:16:46.922732] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.394 [2024-04-27 03:16:47.148342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.005 03:16:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:23.005 03:16:47 -- common/autotest_common.sh@850 -- # return 0 00:05:23.005 03:16:47 -- event/cpu_locks.sh@105 -- # locks_exist 1341701 00:05:23.005 03:16:47 -- event/cpu_locks.sh@22 -- # lslocks -p 1341701 00:05:23.005 03:16:47 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:23.264 lslocks: write error 00:05:23.264 03:16:48 -- event/cpu_locks.sh@107 -- # killprocess 1341563 00:05:23.264 03:16:48 -- common/autotest_common.sh@936 -- # '[' -z 1341563 ']' 00:05:23.264 03:16:48 -- common/autotest_common.sh@940 -- # kill -0 1341563 00:05:23.264 03:16:48 -- common/autotest_common.sh@941 -- # uname 00:05:23.264 03:16:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:23.264 03:16:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1341563 00:05:23.264 03:16:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:23.264 03:16:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:23.264 03:16:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1341563' 00:05:23.264 killing process with pid 1341563 00:05:23.264 03:16:48 -- common/autotest_common.sh@955 -- # kill 1341563 00:05:23.264 03:16:48 -- common/autotest_common.sh@960 -- # wait 1341563 00:05:24.197 03:16:49 -- event/cpu_locks.sh@108 -- # killprocess 1341701 00:05:24.197 03:16:49 -- common/autotest_common.sh@936 -- # '[' -z 1341701 ']' 00:05:24.197 03:16:49 -- common/autotest_common.sh@940 -- # kill -0 1341701 00:05:24.197 03:16:49 -- common/autotest_common.sh@941 -- # uname 00:05:24.197 03:16:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.197 03:16:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1341701 00:05:24.197 03:16:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.197 03:16:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.197 03:16:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1341701' 00:05:24.197 killing process with pid 1341701 00:05:24.197 03:16:49 -- common/autotest_common.sh@955 -- # kill 1341701 00:05:24.197 03:16:49 -- common/autotest_common.sh@960 -- # wait 1341701 00:05:24.763 00:05:24.763 real 0m3.775s 00:05:24.763 user 0m4.108s 00:05:24.763 sys 0m1.046s 00:05:24.763 03:16:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:24.763 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:24.763 ************************************ 00:05:24.763 END TEST locking_app_on_unlocked_coremask 00:05:24.763 ************************************ 00:05:24.763 03:16:49 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:24.763 03:16:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.763 03:16:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.763 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:24.763 ************************************ 00:05:24.763 START TEST locking_app_on_locked_coremask 00:05:24.763 ************************************ 00:05:24.763 03:16:49 -- common/autotest_common.sh@1111 -- # locking_app_on_locked_coremask 00:05:24.763 03:16:49 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1342015 00:05:24.763 03:16:49 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:24.763 03:16:49 -- event/cpu_locks.sh@116 -- # waitforlisten 1342015 /var/tmp/spdk.sock 00:05:24.763 03:16:49 -- common/autotest_common.sh@817 -- # '[' -z 1342015 ']' 00:05:24.763 03:16:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:24.763 03:16:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:24.763 03:16:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:24.763 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:24.763 03:16:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:24.763 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:25.021 [2024-04-27 03:16:49.768862] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:25.021 [2024-04-27 03:16:49.768943] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1342015 ] 00:05:25.021 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.021 [2024-04-27 03:16:49.831451] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.021 [2024-04-27 03:16:49.948796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.279 03:16:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:25.279 03:16:50 -- common/autotest_common.sh@850 -- # return 0 00:05:25.279 03:16:50 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1342143 00:05:25.279 03:16:50 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:25.279 03:16:50 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1342143 /var/tmp/spdk2.sock 00:05:25.279 03:16:50 -- common/autotest_common.sh@638 -- # local es=0 00:05:25.279 03:16:50 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 1342143 /var/tmp/spdk2.sock 00:05:25.279 03:16:50 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:05:25.279 03:16:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:25.279 03:16:50 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:05:25.279 03:16:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:25.279 03:16:50 -- common/autotest_common.sh@641 -- # waitforlisten 1342143 /var/tmp/spdk2.sock 00:05:25.279 03:16:50 -- common/autotest_common.sh@817 -- # '[' -z 1342143 ']' 00:05:25.279 03:16:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:25.279 03:16:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:25.279 03:16:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:25.279 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:25.279 03:16:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:25.279 03:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:25.537 [2024-04-27 03:16:50.269811] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:25.537 [2024-04-27 03:16:50.269885] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1342143 ] 00:05:25.537 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.537 [2024-04-27 03:16:50.367121] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1342015 has claimed it. 00:05:25.537 [2024-04-27 03:16:50.367174] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:26.102 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (1342143) - No such process 00:05:26.102 ERROR: process (pid: 1342143) is no longer running 00:05:26.102 03:16:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:26.102 03:16:50 -- common/autotest_common.sh@850 -- # return 1 00:05:26.103 03:16:50 -- common/autotest_common.sh@641 -- # es=1 00:05:26.103 03:16:50 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:26.103 03:16:50 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:26.103 03:16:50 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:26.103 03:16:50 -- event/cpu_locks.sh@122 -- # locks_exist 1342015 00:05:26.103 03:16:50 -- event/cpu_locks.sh@22 -- # lslocks -p 1342015 00:05:26.103 03:16:50 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:26.361 lslocks: write error 00:05:26.361 03:16:51 -- event/cpu_locks.sh@124 -- # killprocess 1342015 00:05:26.361 03:16:51 -- common/autotest_common.sh@936 -- # '[' -z 1342015 ']' 00:05:26.361 03:16:51 -- common/autotest_common.sh@940 -- # kill -0 1342015 00:05:26.361 03:16:51 -- common/autotest_common.sh@941 -- # uname 00:05:26.361 03:16:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:26.361 03:16:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1342015 00:05:26.361 03:16:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:26.361 03:16:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:26.361 03:16:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1342015' 00:05:26.361 killing process with pid 1342015 00:05:26.361 03:16:51 -- common/autotest_common.sh@955 -- # kill 1342015 00:05:26.361 03:16:51 -- common/autotest_common.sh@960 -- # wait 1342015 00:05:26.926 00:05:26.926 real 0m2.012s 00:05:26.926 user 0m2.178s 00:05:26.927 sys 0m0.612s 00:05:26.927 03:16:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:26.927 03:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.927 ************************************ 00:05:26.927 END TEST locking_app_on_locked_coremask 00:05:26.927 ************************************ 00:05:26.927 03:16:51 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:26.927 03:16:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.927 03:16:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.927 03:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.927 ************************************ 00:05:26.927 START TEST locking_overlapped_coremask 00:05:26.927 ************************************ 00:05:26.927 03:16:51 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask 00:05:26.927 03:16:51 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1342318 00:05:26.927 03:16:51 -- event/cpu_locks.sh@133 -- # waitforlisten 1342318 /var/tmp/spdk.sock 00:05:26.927 03:16:51 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:26.927 03:16:51 -- common/autotest_common.sh@817 -- # '[' -z 1342318 ']' 00:05:26.927 03:16:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.927 03:16:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:26.927 03:16:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.927 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.927 03:16:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:26.927 03:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.927 [2024-04-27 03:16:51.898772] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:26.927 [2024-04-27 03:16:51.898874] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1342318 ] 00:05:27.185 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.185 [2024-04-27 03:16:51.958275] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:27.185 [2024-04-27 03:16:52.065408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:27.185 [2024-04-27 03:16:52.065465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:27.185 [2024-04-27 03:16:52.065468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.470 03:16:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:27.470 03:16:52 -- common/autotest_common.sh@850 -- # return 0 00:05:27.470 03:16:52 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1342452 00:05:27.470 03:16:52 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1342452 /var/tmp/spdk2.sock 00:05:27.470 03:16:52 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:27.470 03:16:52 -- common/autotest_common.sh@638 -- # local es=0 00:05:27.470 03:16:52 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 1342452 /var/tmp/spdk2.sock 00:05:27.470 03:16:52 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:05:27.470 03:16:52 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:27.470 03:16:52 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:05:27.470 03:16:52 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:27.470 03:16:52 -- common/autotest_common.sh@641 -- # waitforlisten 1342452 /var/tmp/spdk2.sock 00:05:27.470 03:16:52 -- common/autotest_common.sh@817 -- # '[' -z 1342452 ']' 00:05:27.470 03:16:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:27.470 03:16:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:27.470 03:16:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:27.470 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:27.470 03:16:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:27.470 03:16:52 -- common/autotest_common.sh@10 -- # set +x 00:05:27.470 [2024-04-27 03:16:52.362648] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:27.470 [2024-04-27 03:16:52.362732] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1342452 ] 00:05:27.470 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.728 [2024-04-27 03:16:52.451823] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1342318 has claimed it. 00:05:27.728 [2024-04-27 03:16:52.451870] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:28.292 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (1342452) - No such process 00:05:28.292 ERROR: process (pid: 1342452) is no longer running 00:05:28.292 03:16:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:28.292 03:16:53 -- common/autotest_common.sh@850 -- # return 1 00:05:28.292 03:16:53 -- common/autotest_common.sh@641 -- # es=1 00:05:28.292 03:16:53 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:28.292 03:16:53 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:28.292 03:16:53 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:28.292 03:16:53 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:28.292 03:16:53 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:28.292 03:16:53 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:28.292 03:16:53 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:28.292 03:16:53 -- event/cpu_locks.sh@141 -- # killprocess 1342318 00:05:28.292 03:16:53 -- common/autotest_common.sh@936 -- # '[' -z 1342318 ']' 00:05:28.292 03:16:53 -- common/autotest_common.sh@940 -- # kill -0 1342318 00:05:28.292 03:16:53 -- common/autotest_common.sh@941 -- # uname 00:05:28.292 03:16:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:28.292 03:16:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1342318 00:05:28.292 03:16:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:28.292 03:16:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:28.292 03:16:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1342318' 00:05:28.292 killing process with pid 1342318 00:05:28.292 03:16:53 -- common/autotest_common.sh@955 -- # kill 1342318 00:05:28.292 03:16:53 -- common/autotest_common.sh@960 -- # wait 1342318 00:05:28.549 00:05:28.549 real 0m1.665s 00:05:28.549 user 0m4.409s 00:05:28.549 sys 0m0.435s 00:05:28.549 03:16:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:28.549 03:16:53 -- common/autotest_common.sh@10 -- # set +x 00:05:28.549 ************************************ 00:05:28.549 END TEST locking_overlapped_coremask 00:05:28.549 ************************************ 00:05:28.806 03:16:53 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:28.806 03:16:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.806 03:16:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.806 03:16:53 -- common/autotest_common.sh@10 -- # set +x 00:05:28.806 ************************************ 00:05:28.806 START TEST locking_overlapped_coremask_via_rpc 00:05:28.806 ************************************ 00:05:28.806 03:16:53 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask_via_rpc 00:05:28.806 03:16:53 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1342625 00:05:28.806 03:16:53 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:28.806 03:16:53 -- event/cpu_locks.sh@149 -- # waitforlisten 1342625 /var/tmp/spdk.sock 00:05:28.806 03:16:53 -- common/autotest_common.sh@817 -- # '[' -z 1342625 ']' 00:05:28.806 03:16:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:28.806 03:16:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:28.806 03:16:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:28.806 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:28.806 03:16:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:28.806 03:16:53 -- common/autotest_common.sh@10 -- # set +x 00:05:28.806 [2024-04-27 03:16:53.683764] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:28.806 [2024-04-27 03:16:53.683865] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1342625 ] 00:05:28.806 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.806 [2024-04-27 03:16:53.741004] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:28.806 [2024-04-27 03:16:53.741044] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:29.064 [2024-04-27 03:16:53.849074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:29.064 [2024-04-27 03:16:53.849140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:29.064 [2024-04-27 03:16:53.849143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.322 03:16:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:29.322 03:16:54 -- common/autotest_common.sh@850 -- # return 0 00:05:29.322 03:16:54 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1342630 00:05:29.322 03:16:54 -- event/cpu_locks.sh@153 -- # waitforlisten 1342630 /var/tmp/spdk2.sock 00:05:29.322 03:16:54 -- common/autotest_common.sh@817 -- # '[' -z 1342630 ']' 00:05:29.322 03:16:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:29.322 03:16:54 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:29.322 03:16:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:29.322 03:16:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:29.322 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:29.322 03:16:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:29.322 03:16:54 -- common/autotest_common.sh@10 -- # set +x 00:05:29.322 [2024-04-27 03:16:54.159207] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:29.322 [2024-04-27 03:16:54.159312] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1342630 ] 00:05:29.322 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.322 [2024-04-27 03:16:54.244389] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:29.322 [2024-04-27 03:16:54.244422] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:29.580 [2024-04-27 03:16:54.454257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:29.580 [2024-04-27 03:16:54.457303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:29.580 [2024-04-27 03:16:54.457306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:30.145 03:16:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:30.145 03:16:55 -- common/autotest_common.sh@850 -- # return 0 00:05:30.145 03:16:55 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:30.145 03:16:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:30.145 03:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:30.145 03:16:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:30.145 03:16:55 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:30.145 03:16:55 -- common/autotest_common.sh@638 -- # local es=0 00:05:30.145 03:16:55 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:30.145 03:16:55 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:05:30.145 03:16:55 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:30.145 03:16:55 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:05:30.145 03:16:55 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:30.145 03:16:55 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:30.145 03:16:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:30.145 03:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:30.145 [2024-04-27 03:16:55.101341] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1342625 has claimed it. 00:05:30.145 request: 00:05:30.145 { 00:05:30.145 "method": "framework_enable_cpumask_locks", 00:05:30.145 "req_id": 1 00:05:30.145 } 00:05:30.145 Got JSON-RPC error response 00:05:30.145 response: 00:05:30.145 { 00:05:30.145 "code": -32603, 00:05:30.145 "message": "Failed to claim CPU core: 2" 00:05:30.145 } 00:05:30.145 03:16:55 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:05:30.146 03:16:55 -- common/autotest_common.sh@641 -- # es=1 00:05:30.146 03:16:55 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:30.146 03:16:55 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:30.146 03:16:55 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:30.146 03:16:55 -- event/cpu_locks.sh@158 -- # waitforlisten 1342625 /var/tmp/spdk.sock 00:05:30.146 03:16:55 -- common/autotest_common.sh@817 -- # '[' -z 1342625 ']' 00:05:30.146 03:16:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:30.146 03:16:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:30.146 03:16:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:30.146 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:30.146 03:16:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:30.146 03:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:30.403 03:16:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:30.403 03:16:55 -- common/autotest_common.sh@850 -- # return 0 00:05:30.403 03:16:55 -- event/cpu_locks.sh@159 -- # waitforlisten 1342630 /var/tmp/spdk2.sock 00:05:30.403 03:16:55 -- common/autotest_common.sh@817 -- # '[' -z 1342630 ']' 00:05:30.403 03:16:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:30.403 03:16:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:30.403 03:16:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:30.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:30.403 03:16:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:30.403 03:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:30.661 03:16:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:30.661 03:16:55 -- common/autotest_common.sh@850 -- # return 0 00:05:30.661 03:16:55 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:30.661 03:16:55 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:30.661 03:16:55 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:30.661 03:16:55 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:30.661 00:05:30.661 real 0m1.967s 00:05:30.661 user 0m0.992s 00:05:30.661 sys 0m0.178s 00:05:30.661 03:16:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:30.661 03:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:30.661 ************************************ 00:05:30.661 END TEST locking_overlapped_coremask_via_rpc 00:05:30.661 ************************************ 00:05:30.661 03:16:55 -- event/cpu_locks.sh@174 -- # cleanup 00:05:30.661 03:16:55 -- event/cpu_locks.sh@15 -- # [[ -z 1342625 ]] 00:05:30.661 03:16:55 -- event/cpu_locks.sh@15 -- # killprocess 1342625 00:05:30.661 03:16:55 -- common/autotest_common.sh@936 -- # '[' -z 1342625 ']' 00:05:30.661 03:16:55 -- common/autotest_common.sh@940 -- # kill -0 1342625 00:05:30.661 03:16:55 -- common/autotest_common.sh@941 -- # uname 00:05:30.661 03:16:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:30.661 03:16:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1342625 00:05:30.919 03:16:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:30.919 03:16:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:30.919 03:16:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1342625' 00:05:30.919 killing process with pid 1342625 00:05:30.919 03:16:55 -- common/autotest_common.sh@955 -- # kill 1342625 00:05:30.919 03:16:55 -- common/autotest_common.sh@960 -- # wait 1342625 00:05:31.177 03:16:56 -- event/cpu_locks.sh@16 -- # [[ -z 1342630 ]] 00:05:31.177 03:16:56 -- event/cpu_locks.sh@16 -- # killprocess 1342630 00:05:31.177 03:16:56 -- common/autotest_common.sh@936 -- # '[' -z 1342630 ']' 00:05:31.177 03:16:56 -- common/autotest_common.sh@940 -- # kill -0 1342630 00:05:31.177 03:16:56 -- common/autotest_common.sh@941 -- # uname 00:05:31.177 03:16:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:31.177 03:16:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1342630 00:05:31.177 03:16:56 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:31.177 03:16:56 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:31.177 03:16:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1342630' 00:05:31.177 killing process with pid 1342630 00:05:31.177 03:16:56 -- common/autotest_common.sh@955 -- # kill 1342630 00:05:31.177 03:16:56 -- common/autotest_common.sh@960 -- # wait 1342630 00:05:31.744 03:16:56 -- event/cpu_locks.sh@18 -- # rm -f 00:05:31.744 03:16:56 -- event/cpu_locks.sh@1 -- # cleanup 00:05:31.744 03:16:56 -- event/cpu_locks.sh@15 -- # [[ -z 1342625 ]] 00:05:31.744 03:16:56 -- event/cpu_locks.sh@15 -- # killprocess 1342625 00:05:31.744 03:16:56 -- common/autotest_common.sh@936 -- # '[' -z 1342625 ']' 00:05:31.744 03:16:56 -- common/autotest_common.sh@940 -- # kill -0 1342625 00:05:31.744 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1342625) - No such process 00:05:31.744 03:16:56 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1342625 is not found' 00:05:31.744 Process with pid 1342625 is not found 00:05:31.744 03:16:56 -- event/cpu_locks.sh@16 -- # [[ -z 1342630 ]] 00:05:31.744 03:16:56 -- event/cpu_locks.sh@16 -- # killprocess 1342630 00:05:31.744 03:16:56 -- common/autotest_common.sh@936 -- # '[' -z 1342630 ']' 00:05:31.744 03:16:56 -- common/autotest_common.sh@940 -- # kill -0 1342630 00:05:31.744 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1342630) - No such process 00:05:31.744 03:16:56 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1342630 is not found' 00:05:31.744 Process with pid 1342630 is not found 00:05:31.744 03:16:56 -- event/cpu_locks.sh@18 -- # rm -f 00:05:31.744 00:05:31.744 real 0m17.731s 00:05:31.744 user 0m29.374s 00:05:31.744 sys 0m5.584s 00:05:31.744 03:16:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:31.744 03:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:31.744 ************************************ 00:05:31.744 END TEST cpu_locks 00:05:31.744 ************************************ 00:05:31.744 00:05:31.744 real 0m44.216s 00:05:31.744 user 1m20.783s 00:05:31.744 sys 0m9.826s 00:05:31.744 03:16:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:31.744 03:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:31.744 ************************************ 00:05:31.744 END TEST event 00:05:31.744 ************************************ 00:05:31.744 03:16:56 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:31.744 03:16:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.744 03:16:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.744 03:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:31.744 ************************************ 00:05:31.744 START TEST thread 00:05:31.744 ************************************ 00:05:31.744 03:16:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:32.003 * Looking for test storage... 00:05:32.003 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:32.003 03:16:56 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:32.003 03:16:56 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:32.003 03:16:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.003 03:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:32.003 ************************************ 00:05:32.003 START TEST thread_poller_perf 00:05:32.003 ************************************ 00:05:32.003 03:16:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:32.003 [2024-04-27 03:16:56.881062] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:32.003 [2024-04-27 03:16:56.881116] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1343136 ] 00:05:32.003 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.003 [2024-04-27 03:16:56.946635] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.262 [2024-04-27 03:16:57.063181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.262 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:33.636 ====================================== 00:05:33.636 busy:2709978578 (cyc) 00:05:33.636 total_run_count: 299000 00:05:33.636 tsc_hz: 2700000000 (cyc) 00:05:33.636 ====================================== 00:05:33.636 poller_cost: 9063 (cyc), 3356 (nsec) 00:05:33.636 00:05:33.636 real 0m1.322s 00:05:33.636 user 0m1.234s 00:05:33.636 sys 0m0.080s 00:05:33.636 03:16:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:33.636 03:16:58 -- common/autotest_common.sh@10 -- # set +x 00:05:33.636 ************************************ 00:05:33.636 END TEST thread_poller_perf 00:05:33.636 ************************************ 00:05:33.636 03:16:58 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:33.636 03:16:58 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:33.636 03:16:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.636 03:16:58 -- common/autotest_common.sh@10 -- # set +x 00:05:33.636 ************************************ 00:05:33.636 START TEST thread_poller_perf 00:05:33.636 ************************************ 00:05:33.636 03:16:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:33.636 [2024-04-27 03:16:58.335760] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:33.636 [2024-04-27 03:16:58.335826] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1343296 ] 00:05:33.636 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.636 [2024-04-27 03:16:58.399599] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.636 [2024-04-27 03:16:58.512856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.636 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:35.012 ====================================== 00:05:35.012 busy:2702593405 (cyc) 00:05:35.012 total_run_count: 3841000 00:05:35.012 tsc_hz: 2700000000 (cyc) 00:05:35.012 ====================================== 00:05:35.012 poller_cost: 703 (cyc), 260 (nsec) 00:05:35.012 00:05:35.012 real 0m1.312s 00:05:35.012 user 0m1.224s 00:05:35.012 sys 0m0.082s 00:05:35.012 03:16:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:35.012 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:05:35.012 ************************************ 00:05:35.012 END TEST thread_poller_perf 00:05:35.012 ************************************ 00:05:35.012 03:16:59 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:35.012 00:05:35.012 real 0m2.940s 00:05:35.012 user 0m2.566s 00:05:35.012 sys 0m0.347s 00:05:35.012 03:16:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:35.012 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:05:35.012 ************************************ 00:05:35.012 END TEST thread 00:05:35.012 ************************************ 00:05:35.012 03:16:59 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:35.012 03:16:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.012 03:16:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.012 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:05:35.012 ************************************ 00:05:35.012 START TEST accel 00:05:35.012 ************************************ 00:05:35.012 03:16:59 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:35.012 * Looking for test storage... 00:05:35.012 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:35.012 03:16:59 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:05:35.012 03:16:59 -- accel/accel.sh@82 -- # get_expected_opcs 00:05:35.012 03:16:59 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:35.012 03:16:59 -- accel/accel.sh@62 -- # spdk_tgt_pid=1343503 00:05:35.012 03:16:59 -- accel/accel.sh@63 -- # waitforlisten 1343503 00:05:35.012 03:16:59 -- common/autotest_common.sh@817 -- # '[' -z 1343503 ']' 00:05:35.012 03:16:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:35.012 03:16:59 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:35.012 03:16:59 -- accel/accel.sh@61 -- # build_accel_config 00:05:35.012 03:16:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:35.012 03:16:59 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:35.012 03:16:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:35.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:35.012 03:16:59 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:35.012 03:16:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:35.012 03:16:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.012 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:05:35.012 03:16:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.012 03:16:59 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:35.012 03:16:59 -- accel/accel.sh@40 -- # local IFS=, 00:05:35.012 03:16:59 -- accel/accel.sh@41 -- # jq -r . 00:05:35.012 [2024-04-27 03:16:59.895898] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:35.012 [2024-04-27 03:16:59.895979] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1343503 ] 00:05:35.012 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.012 [2024-04-27 03:16:59.957065] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.271 [2024-04-27 03:17:00.077145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.206 03:17:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:36.206 03:17:00 -- common/autotest_common.sh@850 -- # return 0 00:05:36.206 03:17:00 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:05:36.206 03:17:00 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:05:36.206 03:17:00 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:05:36.206 03:17:00 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:05:36.206 03:17:00 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:36.206 03:17:00 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:05:36.206 03:17:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:36.206 03:17:00 -- common/autotest_common.sh@10 -- # set +x 00:05:36.206 03:17:00 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:36.206 03:17:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # IFS== 00:05:36.206 03:17:00 -- accel/accel.sh@72 -- # read -r opc module 00:05:36.206 03:17:00 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:36.206 03:17:00 -- accel/accel.sh@75 -- # killprocess 1343503 00:05:36.206 03:17:00 -- common/autotest_common.sh@936 -- # '[' -z 1343503 ']' 00:05:36.206 03:17:00 -- common/autotest_common.sh@940 -- # kill -0 1343503 00:05:36.206 03:17:00 -- common/autotest_common.sh@941 -- # uname 00:05:36.206 03:17:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:36.206 03:17:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1343503 00:05:36.206 03:17:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:36.206 03:17:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:36.206 03:17:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1343503' 00:05:36.206 killing process with pid 1343503 00:05:36.206 03:17:00 -- common/autotest_common.sh@955 -- # kill 1343503 00:05:36.206 03:17:00 -- common/autotest_common.sh@960 -- # wait 1343503 00:05:36.464 03:17:01 -- accel/accel.sh@76 -- # trap - ERR 00:05:36.464 03:17:01 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:05:36.464 03:17:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:36.464 03:17:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.464 03:17:01 -- common/autotest_common.sh@10 -- # set +x 00:05:36.722 03:17:01 -- common/autotest_common.sh@1111 -- # accel_perf -h 00:05:36.722 03:17:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:36.722 03:17:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.722 03:17:01 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:36.722 03:17:01 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:36.722 03:17:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.722 03:17:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.722 03:17:01 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:36.722 03:17:01 -- accel/accel.sh@40 -- # local IFS=, 00:05:36.722 03:17:01 -- accel/accel.sh@41 -- # jq -r . 00:05:36.722 03:17:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:36.722 03:17:01 -- common/autotest_common.sh@10 -- # set +x 00:05:36.722 03:17:01 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:36.722 03:17:01 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:36.722 03:17:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.722 03:17:01 -- common/autotest_common.sh@10 -- # set +x 00:05:36.722 ************************************ 00:05:36.722 START TEST accel_missing_filename 00:05:36.722 ************************************ 00:05:36.722 03:17:01 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress 00:05:36.723 03:17:01 -- common/autotest_common.sh@638 -- # local es=0 00:05:36.723 03:17:01 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:36.723 03:17:01 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:36.723 03:17:01 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:36.723 03:17:01 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:36.723 03:17:01 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:36.723 03:17:01 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress 00:05:36.723 03:17:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:36.723 03:17:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.723 03:17:01 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:36.723 03:17:01 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:36.723 03:17:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.723 03:17:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.723 03:17:01 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:36.723 03:17:01 -- accel/accel.sh@40 -- # local IFS=, 00:05:36.723 03:17:01 -- accel/accel.sh@41 -- # jq -r . 00:05:36.723 [2024-04-27 03:17:01.615670] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:36.723 [2024-04-27 03:17:01.615729] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1343819 ] 00:05:36.723 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.723 [2024-04-27 03:17:01.678165] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.981 [2024-04-27 03:17:01.794526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.981 [2024-04-27 03:17:01.857244] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:36.981 [2024-04-27 03:17:01.946689] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:05:37.239 A filename is required. 00:05:37.239 03:17:02 -- common/autotest_common.sh@641 -- # es=234 00:05:37.239 03:17:02 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:37.239 03:17:02 -- common/autotest_common.sh@650 -- # es=106 00:05:37.239 03:17:02 -- common/autotest_common.sh@651 -- # case "$es" in 00:05:37.239 03:17:02 -- common/autotest_common.sh@658 -- # es=1 00:05:37.239 03:17:02 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:37.239 00:05:37.239 real 0m0.471s 00:05:37.239 user 0m0.363s 00:05:37.239 sys 0m0.141s 00:05:37.239 03:17:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:37.239 03:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:37.239 ************************************ 00:05:37.239 END TEST accel_missing_filename 00:05:37.239 ************************************ 00:05:37.239 03:17:02 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.239 03:17:02 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:37.239 03:17:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.239 03:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:37.239 ************************************ 00:05:37.239 START TEST accel_compress_verify 00:05:37.239 ************************************ 00:05:37.239 03:17:02 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.239 03:17:02 -- common/autotest_common.sh@638 -- # local es=0 00:05:37.239 03:17:02 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.239 03:17:02 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:37.239 03:17:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:37.239 03:17:02 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:37.239 03:17:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:37.239 03:17:02 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.239 03:17:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.239 03:17:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.239 03:17:02 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:37.239 03:17:02 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:37.239 03:17:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.239 03:17:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.239 03:17:02 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:37.239 03:17:02 -- accel/accel.sh@40 -- # local IFS=, 00:05:37.239 03:17:02 -- accel/accel.sh@41 -- # jq -r . 00:05:37.497 [2024-04-27 03:17:02.217475] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:37.497 [2024-04-27 03:17:02.217539] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1343864 ] 00:05:37.497 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.497 [2024-04-27 03:17:02.282832] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.497 [2024-04-27 03:17:02.399356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.497 [2024-04-27 03:17:02.462224] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:37.755 [2024-04-27 03:17:02.541826] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:05:37.755 00:05:37.755 Compression does not support the verify option, aborting. 00:05:37.755 03:17:02 -- common/autotest_common.sh@641 -- # es=161 00:05:37.755 03:17:02 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:37.755 03:17:02 -- common/autotest_common.sh@650 -- # es=33 00:05:37.755 03:17:02 -- common/autotest_common.sh@651 -- # case "$es" in 00:05:37.755 03:17:02 -- common/autotest_common.sh@658 -- # es=1 00:05:37.755 03:17:02 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:37.755 00:05:37.755 real 0m0.456s 00:05:37.755 user 0m0.341s 00:05:37.755 sys 0m0.149s 00:05:37.755 03:17:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:37.755 03:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:37.755 ************************************ 00:05:37.755 END TEST accel_compress_verify 00:05:37.755 ************************************ 00:05:37.755 03:17:02 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:37.755 03:17:02 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:37.755 03:17:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.755 03:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:38.014 ************************************ 00:05:38.014 START TEST accel_wrong_workload 00:05:38.014 ************************************ 00:05:38.014 03:17:02 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w foobar 00:05:38.014 03:17:02 -- common/autotest_common.sh@638 -- # local es=0 00:05:38.015 03:17:02 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:38.015 03:17:02 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:38.015 03:17:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:38.015 03:17:02 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:38.015 03:17:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:38.015 03:17:02 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w foobar 00:05:38.015 03:17:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:38.015 03:17:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.015 03:17:02 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:38.015 03:17:02 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:38.015 03:17:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.015 03:17:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.015 03:17:02 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:38.015 03:17:02 -- accel/accel.sh@40 -- # local IFS=, 00:05:38.015 03:17:02 -- accel/accel.sh@41 -- # jq -r . 00:05:38.015 Unsupported workload type: foobar 00:05:38.015 [2024-04-27 03:17:02.785010] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:38.015 accel_perf options: 00:05:38.015 [-h help message] 00:05:38.015 [-q queue depth per core] 00:05:38.015 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:38.015 [-T number of threads per core 00:05:38.015 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:38.015 [-t time in seconds] 00:05:38.015 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:38.015 [ dif_verify, , dif_generate, dif_generate_copy 00:05:38.015 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:38.015 [-l for compress/decompress workloads, name of uncompressed input file 00:05:38.015 [-S for crc32c workload, use this seed value (default 0) 00:05:38.015 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:38.015 [-f for fill workload, use this BYTE value (default 255) 00:05:38.015 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:38.015 [-y verify result if this switch is on] 00:05:38.015 [-a tasks to allocate per core (default: same value as -q)] 00:05:38.015 Can be used to spread operations across a wider range of memory. 00:05:38.015 03:17:02 -- common/autotest_common.sh@641 -- # es=1 00:05:38.015 03:17:02 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:38.015 03:17:02 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:38.015 03:17:02 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:38.015 00:05:38.015 real 0m0.023s 00:05:38.015 user 0m0.014s 00:05:38.015 sys 0m0.008s 00:05:38.015 03:17:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:38.015 03:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:38.015 ************************************ 00:05:38.015 END TEST accel_wrong_workload 00:05:38.015 ************************************ 00:05:38.015 Error: writing output failed: Broken pipe 00:05:38.015 03:17:02 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:38.015 03:17:02 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:38.015 03:17:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.015 03:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:38.015 ************************************ 00:05:38.015 START TEST accel_negative_buffers 00:05:38.015 ************************************ 00:05:38.015 03:17:02 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:38.015 03:17:02 -- common/autotest_common.sh@638 -- # local es=0 00:05:38.015 03:17:02 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:38.015 03:17:02 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:38.015 03:17:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:38.015 03:17:02 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:38.015 03:17:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:38.015 03:17:02 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w xor -y -x -1 00:05:38.015 03:17:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:38.015 03:17:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.015 03:17:02 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:38.015 03:17:02 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:38.015 03:17:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.015 03:17:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.015 03:17:02 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:38.015 03:17:02 -- accel/accel.sh@40 -- # local IFS=, 00:05:38.015 03:17:02 -- accel/accel.sh@41 -- # jq -r . 00:05:38.015 -x option must be non-negative. 00:05:38.015 [2024-04-27 03:17:02.935777] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:38.015 accel_perf options: 00:05:38.015 [-h help message] 00:05:38.015 [-q queue depth per core] 00:05:38.015 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:38.015 [-T number of threads per core 00:05:38.015 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:38.015 [-t time in seconds] 00:05:38.015 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:38.015 [ dif_verify, , dif_generate, dif_generate_copy 00:05:38.015 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:38.015 [-l for compress/decompress workloads, name of uncompressed input file 00:05:38.015 [-S for crc32c workload, use this seed value (default 0) 00:05:38.015 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:38.015 [-f for fill workload, use this BYTE value (default 255) 00:05:38.015 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:38.015 [-y verify result if this switch is on] 00:05:38.015 [-a tasks to allocate per core (default: same value as -q)] 00:05:38.015 Can be used to spread operations across a wider range of memory. 00:05:38.015 03:17:02 -- common/autotest_common.sh@641 -- # es=1 00:05:38.015 03:17:02 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:38.015 03:17:02 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:38.015 03:17:02 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:38.015 00:05:38.015 real 0m0.023s 00:05:38.015 user 0m0.012s 00:05:38.015 sys 0m0.012s 00:05:38.015 03:17:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:38.015 03:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:38.015 ************************************ 00:05:38.015 END TEST accel_negative_buffers 00:05:38.015 ************************************ 00:05:38.015 Error: writing output failed: Broken pipe 00:05:38.015 03:17:02 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:38.015 03:17:02 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:38.015 03:17:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.015 03:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:38.273 ************************************ 00:05:38.273 START TEST accel_crc32c 00:05:38.273 ************************************ 00:05:38.273 03:17:03 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:38.273 03:17:03 -- accel/accel.sh@16 -- # local accel_opc 00:05:38.273 03:17:03 -- accel/accel.sh@17 -- # local accel_module 00:05:38.273 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.273 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.273 03:17:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:38.273 03:17:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:38.273 03:17:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.273 03:17:03 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:38.273 03:17:03 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:38.273 03:17:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.273 03:17:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.273 03:17:03 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:38.273 03:17:03 -- accel/accel.sh@40 -- # local IFS=, 00:05:38.273 03:17:03 -- accel/accel.sh@41 -- # jq -r . 00:05:38.273 [2024-04-27 03:17:03.070042] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:38.273 [2024-04-27 03:17:03.070103] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1344057 ] 00:05:38.273 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.273 [2024-04-27 03:17:03.132457] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.273 [2024-04-27 03:17:03.247411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.530 03:17:03 -- accel/accel.sh@20 -- # val= 00:05:38.530 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.530 03:17:03 -- accel/accel.sh@20 -- # val= 00:05:38.530 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.530 03:17:03 -- accel/accel.sh@20 -- # val=0x1 00:05:38.530 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.530 03:17:03 -- accel/accel.sh@20 -- # val= 00:05:38.530 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.530 03:17:03 -- accel/accel.sh@20 -- # val= 00:05:38.530 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.530 03:17:03 -- accel/accel.sh@20 -- # val=crc32c 00:05:38.530 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.530 03:17:03 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.530 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.530 03:17:03 -- accel/accel.sh@20 -- # val=32 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.531 03:17:03 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.531 03:17:03 -- accel/accel.sh@20 -- # val= 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.531 03:17:03 -- accel/accel.sh@20 -- # val=software 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@22 -- # accel_module=software 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.531 03:17:03 -- accel/accel.sh@20 -- # val=32 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.531 03:17:03 -- accel/accel.sh@20 -- # val=32 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.531 03:17:03 -- accel/accel.sh@20 -- # val=1 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.531 03:17:03 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.531 03:17:03 -- accel/accel.sh@20 -- # val=Yes 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.531 03:17:03 -- accel/accel.sh@20 -- # val= 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:38.531 03:17:03 -- accel/accel.sh@20 -- # val= 00:05:38.531 03:17:03 -- accel/accel.sh@21 -- # case "$var" in 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # IFS=: 00:05:38.531 03:17:03 -- accel/accel.sh@19 -- # read -r var val 00:05:39.906 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:39.906 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:39.906 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:39.906 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:39.906 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:39.906 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:39.906 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:39.906 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:39.906 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:39.906 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:39.906 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:39.906 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:39.906 03:17:04 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:39.906 03:17:04 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:05:39.906 03:17:04 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:39.906 00:05:39.906 real 0m1.468s 00:05:39.906 user 0m1.325s 00:05:39.906 sys 0m0.145s 00:05:39.906 03:17:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:39.906 03:17:04 -- common/autotest_common.sh@10 -- # set +x 00:05:39.906 ************************************ 00:05:39.906 END TEST accel_crc32c 00:05:39.906 ************************************ 00:05:39.906 03:17:04 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:39.906 03:17:04 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:39.906 03:17:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.906 03:17:04 -- common/autotest_common.sh@10 -- # set +x 00:05:39.906 ************************************ 00:05:39.906 START TEST accel_crc32c_C2 00:05:39.906 ************************************ 00:05:39.906 03:17:04 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:39.906 03:17:04 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.906 03:17:04 -- accel/accel.sh@17 -- # local accel_module 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:39.906 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:39.906 03:17:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:39.906 03:17:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:39.906 03:17:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.906 03:17:04 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:39.906 03:17:04 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:39.906 03:17:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.906 03:17:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.906 03:17:04 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:39.906 03:17:04 -- accel/accel.sh@40 -- # local IFS=, 00:05:39.906 03:17:04 -- accel/accel.sh@41 -- # jq -r . 00:05:39.906 [2024-04-27 03:17:04.655212] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:39.906 [2024-04-27 03:17:04.655347] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1344338 ] 00:05:39.906 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.906 [2024-04-27 03:17:04.716142] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.906 [2024-04-27 03:17:04.830759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val=0x1 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val=crc32c 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val=0 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val=software 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@22 -- # accel_module=software 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val=32 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val=32 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.164 03:17:04 -- accel/accel.sh@20 -- # val=1 00:05:40.164 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.164 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.165 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.165 03:17:04 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:40.165 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.165 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.165 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.165 03:17:04 -- accel/accel.sh@20 -- # val=Yes 00:05:40.165 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.165 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.165 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.165 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:40.165 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.165 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.165 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:40.165 03:17:04 -- accel/accel.sh@20 -- # val= 00:05:40.165 03:17:04 -- accel/accel.sh@21 -- # case "$var" in 00:05:40.165 03:17:04 -- accel/accel.sh@19 -- # IFS=: 00:05:40.165 03:17:04 -- accel/accel.sh@19 -- # read -r var val 00:05:41.539 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.539 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.539 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.539 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.539 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.539 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.539 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.539 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.539 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.539 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.539 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.539 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.539 03:17:06 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:41.539 03:17:06 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:05:41.539 03:17:06 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:41.539 00:05:41.539 real 0m1.454s 00:05:41.539 user 0m1.325s 00:05:41.539 sys 0m0.131s 00:05:41.539 03:17:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:41.539 03:17:06 -- common/autotest_common.sh@10 -- # set +x 00:05:41.539 ************************************ 00:05:41.539 END TEST accel_crc32c_C2 00:05:41.539 ************************************ 00:05:41.539 03:17:06 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:41.539 03:17:06 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:41.539 03:17:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.539 03:17:06 -- common/autotest_common.sh@10 -- # set +x 00:05:41.539 ************************************ 00:05:41.539 START TEST accel_copy 00:05:41.539 ************************************ 00:05:41.539 03:17:06 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy -y 00:05:41.539 03:17:06 -- accel/accel.sh@16 -- # local accel_opc 00:05:41.539 03:17:06 -- accel/accel.sh@17 -- # local accel_module 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.539 03:17:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:41.539 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.539 03:17:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:41.539 03:17:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.539 03:17:06 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:41.539 03:17:06 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:41.540 03:17:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.540 03:17:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.540 03:17:06 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:41.540 03:17:06 -- accel/accel.sh@40 -- # local IFS=, 00:05:41.540 03:17:06 -- accel/accel.sh@41 -- # jq -r . 00:05:41.540 [2024-04-27 03:17:06.240158] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:41.540 [2024-04-27 03:17:06.240222] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1344505 ] 00:05:41.540 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.540 [2024-04-27 03:17:06.303487] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.540 [2024-04-27 03:17:06.417395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val=0x1 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val=copy 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@23 -- # accel_opc=copy 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val=software 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@22 -- # accel_module=software 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val=32 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val=32 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val=1 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val=Yes 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:41.540 03:17:06 -- accel/accel.sh@20 -- # val= 00:05:41.540 03:17:06 -- accel/accel.sh@21 -- # case "$var" in 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # IFS=: 00:05:41.540 03:17:06 -- accel/accel.sh@19 -- # read -r var val 00:05:42.913 03:17:07 -- accel/accel.sh@20 -- # val= 00:05:42.913 03:17:07 -- accel/accel.sh@21 -- # case "$var" in 00:05:42.913 03:17:07 -- accel/accel.sh@19 -- # IFS=: 00:05:42.913 03:17:07 -- accel/accel.sh@19 -- # read -r var val 00:05:42.913 03:17:07 -- accel/accel.sh@20 -- # val= 00:05:42.913 03:17:07 -- accel/accel.sh@21 -- # case "$var" in 00:05:42.913 03:17:07 -- accel/accel.sh@19 -- # IFS=: 00:05:42.913 03:17:07 -- accel/accel.sh@19 -- # read -r var val 00:05:42.913 03:17:07 -- accel/accel.sh@20 -- # val= 00:05:42.913 03:17:07 -- accel/accel.sh@21 -- # case "$var" in 00:05:42.914 03:17:07 -- accel/accel.sh@19 -- # IFS=: 00:05:42.914 03:17:07 -- accel/accel.sh@19 -- # read -r var val 00:05:42.914 03:17:07 -- accel/accel.sh@20 -- # val= 00:05:42.914 03:17:07 -- accel/accel.sh@21 -- # case "$var" in 00:05:42.914 03:17:07 -- accel/accel.sh@19 -- # IFS=: 00:05:42.914 03:17:07 -- accel/accel.sh@19 -- # read -r var val 00:05:42.914 03:17:07 -- accel/accel.sh@20 -- # val= 00:05:42.914 03:17:07 -- accel/accel.sh@21 -- # case "$var" in 00:05:42.914 03:17:07 -- accel/accel.sh@19 -- # IFS=: 00:05:42.914 03:17:07 -- accel/accel.sh@19 -- # read -r var val 00:05:42.914 03:17:07 -- accel/accel.sh@20 -- # val= 00:05:42.914 03:17:07 -- accel/accel.sh@21 -- # case "$var" in 00:05:42.914 03:17:07 -- accel/accel.sh@19 -- # IFS=: 00:05:42.914 03:17:07 -- accel/accel.sh@19 -- # read -r var val 00:05:42.914 03:17:07 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:42.914 03:17:07 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:05:42.914 03:17:07 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:42.914 00:05:42.914 real 0m1.476s 00:05:42.914 user 0m1.329s 00:05:42.914 sys 0m0.148s 00:05:42.914 03:17:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:42.914 03:17:07 -- common/autotest_common.sh@10 -- # set +x 00:05:42.914 ************************************ 00:05:42.914 END TEST accel_copy 00:05:42.914 ************************************ 00:05:42.914 03:17:07 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:42.914 03:17:07 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:42.914 03:17:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.914 03:17:07 -- common/autotest_common.sh@10 -- # set +x 00:05:42.914 ************************************ 00:05:42.914 START TEST accel_fill 00:05:42.914 ************************************ 00:05:42.914 03:17:07 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:42.914 03:17:07 -- accel/accel.sh@16 -- # local accel_opc 00:05:42.914 03:17:07 -- accel/accel.sh@17 -- # local accel_module 00:05:42.914 03:17:07 -- accel/accel.sh@19 -- # IFS=: 00:05:42.914 03:17:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:42.914 03:17:07 -- accel/accel.sh@19 -- # read -r var val 00:05:42.914 03:17:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:42.914 03:17:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.914 03:17:07 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:42.914 03:17:07 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:42.914 03:17:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.914 03:17:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.914 03:17:07 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:42.914 03:17:07 -- accel/accel.sh@40 -- # local IFS=, 00:05:42.914 03:17:07 -- accel/accel.sh@41 -- # jq -r . 00:05:42.914 [2024-04-27 03:17:07.828058] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:42.914 [2024-04-27 03:17:07.828122] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1344671 ] 00:05:42.914 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.914 [2024-04-27 03:17:07.890807] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.173 [2024-04-27 03:17:08.009939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val= 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val= 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val=0x1 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val= 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val= 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val=fill 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@23 -- # accel_opc=fill 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val=0x80 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val= 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val=software 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@22 -- # accel_module=software 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val=64 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val=64 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val=1 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val=Yes 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val= 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:43.173 03:17:08 -- accel/accel.sh@20 -- # val= 00:05:43.173 03:17:08 -- accel/accel.sh@21 -- # case "$var" in 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # IFS=: 00:05:43.173 03:17:08 -- accel/accel.sh@19 -- # read -r var val 00:05:44.546 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.546 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.546 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.546 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.546 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.546 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.546 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.546 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.546 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.546 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.546 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.546 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.546 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.547 03:17:09 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:44.547 03:17:09 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:05:44.547 03:17:09 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:44.547 00:05:44.547 real 0m1.481s 00:05:44.547 user 0m1.336s 00:05:44.547 sys 0m0.147s 00:05:44.547 03:17:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:44.547 03:17:09 -- common/autotest_common.sh@10 -- # set +x 00:05:44.547 ************************************ 00:05:44.547 END TEST accel_fill 00:05:44.547 ************************************ 00:05:44.547 03:17:09 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:44.547 03:17:09 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:44.547 03:17:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.547 03:17:09 -- common/autotest_common.sh@10 -- # set +x 00:05:44.547 ************************************ 00:05:44.547 START TEST accel_copy_crc32c 00:05:44.547 ************************************ 00:05:44.547 03:17:09 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y 00:05:44.547 03:17:09 -- accel/accel.sh@16 -- # local accel_opc 00:05:44.547 03:17:09 -- accel/accel.sh@17 -- # local accel_module 00:05:44.547 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.547 03:17:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:44.547 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.547 03:17:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:44.547 03:17:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.547 03:17:09 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:44.547 03:17:09 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:44.547 03:17:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.547 03:17:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.547 03:17:09 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:44.547 03:17:09 -- accel/accel.sh@40 -- # local IFS=, 00:05:44.547 03:17:09 -- accel/accel.sh@41 -- # jq -r . 00:05:44.547 [2024-04-27 03:17:09.434579] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:44.547 [2024-04-27 03:17:09.434643] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1344945 ] 00:05:44.547 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.547 [2024-04-27 03:17:09.496633] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.805 [2024-04-27 03:17:09.612348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val=0x1 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val=copy_crc32c 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val=0 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val=software 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@22 -- # accel_module=software 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val=32 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val=32 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val=1 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val=Yes 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:44.805 03:17:09 -- accel/accel.sh@20 -- # val= 00:05:44.805 03:17:09 -- accel/accel.sh@21 -- # case "$var" in 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # IFS=: 00:05:44.805 03:17:09 -- accel/accel.sh@19 -- # read -r var val 00:05:46.176 03:17:10 -- accel/accel.sh@20 -- # val= 00:05:46.176 03:17:10 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.176 03:17:10 -- accel/accel.sh@19 -- # IFS=: 00:05:46.176 03:17:10 -- accel/accel.sh@19 -- # read -r var val 00:05:46.177 03:17:10 -- accel/accel.sh@20 -- # val= 00:05:46.177 03:17:10 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.177 03:17:10 -- accel/accel.sh@19 -- # IFS=: 00:05:46.177 03:17:10 -- accel/accel.sh@19 -- # read -r var val 00:05:46.177 03:17:10 -- accel/accel.sh@20 -- # val= 00:05:46.177 03:17:10 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.177 03:17:10 -- accel/accel.sh@19 -- # IFS=: 00:05:46.177 03:17:10 -- accel/accel.sh@19 -- # read -r var val 00:05:46.177 03:17:10 -- accel/accel.sh@20 -- # val= 00:05:46.177 03:17:10 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.177 03:17:10 -- accel/accel.sh@19 -- # IFS=: 00:05:46.177 03:17:10 -- accel/accel.sh@19 -- # read -r var val 00:05:46.177 03:17:10 -- accel/accel.sh@20 -- # val= 00:05:46.177 03:17:10 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.177 03:17:10 -- accel/accel.sh@19 -- # IFS=: 00:05:46.177 03:17:10 -- accel/accel.sh@19 -- # read -r var val 00:05:46.177 03:17:10 -- accel/accel.sh@20 -- # val= 00:05:46.177 03:17:10 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.177 03:17:10 -- accel/accel.sh@19 -- # IFS=: 00:05:46.177 03:17:10 -- accel/accel.sh@19 -- # read -r var val 00:05:46.177 03:17:10 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:46.177 03:17:10 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:05:46.177 03:17:10 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.177 00:05:46.177 real 0m1.468s 00:05:46.177 user 0m1.328s 00:05:46.177 sys 0m0.143s 00:05:46.177 03:17:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:46.177 03:17:10 -- common/autotest_common.sh@10 -- # set +x 00:05:46.177 ************************************ 00:05:46.177 END TEST accel_copy_crc32c 00:05:46.177 ************************************ 00:05:46.177 03:17:10 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:46.177 03:17:10 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:46.177 03:17:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.177 03:17:10 -- common/autotest_common.sh@10 -- # set +x 00:05:46.177 ************************************ 00:05:46.177 START TEST accel_copy_crc32c_C2 00:05:46.177 ************************************ 00:05:46.177 03:17:11 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:46.177 03:17:11 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.177 03:17:11 -- accel/accel.sh@17 -- # local accel_module 00:05:46.177 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.177 03:17:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:46.177 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.177 03:17:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:46.177 03:17:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.177 03:17:11 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:46.177 03:17:11 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:46.177 03:17:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.177 03:17:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.177 03:17:11 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:46.177 03:17:11 -- accel/accel.sh@40 -- # local IFS=, 00:05:46.177 03:17:11 -- accel/accel.sh@41 -- # jq -r . 00:05:46.177 [2024-04-27 03:17:11.021582] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:46.177 [2024-04-27 03:17:11.021646] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1345119 ] 00:05:46.177 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.177 [2024-04-27 03:17:11.082907] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.435 [2024-04-27 03:17:11.204255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val= 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val= 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val=0x1 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val= 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val= 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val=copy_crc32c 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val=0 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val='8192 bytes' 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val= 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val=software 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@22 -- # accel_module=software 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val=32 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val=32 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val=1 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val=Yes 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val= 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:46.435 03:17:11 -- accel/accel.sh@20 -- # val= 00:05:46.435 03:17:11 -- accel/accel.sh@21 -- # case "$var" in 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # IFS=: 00:05:46.435 03:17:11 -- accel/accel.sh@19 -- # read -r var val 00:05:47.809 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:47.809 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:47.809 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:47.809 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:47.809 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:47.809 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:47.809 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:47.809 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:47.809 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:47.809 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:47.809 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:47.809 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:47.809 03:17:12 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:47.809 03:17:12 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:05:47.809 03:17:12 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:47.809 00:05:47.809 real 0m1.482s 00:05:47.809 user 0m1.341s 00:05:47.809 sys 0m0.143s 00:05:47.809 03:17:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:47.809 03:17:12 -- common/autotest_common.sh@10 -- # set +x 00:05:47.809 ************************************ 00:05:47.809 END TEST accel_copy_crc32c_C2 00:05:47.809 ************************************ 00:05:47.809 03:17:12 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:47.809 03:17:12 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:47.809 03:17:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.809 03:17:12 -- common/autotest_common.sh@10 -- # set +x 00:05:47.809 ************************************ 00:05:47.809 START TEST accel_dualcast 00:05:47.809 ************************************ 00:05:47.809 03:17:12 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dualcast -y 00:05:47.809 03:17:12 -- accel/accel.sh@16 -- # local accel_opc 00:05:47.809 03:17:12 -- accel/accel.sh@17 -- # local accel_module 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:47.809 03:17:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:47.809 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:47.809 03:17:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:47.809 03:17:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.809 03:17:12 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:47.809 03:17:12 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:47.809 03:17:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.809 03:17:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.809 03:17:12 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:47.809 03:17:12 -- accel/accel.sh@40 -- # local IFS=, 00:05:47.809 03:17:12 -- accel/accel.sh@41 -- # jq -r . 00:05:47.809 [2024-04-27 03:17:12.631697] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:47.809 [2024-04-27 03:17:12.631760] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1345398 ] 00:05:47.809 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.809 [2024-04-27 03:17:12.693608] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.067 [2024-04-27 03:17:12.815681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.067 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:48.067 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.067 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val=0x1 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val=dualcast 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val=software 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@22 -- # accel_module=software 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val=32 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val=32 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val=1 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val=Yes 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:48.068 03:17:12 -- accel/accel.sh@20 -- # val= 00:05:48.068 03:17:12 -- accel/accel.sh@21 -- # case "$var" in 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # IFS=: 00:05:48.068 03:17:12 -- accel/accel.sh@19 -- # read -r var val 00:05:49.441 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.441 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.441 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.441 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.441 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.441 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.441 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.441 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.441 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.441 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.441 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.441 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.441 03:17:14 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:49.441 03:17:14 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:05:49.441 03:17:14 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.441 00:05:49.441 real 0m1.486s 00:05:49.441 user 0m1.340s 00:05:49.441 sys 0m0.147s 00:05:49.441 03:17:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:49.441 03:17:14 -- common/autotest_common.sh@10 -- # set +x 00:05:49.441 ************************************ 00:05:49.441 END TEST accel_dualcast 00:05:49.441 ************************************ 00:05:49.441 03:17:14 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:49.441 03:17:14 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:49.441 03:17:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.441 03:17:14 -- common/autotest_common.sh@10 -- # set +x 00:05:49.441 ************************************ 00:05:49.441 START TEST accel_compare 00:05:49.441 ************************************ 00:05:49.441 03:17:14 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compare -y 00:05:49.441 03:17:14 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.441 03:17:14 -- accel/accel.sh@17 -- # local accel_module 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.441 03:17:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:49.441 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.441 03:17:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:49.441 03:17:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.441 03:17:14 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:49.441 03:17:14 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:49.441 03:17:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.441 03:17:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.441 03:17:14 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:49.441 03:17:14 -- accel/accel.sh@40 -- # local IFS=, 00:05:49.441 03:17:14 -- accel/accel.sh@41 -- # jq -r . 00:05:49.441 [2024-04-27 03:17:14.235445] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:49.441 [2024-04-27 03:17:14.235506] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1345566 ] 00:05:49.441 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.441 [2024-04-27 03:17:14.301254] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.700 [2024-04-27 03:17:14.422930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val=0x1 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val=compare 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@23 -- # accel_opc=compare 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val=software 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@22 -- # accel_module=software 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val=32 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val=32 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val=1 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val=Yes 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:49.700 03:17:14 -- accel/accel.sh@20 -- # val= 00:05:49.700 03:17:14 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # IFS=: 00:05:49.700 03:17:14 -- accel/accel.sh@19 -- # read -r var val 00:05:51.075 03:17:15 -- accel/accel.sh@20 -- # val= 00:05:51.075 03:17:15 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # IFS=: 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # read -r var val 00:05:51.075 03:17:15 -- accel/accel.sh@20 -- # val= 00:05:51.075 03:17:15 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # IFS=: 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # read -r var val 00:05:51.075 03:17:15 -- accel/accel.sh@20 -- # val= 00:05:51.075 03:17:15 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # IFS=: 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # read -r var val 00:05:51.075 03:17:15 -- accel/accel.sh@20 -- # val= 00:05:51.075 03:17:15 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # IFS=: 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # read -r var val 00:05:51.075 03:17:15 -- accel/accel.sh@20 -- # val= 00:05:51.075 03:17:15 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # IFS=: 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # read -r var val 00:05:51.075 03:17:15 -- accel/accel.sh@20 -- # val= 00:05:51.075 03:17:15 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # IFS=: 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # read -r var val 00:05:51.075 03:17:15 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:51.075 03:17:15 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:05:51.075 03:17:15 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:51.075 00:05:51.075 real 0m1.488s 00:05:51.075 user 0m1.344s 00:05:51.075 sys 0m0.146s 00:05:51.075 03:17:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:51.075 03:17:15 -- common/autotest_common.sh@10 -- # set +x 00:05:51.075 ************************************ 00:05:51.075 END TEST accel_compare 00:05:51.075 ************************************ 00:05:51.075 03:17:15 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:51.075 03:17:15 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:51.075 03:17:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.075 03:17:15 -- common/autotest_common.sh@10 -- # set +x 00:05:51.075 ************************************ 00:05:51.075 START TEST accel_xor 00:05:51.075 ************************************ 00:05:51.075 03:17:15 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y 00:05:51.075 03:17:15 -- accel/accel.sh@16 -- # local accel_opc 00:05:51.075 03:17:15 -- accel/accel.sh@17 -- # local accel_module 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # IFS=: 00:05:51.075 03:17:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:51.075 03:17:15 -- accel/accel.sh@19 -- # read -r var val 00:05:51.075 03:17:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:51.075 03:17:15 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.075 03:17:15 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:51.075 03:17:15 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:51.075 03:17:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.075 03:17:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.075 03:17:15 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:51.075 03:17:15 -- accel/accel.sh@40 -- # local IFS=, 00:05:51.075 03:17:15 -- accel/accel.sh@41 -- # jq -r . 00:05:51.075 [2024-04-27 03:17:15.855470] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:51.075 [2024-04-27 03:17:15.855550] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1345735 ] 00:05:51.075 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.075 [2024-04-27 03:17:15.920042] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.075 [2024-04-27 03:17:16.040114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val= 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val= 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val=0x1 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val= 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val= 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val=xor 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@23 -- # accel_opc=xor 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val=2 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val= 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val=software 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@22 -- # accel_module=software 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val=32 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val=32 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val=1 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val=Yes 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val= 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:51.334 03:17:16 -- accel/accel.sh@20 -- # val= 00:05:51.334 03:17:16 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # IFS=: 00:05:51.334 03:17:16 -- accel/accel.sh@19 -- # read -r var val 00:05:52.710 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.710 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.710 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.710 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.710 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.710 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.710 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.710 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.710 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.710 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.710 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.710 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.710 03:17:17 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:52.710 03:17:17 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:05:52.710 03:17:17 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.710 00:05:52.710 real 0m1.490s 00:05:52.710 user 0m1.348s 00:05:52.710 sys 0m0.144s 00:05:52.710 03:17:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:52.710 03:17:17 -- common/autotest_common.sh@10 -- # set +x 00:05:52.710 ************************************ 00:05:52.710 END TEST accel_xor 00:05:52.710 ************************************ 00:05:52.710 03:17:17 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:52.710 03:17:17 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:52.710 03:17:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.710 03:17:17 -- common/autotest_common.sh@10 -- # set +x 00:05:52.710 ************************************ 00:05:52.710 START TEST accel_xor 00:05:52.710 ************************************ 00:05:52.710 03:17:17 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y -x 3 00:05:52.710 03:17:17 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.710 03:17:17 -- accel/accel.sh@17 -- # local accel_module 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.710 03:17:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:52.710 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.710 03:17:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:52.710 03:17:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.710 03:17:17 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:52.710 03:17:17 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:52.710 03:17:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.710 03:17:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.710 03:17:17 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:52.710 03:17:17 -- accel/accel.sh@40 -- # local IFS=, 00:05:52.710 03:17:17 -- accel/accel.sh@41 -- # jq -r . 00:05:52.710 [2024-04-27 03:17:17.464215] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:52.710 [2024-04-27 03:17:17.464286] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1346007 ] 00:05:52.710 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.710 [2024-04-27 03:17:17.526200] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.710 [2024-04-27 03:17:17.649945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val=0x1 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val=xor 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@23 -- # accel_opc=xor 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val=3 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val=software 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@22 -- # accel_module=software 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val=32 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val=32 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val=1 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val=Yes 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:52.969 03:17:17 -- accel/accel.sh@20 -- # val= 00:05:52.969 03:17:17 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # IFS=: 00:05:52.969 03:17:17 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:18 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:18 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:18 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:18 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:18 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:18 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:18 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:18 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:18 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:18 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:18 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:18 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:18 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:18 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:54.343 03:17:18 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:05:54.343 03:17:18 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.343 00:05:54.343 real 0m1.481s 00:05:54.343 user 0m1.340s 00:05:54.343 sys 0m0.143s 00:05:54.343 03:17:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:54.343 03:17:18 -- common/autotest_common.sh@10 -- # set +x 00:05:54.343 ************************************ 00:05:54.343 END TEST accel_xor 00:05:54.343 ************************************ 00:05:54.343 03:17:18 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:54.343 03:17:18 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:54.343 03:17:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.343 03:17:18 -- common/autotest_common.sh@10 -- # set +x 00:05:54.343 ************************************ 00:05:54.343 START TEST accel_dif_verify 00:05:54.343 ************************************ 00:05:54.343 03:17:19 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_verify 00:05:54.343 03:17:19 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.343 03:17:19 -- accel/accel.sh@17 -- # local accel_module 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:54.343 03:17:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.343 03:17:19 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:54.343 03:17:19 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:54.343 03:17:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.343 03:17:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.343 03:17:19 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:54.343 03:17:19 -- accel/accel.sh@40 -- # local IFS=, 00:05:54.343 03:17:19 -- accel/accel.sh@41 -- # jq -r . 00:05:54.343 [2024-04-27 03:17:19.070141] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:54.343 [2024-04-27 03:17:19.070210] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1346178 ] 00:05:54.343 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.343 [2024-04-27 03:17:19.132452] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.343 [2024-04-27 03:17:19.253204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val=0x1 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val=dif_verify 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val='512 bytes' 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val='8 bytes' 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val= 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.343 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.343 03:17:19 -- accel/accel.sh@20 -- # val=software 00:05:54.343 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.343 03:17:19 -- accel/accel.sh@22 -- # accel_module=software 00:05:54.344 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.344 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.344 03:17:19 -- accel/accel.sh@20 -- # val=32 00:05:54.344 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.344 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.344 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.344 03:17:19 -- accel/accel.sh@20 -- # val=32 00:05:54.344 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.344 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.344 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.344 03:17:19 -- accel/accel.sh@20 -- # val=1 00:05:54.344 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.344 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.344 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.344 03:17:19 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:54.344 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.344 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.601 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.602 03:17:19 -- accel/accel.sh@20 -- # val=No 00:05:54.602 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.602 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.602 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.602 03:17:19 -- accel/accel.sh@20 -- # val= 00:05:54.602 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.602 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.602 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:54.602 03:17:19 -- accel/accel.sh@20 -- # val= 00:05:54.602 03:17:19 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.602 03:17:19 -- accel/accel.sh@19 -- # IFS=: 00:05:54.602 03:17:19 -- accel/accel.sh@19 -- # read -r var val 00:05:55.974 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.974 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.974 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.974 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.974 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.974 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.974 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.974 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.974 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.974 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.974 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.974 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.974 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.974 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.974 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.974 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.974 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.974 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:55.975 03:17:20 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:05:55.975 03:17:20 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.975 00:05:55.975 real 0m1.480s 00:05:55.975 user 0m1.342s 00:05:55.975 sys 0m0.140s 00:05:55.975 03:17:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:55.975 03:17:20 -- common/autotest_common.sh@10 -- # set +x 00:05:55.975 ************************************ 00:05:55.975 END TEST accel_dif_verify 00:05:55.975 ************************************ 00:05:55.975 03:17:20 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:55.975 03:17:20 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:55.975 03:17:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.975 03:17:20 -- common/autotest_common.sh@10 -- # set +x 00:05:55.975 ************************************ 00:05:55.975 START TEST accel_dif_generate 00:05:55.975 ************************************ 00:05:55.975 03:17:20 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate 00:05:55.975 03:17:20 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.975 03:17:20 -- accel/accel.sh@17 -- # local accel_module 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:55.975 03:17:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.975 03:17:20 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:55.975 03:17:20 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:55.975 03:17:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.975 03:17:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.975 03:17:20 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:55.975 03:17:20 -- accel/accel.sh@40 -- # local IFS=, 00:05:55.975 03:17:20 -- accel/accel.sh@41 -- # jq -r . 00:05:55.975 [2024-04-27 03:17:20.669748] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:55.975 [2024-04-27 03:17:20.669812] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1346460 ] 00:05:55.975 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.975 [2024-04-27 03:17:20.731160] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.975 [2024-04-27 03:17:20.851632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val=0x1 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val=dif_generate 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val='512 bytes' 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val='8 bytes' 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val=software 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@22 -- # accel_module=software 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val=32 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val=32 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val=1 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val=No 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:55.975 03:17:20 -- accel/accel.sh@20 -- # val= 00:05:55.975 03:17:20 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # IFS=: 00:05:55.975 03:17:20 -- accel/accel.sh@19 -- # read -r var val 00:05:57.347 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.348 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.348 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.348 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.348 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.348 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.348 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.348 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.348 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.348 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.348 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.348 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.348 03:17:22 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:57.348 03:17:22 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:05:57.348 03:17:22 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.348 00:05:57.348 real 0m1.478s 00:05:57.348 user 0m1.344s 00:05:57.348 sys 0m0.137s 00:05:57.348 03:17:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:57.348 03:17:22 -- common/autotest_common.sh@10 -- # set +x 00:05:57.348 ************************************ 00:05:57.348 END TEST accel_dif_generate 00:05:57.348 ************************************ 00:05:57.348 03:17:22 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:57.348 03:17:22 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:57.348 03:17:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.348 03:17:22 -- common/autotest_common.sh@10 -- # set +x 00:05:57.348 ************************************ 00:05:57.348 START TEST accel_dif_generate_copy 00:05:57.348 ************************************ 00:05:57.348 03:17:22 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate_copy 00:05:57.348 03:17:22 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.348 03:17:22 -- accel/accel.sh@17 -- # local accel_module 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.348 03:17:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:05:57.348 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.348 03:17:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:57.348 03:17:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.348 03:17:22 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:57.348 03:17:22 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:57.348 03:17:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.348 03:17:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.348 03:17:22 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:57.348 03:17:22 -- accel/accel.sh@40 -- # local IFS=, 00:05:57.348 03:17:22 -- accel/accel.sh@41 -- # jq -r . 00:05:57.348 [2024-04-27 03:17:22.269603] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:57.348 [2024-04-27 03:17:22.269665] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1346622 ] 00:05:57.348 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.624 [2024-04-27 03:17:22.353107] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.624 [2024-04-27 03:17:22.481222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.624 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.624 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.624 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.624 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.624 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.624 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.624 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val=0x1 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val=software 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@22 -- # accel_module=software 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val=32 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val=32 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val=1 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val=No 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:57.625 03:17:22 -- accel/accel.sh@20 -- # val= 00:05:57.625 03:17:22 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # IFS=: 00:05:57.625 03:17:22 -- accel/accel.sh@19 -- # read -r var val 00:05:59.000 03:17:23 -- accel/accel.sh@20 -- # val= 00:05:59.000 03:17:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # IFS=: 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # read -r var val 00:05:59.000 03:17:23 -- accel/accel.sh@20 -- # val= 00:05:59.000 03:17:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # IFS=: 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # read -r var val 00:05:59.000 03:17:23 -- accel/accel.sh@20 -- # val= 00:05:59.000 03:17:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # IFS=: 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # read -r var val 00:05:59.000 03:17:23 -- accel/accel.sh@20 -- # val= 00:05:59.000 03:17:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # IFS=: 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # read -r var val 00:05:59.000 03:17:23 -- accel/accel.sh@20 -- # val= 00:05:59.000 03:17:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # IFS=: 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # read -r var val 00:05:59.000 03:17:23 -- accel/accel.sh@20 -- # val= 00:05:59.000 03:17:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # IFS=: 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # read -r var val 00:05:59.000 03:17:23 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:59.000 03:17:23 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:05:59.000 03:17:23 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:59.000 00:05:59.000 real 0m1.503s 00:05:59.000 user 0m1.347s 00:05:59.000 sys 0m0.156s 00:05:59.000 03:17:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:59.000 03:17:23 -- common/autotest_common.sh@10 -- # set +x 00:05:59.000 ************************************ 00:05:59.000 END TEST accel_dif_generate_copy 00:05:59.000 ************************************ 00:05:59.000 03:17:23 -- accel/accel.sh@115 -- # [[ y == y ]] 00:05:59.000 03:17:23 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.000 03:17:23 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:59.000 03:17:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.000 03:17:23 -- common/autotest_common.sh@10 -- # set +x 00:05:59.000 ************************************ 00:05:59.000 START TEST accel_comp 00:05:59.000 ************************************ 00:05:59.000 03:17:23 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.000 03:17:23 -- accel/accel.sh@16 -- # local accel_opc 00:05:59.000 03:17:23 -- accel/accel.sh@17 -- # local accel_module 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # IFS=: 00:05:59.000 03:17:23 -- accel/accel.sh@19 -- # read -r var val 00:05:59.000 03:17:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.000 03:17:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.000 03:17:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.000 03:17:23 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:59.000 03:17:23 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:59.000 03:17:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.000 03:17:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.000 03:17:23 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:59.000 03:17:23 -- accel/accel.sh@40 -- # local IFS=, 00:05:59.000 03:17:23 -- accel/accel.sh@41 -- # jq -r . 00:05:59.000 [2024-04-27 03:17:23.895442] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:05:59.000 [2024-04-27 03:17:23.895503] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1346861 ] 00:05:59.000 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.000 [2024-04-27 03:17:23.957719] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.258 [2024-04-27 03:17:24.078814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val= 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val= 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val= 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val=0x1 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val= 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val= 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val=compress 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@23 -- # accel_opc=compress 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val= 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val=software 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@22 -- # accel_module=software 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.258 03:17:24 -- accel/accel.sh@20 -- # val=32 00:05:59.258 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.258 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.259 03:17:24 -- accel/accel.sh@20 -- # val=32 00:05:59.259 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.259 03:17:24 -- accel/accel.sh@20 -- # val=1 00:05:59.259 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.259 03:17:24 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:59.259 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.259 03:17:24 -- accel/accel.sh@20 -- # val=No 00:05:59.259 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.259 03:17:24 -- accel/accel.sh@20 -- # val= 00:05:59.259 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:05:59.259 03:17:24 -- accel/accel.sh@20 -- # val= 00:05:59.259 03:17:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # IFS=: 00:05:59.259 03:17:24 -- accel/accel.sh@19 -- # read -r var val 00:06:00.633 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.633 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.633 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.633 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.633 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.633 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.633 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.633 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.633 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.633 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.633 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.633 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.633 03:17:25 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:00.633 03:17:25 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:06:00.633 03:17:25 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.633 00:06:00.633 real 0m1.491s 00:06:00.633 user 0m1.343s 00:06:00.633 sys 0m0.150s 00:06:00.633 03:17:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:00.633 03:17:25 -- common/autotest_common.sh@10 -- # set +x 00:06:00.633 ************************************ 00:06:00.633 END TEST accel_comp 00:06:00.633 ************************************ 00:06:00.633 03:17:25 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:00.633 03:17:25 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:00.633 03:17:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.633 03:17:25 -- common/autotest_common.sh@10 -- # set +x 00:06:00.633 ************************************ 00:06:00.633 START TEST accel_decomp 00:06:00.633 ************************************ 00:06:00.633 03:17:25 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:00.633 03:17:25 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.633 03:17:25 -- accel/accel.sh@17 -- # local accel_module 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.633 03:17:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:00.633 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.633 03:17:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:00.633 03:17:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.633 03:17:25 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:00.633 03:17:25 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:00.633 03:17:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.633 03:17:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.633 03:17:25 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:00.633 03:17:25 -- accel/accel.sh@40 -- # local IFS=, 00:06:00.633 03:17:25 -- accel/accel.sh@41 -- # jq -r . 00:06:00.633 [2024-04-27 03:17:25.509953] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:00.633 [2024-04-27 03:17:25.510013] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1347071 ] 00:06:00.633 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.633 [2024-04-27 03:17:25.572295] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.892 [2024-04-27 03:17:25.693244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.892 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.892 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.892 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.892 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val=0x1 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val=decompress 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val=software 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@22 -- # accel_module=software 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val=32 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val=32 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val=1 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val=Yes 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:00.893 03:17:25 -- accel/accel.sh@20 -- # val= 00:06:00.893 03:17:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # IFS=: 00:06:00.893 03:17:25 -- accel/accel.sh@19 -- # read -r var val 00:06:02.267 03:17:26 -- accel/accel.sh@20 -- # val= 00:06:02.267 03:17:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # IFS=: 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # read -r var val 00:06:02.267 03:17:26 -- accel/accel.sh@20 -- # val= 00:06:02.267 03:17:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # IFS=: 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # read -r var val 00:06:02.267 03:17:26 -- accel/accel.sh@20 -- # val= 00:06:02.267 03:17:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # IFS=: 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # read -r var val 00:06:02.267 03:17:26 -- accel/accel.sh@20 -- # val= 00:06:02.267 03:17:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # IFS=: 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # read -r var val 00:06:02.267 03:17:26 -- accel/accel.sh@20 -- # val= 00:06:02.267 03:17:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # IFS=: 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # read -r var val 00:06:02.267 03:17:26 -- accel/accel.sh@20 -- # val= 00:06:02.267 03:17:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # IFS=: 00:06:02.267 03:17:26 -- accel/accel.sh@19 -- # read -r var val 00:06:02.267 03:17:26 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:02.267 03:17:26 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:02.268 03:17:26 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:02.268 00:06:02.268 real 0m1.490s 00:06:02.268 user 0m1.349s 00:06:02.268 sys 0m0.144s 00:06:02.268 03:17:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:02.268 03:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.268 ************************************ 00:06:02.268 END TEST accel_decomp 00:06:02.268 ************************************ 00:06:02.268 03:17:27 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:02.268 03:17:27 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:02.268 03:17:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.268 03:17:27 -- common/autotest_common.sh@10 -- # set +x 00:06:02.268 ************************************ 00:06:02.268 START TEST accel_decmop_full 00:06:02.268 ************************************ 00:06:02.268 03:17:27 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:02.268 03:17:27 -- accel/accel.sh@16 -- # local accel_opc 00:06:02.268 03:17:27 -- accel/accel.sh@17 -- # local accel_module 00:06:02.268 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.268 03:17:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:02.268 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.268 03:17:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:02.268 03:17:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.268 03:17:27 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:02.268 03:17:27 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:02.268 03:17:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.268 03:17:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.268 03:17:27 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:02.268 03:17:27 -- accel/accel.sh@40 -- # local IFS=, 00:06:02.268 03:17:27 -- accel/accel.sh@41 -- # jq -r . 00:06:02.268 [2024-04-27 03:17:27.122991] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:02.268 [2024-04-27 03:17:27.123055] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1347241 ] 00:06:02.268 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.268 [2024-04-27 03:17:27.184775] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.527 [2024-04-27 03:17:27.304892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val= 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val= 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val= 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val=0x1 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val= 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val= 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val=decompress 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val= 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val=software 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@22 -- # accel_module=software 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val=32 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val=32 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val=1 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val=Yes 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val= 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:02.527 03:17:27 -- accel/accel.sh@20 -- # val= 00:06:02.527 03:17:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # IFS=: 00:06:02.527 03:17:27 -- accel/accel.sh@19 -- # read -r var val 00:06:03.900 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:03.900 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:03.900 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:03.900 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:03.900 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:03.900 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:03.900 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:03.900 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:03.900 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:03.900 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:03.900 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:03.900 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:03.900 03:17:28 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:03.900 03:17:28 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:03.900 03:17:28 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:03.900 00:06:03.900 real 0m1.491s 00:06:03.900 user 0m1.352s 00:06:03.900 sys 0m0.141s 00:06:03.900 03:17:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:03.900 03:17:28 -- common/autotest_common.sh@10 -- # set +x 00:06:03.900 ************************************ 00:06:03.900 END TEST accel_decmop_full 00:06:03.900 ************************************ 00:06:03.900 03:17:28 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:03.900 03:17:28 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:03.900 03:17:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.900 03:17:28 -- common/autotest_common.sh@10 -- # set +x 00:06:03.900 ************************************ 00:06:03.900 START TEST accel_decomp_mcore 00:06:03.900 ************************************ 00:06:03.900 03:17:28 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:03.900 03:17:28 -- accel/accel.sh@16 -- # local accel_opc 00:06:03.900 03:17:28 -- accel/accel.sh@17 -- # local accel_module 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:03.900 03:17:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:03.900 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:03.900 03:17:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:03.900 03:17:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.900 03:17:28 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:03.900 03:17:28 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:03.900 03:17:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.900 03:17:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.900 03:17:28 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:03.900 03:17:28 -- accel/accel.sh@40 -- # local IFS=, 00:06:03.900 03:17:28 -- accel/accel.sh@41 -- # jq -r . 00:06:03.900 [2024-04-27 03:17:28.739050] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:03.900 [2024-04-27 03:17:28.739115] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1347524 ] 00:06:03.900 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.900 [2024-04-27 03:17:28.799677] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:04.159 [2024-04-27 03:17:28.923360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:04.159 [2024-04-27 03:17:28.923416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:04.159 [2024-04-27 03:17:28.923467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:04.159 [2024-04-27 03:17:28.923470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val=0xf 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val=decompress 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val=software 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@22 -- # accel_module=software 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val=32 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val=32 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val=1 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val=Yes 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:04.159 03:17:28 -- accel/accel.sh@20 -- # val= 00:06:04.159 03:17:28 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # IFS=: 00:06:04.159 03:17:28 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.533 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.533 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.533 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.533 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.533 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.533 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.533 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.533 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.533 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:05.533 03:17:30 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:05.533 03:17:30 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:05.533 00:06:05.533 real 0m1.481s 00:06:05.533 user 0m4.763s 00:06:05.533 sys 0m0.151s 00:06:05.533 03:17:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:05.533 03:17:30 -- common/autotest_common.sh@10 -- # set +x 00:06:05.533 ************************************ 00:06:05.533 END TEST accel_decomp_mcore 00:06:05.533 ************************************ 00:06:05.533 03:17:30 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:05.533 03:17:30 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:05.533 03:17:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.533 03:17:30 -- common/autotest_common.sh@10 -- # set +x 00:06:05.533 ************************************ 00:06:05.533 START TEST accel_decomp_full_mcore 00:06:05.533 ************************************ 00:06:05.533 03:17:30 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:05.533 03:17:30 -- accel/accel.sh@16 -- # local accel_opc 00:06:05.533 03:17:30 -- accel/accel.sh@17 -- # local accel_module 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.533 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.533 03:17:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:05.533 03:17:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:05.533 03:17:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.533 03:17:30 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:05.533 03:17:30 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:05.533 03:17:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.533 03:17:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.533 03:17:30 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:05.533 03:17:30 -- accel/accel.sh@40 -- # local IFS=, 00:06:05.533 03:17:30 -- accel/accel.sh@41 -- # jq -r . 00:06:05.533 [2024-04-27 03:17:30.337624] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:05.533 [2024-04-27 03:17:30.337686] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1347689 ] 00:06:05.533 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.533 [2024-04-27 03:17:30.399734] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:05.791 [2024-04-27 03:17:30.524146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:05.791 [2024-04-27 03:17:30.524198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:05.791 [2024-04-27 03:17:30.524257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.791 [2024-04-27 03:17:30.524257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val=0xf 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val=decompress 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.791 03:17:30 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val=software 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.791 03:17:30 -- accel/accel.sh@22 -- # accel_module=software 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.791 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.791 03:17:30 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:05.791 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.792 03:17:30 -- accel/accel.sh@20 -- # val=32 00:06:05.792 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.792 03:17:30 -- accel/accel.sh@20 -- # val=32 00:06:05.792 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.792 03:17:30 -- accel/accel.sh@20 -- # val=1 00:06:05.792 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.792 03:17:30 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:05.792 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.792 03:17:30 -- accel/accel.sh@20 -- # val=Yes 00:06:05.792 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.792 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.792 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:05.792 03:17:30 -- accel/accel.sh@20 -- # val= 00:06:05.792 03:17:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # IFS=: 00:06:05.792 03:17:30 -- accel/accel.sh@19 -- # read -r var val 00:06:07.163 03:17:31 -- accel/accel.sh@20 -- # val= 00:06:07.163 03:17:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # IFS=: 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # read -r var val 00:06:07.163 03:17:31 -- accel/accel.sh@20 -- # val= 00:06:07.163 03:17:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # IFS=: 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # read -r var val 00:06:07.163 03:17:31 -- accel/accel.sh@20 -- # val= 00:06:07.163 03:17:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # IFS=: 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # read -r var val 00:06:07.163 03:17:31 -- accel/accel.sh@20 -- # val= 00:06:07.163 03:17:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # IFS=: 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # read -r var val 00:06:07.163 03:17:31 -- accel/accel.sh@20 -- # val= 00:06:07.163 03:17:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # IFS=: 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # read -r var val 00:06:07.163 03:17:31 -- accel/accel.sh@20 -- # val= 00:06:07.163 03:17:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # IFS=: 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # read -r var val 00:06:07.163 03:17:31 -- accel/accel.sh@20 -- # val= 00:06:07.163 03:17:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # IFS=: 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # read -r var val 00:06:07.163 03:17:31 -- accel/accel.sh@20 -- # val= 00:06:07.163 03:17:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # IFS=: 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # read -r var val 00:06:07.163 03:17:31 -- accel/accel.sh@20 -- # val= 00:06:07.163 03:17:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # IFS=: 00:06:07.163 03:17:31 -- accel/accel.sh@19 -- # read -r var val 00:06:07.163 03:17:31 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:07.163 03:17:31 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:07.163 03:17:31 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.163 00:06:07.163 real 0m1.488s 00:06:07.163 user 0m4.803s 00:06:07.163 sys 0m0.152s 00:06:07.163 03:17:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:07.163 03:17:31 -- common/autotest_common.sh@10 -- # set +x 00:06:07.163 ************************************ 00:06:07.163 END TEST accel_decomp_full_mcore 00:06:07.164 ************************************ 00:06:07.164 03:17:31 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:07.164 03:17:31 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:07.164 03:17:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.164 03:17:31 -- common/autotest_common.sh@10 -- # set +x 00:06:07.164 ************************************ 00:06:07.164 START TEST accel_decomp_mthread 00:06:07.164 ************************************ 00:06:07.164 03:17:31 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:07.164 03:17:31 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.164 03:17:31 -- accel/accel.sh@17 -- # local accel_module 00:06:07.164 03:17:31 -- accel/accel.sh@19 -- # IFS=: 00:06:07.164 03:17:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:07.164 03:17:31 -- accel/accel.sh@19 -- # read -r var val 00:06:07.164 03:17:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:07.164 03:17:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.164 03:17:31 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:07.164 03:17:31 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:07.164 03:17:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.164 03:17:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.164 03:17:31 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:07.164 03:17:31 -- accel/accel.sh@40 -- # local IFS=, 00:06:07.164 03:17:31 -- accel/accel.sh@41 -- # jq -r . 00:06:07.164 [2024-04-27 03:17:31.946224] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:07.164 [2024-04-27 03:17:31.946299] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1347977 ] 00:06:07.164 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.164 [2024-04-27 03:17:32.007791] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.164 [2024-04-27 03:17:32.128860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val= 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val= 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val= 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val=0x1 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val= 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val= 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val=decompress 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val= 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val=software 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@22 -- # accel_module=software 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val=32 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val=32 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val=2 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val=Yes 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val= 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:07.422 03:17:32 -- accel/accel.sh@20 -- # val= 00:06:07.422 03:17:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # IFS=: 00:06:07.422 03:17:32 -- accel/accel.sh@19 -- # read -r var val 00:06:08.793 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:08.793 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:08.793 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:08.793 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:08.793 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:08.793 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:08.793 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:08.793 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:08.793 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:08.793 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:08.793 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:08.793 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:08.793 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:08.793 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:08.793 03:17:33 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:08.793 03:17:33 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:08.793 03:17:33 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:08.793 00:06:08.793 real 0m1.494s 00:06:08.793 user 0m1.347s 00:06:08.793 sys 0m0.150s 00:06:08.793 03:17:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:08.793 03:17:33 -- common/autotest_common.sh@10 -- # set +x 00:06:08.793 ************************************ 00:06:08.793 END TEST accel_decomp_mthread 00:06:08.793 ************************************ 00:06:08.793 03:17:33 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:08.793 03:17:33 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:08.793 03:17:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.793 03:17:33 -- common/autotest_common.sh@10 -- # set +x 00:06:08.793 ************************************ 00:06:08.793 START TEST accel_deomp_full_mthread 00:06:08.793 ************************************ 00:06:08.793 03:17:33 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:08.793 03:17:33 -- accel/accel.sh@16 -- # local accel_opc 00:06:08.793 03:17:33 -- accel/accel.sh@17 -- # local accel_module 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:08.793 03:17:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:08.793 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:08.793 03:17:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:08.793 03:17:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.793 03:17:33 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:08.793 03:17:33 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:08.793 03:17:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.793 03:17:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.793 03:17:33 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:08.793 03:17:33 -- accel/accel.sh@40 -- # local IFS=, 00:06:08.793 03:17:33 -- accel/accel.sh@41 -- # jq -r . 00:06:08.793 [2024-04-27 03:17:33.568112] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:08.793 [2024-04-27 03:17:33.568179] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1348139 ] 00:06:08.793 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.793 [2024-04-27 03:17:33.632892] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.793 [2024-04-27 03:17:33.753273] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val=0x1 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val=decompress 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val=software 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@22 -- # accel_module=software 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val=32 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val=32 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.051 03:17:33 -- accel/accel.sh@20 -- # val=2 00:06:09.051 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.051 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.052 03:17:33 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:09.052 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.052 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.052 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.052 03:17:33 -- accel/accel.sh@20 -- # val=Yes 00:06:09.052 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.052 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.052 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.052 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:09.052 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.052 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.052 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:09.052 03:17:33 -- accel/accel.sh@20 -- # val= 00:06:09.052 03:17:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.052 03:17:33 -- accel/accel.sh@19 -- # IFS=: 00:06:09.052 03:17:33 -- accel/accel.sh@19 -- # read -r var val 00:06:10.425 03:17:35 -- accel/accel.sh@20 -- # val= 00:06:10.425 03:17:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # IFS=: 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # read -r var val 00:06:10.425 03:17:35 -- accel/accel.sh@20 -- # val= 00:06:10.425 03:17:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # IFS=: 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # read -r var val 00:06:10.425 03:17:35 -- accel/accel.sh@20 -- # val= 00:06:10.425 03:17:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # IFS=: 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # read -r var val 00:06:10.425 03:17:35 -- accel/accel.sh@20 -- # val= 00:06:10.425 03:17:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # IFS=: 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # read -r var val 00:06:10.425 03:17:35 -- accel/accel.sh@20 -- # val= 00:06:10.425 03:17:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # IFS=: 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # read -r var val 00:06:10.425 03:17:35 -- accel/accel.sh@20 -- # val= 00:06:10.425 03:17:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # IFS=: 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # read -r var val 00:06:10.425 03:17:35 -- accel/accel.sh@20 -- # val= 00:06:10.425 03:17:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # IFS=: 00:06:10.425 03:17:35 -- accel/accel.sh@19 -- # read -r var val 00:06:10.425 03:17:35 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:10.425 03:17:35 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:10.425 03:17:35 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.425 00:06:10.425 real 0m1.529s 00:06:10.425 user 0m1.391s 00:06:10.425 sys 0m0.140s 00:06:10.425 03:17:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:10.425 03:17:35 -- common/autotest_common.sh@10 -- # set +x 00:06:10.425 ************************************ 00:06:10.425 END TEST accel_deomp_full_mthread 00:06:10.425 ************************************ 00:06:10.425 03:17:35 -- accel/accel.sh@124 -- # [[ n == y ]] 00:06:10.425 03:17:35 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:10.425 03:17:35 -- accel/accel.sh@137 -- # build_accel_config 00:06:10.425 03:17:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:10.425 03:17:35 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:10.425 03:17:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.425 03:17:35 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:10.425 03:17:35 -- common/autotest_common.sh@10 -- # set +x 00:06:10.425 03:17:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.425 03:17:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.425 03:17:35 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:10.425 03:17:35 -- accel/accel.sh@40 -- # local IFS=, 00:06:10.425 03:17:35 -- accel/accel.sh@41 -- # jq -r . 00:06:10.425 ************************************ 00:06:10.425 START TEST accel_dif_functional_tests 00:06:10.425 ************************************ 00:06:10.425 03:17:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:10.425 [2024-04-27 03:17:35.238944] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:10.425 [2024-04-27 03:17:35.239007] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1348382 ] 00:06:10.425 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.425 [2024-04-27 03:17:35.297690] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:10.683 [2024-04-27 03:17:35.418866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:10.683 [2024-04-27 03:17:35.418920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:10.683 [2024-04-27 03:17:35.418923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.683 00:06:10.683 00:06:10.683 CUnit - A unit testing framework for C - Version 2.1-3 00:06:10.683 http://cunit.sourceforge.net/ 00:06:10.683 00:06:10.683 00:06:10.683 Suite: accel_dif 00:06:10.683 Test: verify: DIF generated, GUARD check ...passed 00:06:10.683 Test: verify: DIF generated, APPTAG check ...passed 00:06:10.683 Test: verify: DIF generated, REFTAG check ...passed 00:06:10.683 Test: verify: DIF not generated, GUARD check ...[2024-04-27 03:17:35.522099] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:10.683 [2024-04-27 03:17:35.522171] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:10.683 passed 00:06:10.683 Test: verify: DIF not generated, APPTAG check ...[2024-04-27 03:17:35.522216] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:10.683 [2024-04-27 03:17:35.522255] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:10.683 passed 00:06:10.683 Test: verify: DIF not generated, REFTAG check ...[2024-04-27 03:17:35.522293] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:10.683 [2024-04-27 03:17:35.522326] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:10.683 passed 00:06:10.683 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:10.683 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-27 03:17:35.522397] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:10.683 passed 00:06:10.683 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:10.683 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:10.683 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:10.683 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-27 03:17:35.522567] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:10.683 passed 00:06:10.683 Test: generate copy: DIF generated, GUARD check ...passed 00:06:10.683 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:10.683 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:10.683 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:10.683 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:10.683 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:10.683 Test: generate copy: iovecs-len validate ...[2024-04-27 03:17:35.522827] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:10.683 passed 00:06:10.683 Test: generate copy: buffer alignment validate ...passed 00:06:10.683 00:06:10.683 Run Summary: Type Total Ran Passed Failed Inactive 00:06:10.683 suites 1 1 n/a 0 0 00:06:10.683 tests 20 20 20 0 0 00:06:10.683 asserts 204 204 204 0 n/a 00:06:10.683 00:06:10.683 Elapsed time = 0.003 seconds 00:06:10.942 00:06:10.942 real 0m0.592s 00:06:10.942 user 0m0.871s 00:06:10.942 sys 0m0.180s 00:06:10.942 03:17:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:10.942 03:17:35 -- common/autotest_common.sh@10 -- # set +x 00:06:10.942 ************************************ 00:06:10.942 END TEST accel_dif_functional_tests 00:06:10.942 ************************************ 00:06:10.942 00:06:10.942 real 0m36.024s 00:06:10.942 user 0m38.366s 00:06:10.942 sys 0m5.560s 00:06:10.942 03:17:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:10.942 03:17:35 -- common/autotest_common.sh@10 -- # set +x 00:06:10.942 ************************************ 00:06:10.942 END TEST accel 00:06:10.942 ************************************ 00:06:10.942 03:17:35 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:10.942 03:17:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:10.942 03:17:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.942 03:17:35 -- common/autotest_common.sh@10 -- # set +x 00:06:11.200 ************************************ 00:06:11.200 START TEST accel_rpc 00:06:11.200 ************************************ 00:06:11.200 03:17:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:11.200 * Looking for test storage... 00:06:11.200 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:11.200 03:17:35 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:11.200 03:17:35 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1348505 00:06:11.200 03:17:35 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:11.200 03:17:35 -- accel/accel_rpc.sh@15 -- # waitforlisten 1348505 00:06:11.200 03:17:35 -- common/autotest_common.sh@817 -- # '[' -z 1348505 ']' 00:06:11.200 03:17:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:11.200 03:17:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:11.200 03:17:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:11.200 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:11.200 03:17:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:11.200 03:17:35 -- common/autotest_common.sh@10 -- # set +x 00:06:11.200 [2024-04-27 03:17:36.046944] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:11.200 [2024-04-27 03:17:36.047038] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1348505 ] 00:06:11.200 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.200 [2024-04-27 03:17:36.103546] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.459 [2024-04-27 03:17:36.205802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.459 03:17:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:11.459 03:17:36 -- common/autotest_common.sh@850 -- # return 0 00:06:11.459 03:17:36 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:11.459 03:17:36 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:11.459 03:17:36 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:11.459 03:17:36 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:11.459 03:17:36 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:11.459 03:17:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:11.459 03:17:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.459 03:17:36 -- common/autotest_common.sh@10 -- # set +x 00:06:11.459 ************************************ 00:06:11.459 START TEST accel_assign_opcode 00:06:11.459 ************************************ 00:06:11.459 03:17:36 -- common/autotest_common.sh@1111 -- # accel_assign_opcode_test_suite 00:06:11.459 03:17:36 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:11.459 03:17:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:11.459 03:17:36 -- common/autotest_common.sh@10 -- # set +x 00:06:11.459 [2024-04-27 03:17:36.342589] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:11.459 03:17:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:11.459 03:17:36 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:11.459 03:17:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:11.459 03:17:36 -- common/autotest_common.sh@10 -- # set +x 00:06:11.459 [2024-04-27 03:17:36.350594] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:11.459 03:17:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:11.459 03:17:36 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:11.459 03:17:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:11.459 03:17:36 -- common/autotest_common.sh@10 -- # set +x 00:06:11.717 03:17:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:11.717 03:17:36 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:11.717 03:17:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:11.717 03:17:36 -- common/autotest_common.sh@10 -- # set +x 00:06:11.717 03:17:36 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:11.717 03:17:36 -- accel/accel_rpc.sh@42 -- # grep software 00:06:11.717 03:17:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:11.717 software 00:06:11.717 00:06:11.717 real 0m0.309s 00:06:11.717 user 0m0.041s 00:06:11.717 sys 0m0.008s 00:06:11.717 03:17:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:11.717 03:17:36 -- common/autotest_common.sh@10 -- # set +x 00:06:11.717 ************************************ 00:06:11.717 END TEST accel_assign_opcode 00:06:11.717 ************************************ 00:06:11.717 03:17:36 -- accel/accel_rpc.sh@55 -- # killprocess 1348505 00:06:11.717 03:17:36 -- common/autotest_common.sh@936 -- # '[' -z 1348505 ']' 00:06:11.717 03:17:36 -- common/autotest_common.sh@940 -- # kill -0 1348505 00:06:11.717 03:17:36 -- common/autotest_common.sh@941 -- # uname 00:06:11.717 03:17:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:11.717 03:17:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1348505 00:06:11.975 03:17:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:11.975 03:17:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:11.975 03:17:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1348505' 00:06:11.975 killing process with pid 1348505 00:06:11.975 03:17:36 -- common/autotest_common.sh@955 -- # kill 1348505 00:06:11.975 03:17:36 -- common/autotest_common.sh@960 -- # wait 1348505 00:06:12.234 00:06:12.234 real 0m1.226s 00:06:12.234 user 0m1.172s 00:06:12.234 sys 0m0.468s 00:06:12.234 03:17:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:12.234 03:17:37 -- common/autotest_common.sh@10 -- # set +x 00:06:12.234 ************************************ 00:06:12.234 END TEST accel_rpc 00:06:12.234 ************************************ 00:06:12.234 03:17:37 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:12.234 03:17:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:12.234 03:17:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.234 03:17:37 -- common/autotest_common.sh@10 -- # set +x 00:06:12.493 ************************************ 00:06:12.493 START TEST app_cmdline 00:06:12.493 ************************************ 00:06:12.493 03:17:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:12.493 * Looking for test storage... 00:06:12.493 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:12.493 03:17:37 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:12.493 03:17:37 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1348724 00:06:12.493 03:17:37 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:12.493 03:17:37 -- app/cmdline.sh@18 -- # waitforlisten 1348724 00:06:12.493 03:17:37 -- common/autotest_common.sh@817 -- # '[' -z 1348724 ']' 00:06:12.493 03:17:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:12.493 03:17:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:12.493 03:17:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:12.493 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:12.493 03:17:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:12.493 03:17:37 -- common/autotest_common.sh@10 -- # set +x 00:06:12.493 [2024-04-27 03:17:37.408381] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:12.493 [2024-04-27 03:17:37.408480] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1348724 ] 00:06:12.493 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.493 [2024-04-27 03:17:37.464951] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.754 [2024-04-27 03:17:37.571730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.012 03:17:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:13.012 03:17:37 -- common/autotest_common.sh@850 -- # return 0 00:06:13.012 03:17:37 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:13.270 { 00:06:13.270 "version": "SPDK v24.05-pre git sha1 33914772a", 00:06:13.270 "fields": { 00:06:13.270 "major": 24, 00:06:13.270 "minor": 5, 00:06:13.270 "patch": 0, 00:06:13.270 "suffix": "-pre", 00:06:13.270 "commit": "33914772a" 00:06:13.270 } 00:06:13.270 } 00:06:13.270 03:17:38 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:13.270 03:17:38 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:13.270 03:17:38 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:13.270 03:17:38 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:13.270 03:17:38 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:13.270 03:17:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:13.270 03:17:38 -- common/autotest_common.sh@10 -- # set +x 00:06:13.270 03:17:38 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:13.270 03:17:38 -- app/cmdline.sh@26 -- # sort 00:06:13.270 03:17:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:13.270 03:17:38 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:13.270 03:17:38 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:13.270 03:17:38 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:13.270 03:17:38 -- common/autotest_common.sh@638 -- # local es=0 00:06:13.270 03:17:38 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:13.270 03:17:38 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:13.270 03:17:38 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:13.270 03:17:38 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:13.270 03:17:38 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:13.270 03:17:38 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:13.270 03:17:38 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:13.270 03:17:38 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:13.270 03:17:38 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:13.270 03:17:38 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:13.528 request: 00:06:13.528 { 00:06:13.528 "method": "env_dpdk_get_mem_stats", 00:06:13.528 "req_id": 1 00:06:13.528 } 00:06:13.529 Got JSON-RPC error response 00:06:13.529 response: 00:06:13.529 { 00:06:13.529 "code": -32601, 00:06:13.529 "message": "Method not found" 00:06:13.529 } 00:06:13.529 03:17:38 -- common/autotest_common.sh@641 -- # es=1 00:06:13.529 03:17:38 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:13.529 03:17:38 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:13.529 03:17:38 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:13.529 03:17:38 -- app/cmdline.sh@1 -- # killprocess 1348724 00:06:13.529 03:17:38 -- common/autotest_common.sh@936 -- # '[' -z 1348724 ']' 00:06:13.529 03:17:38 -- common/autotest_common.sh@940 -- # kill -0 1348724 00:06:13.529 03:17:38 -- common/autotest_common.sh@941 -- # uname 00:06:13.529 03:17:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:13.529 03:17:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1348724 00:06:13.529 03:17:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:13.529 03:17:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:13.529 03:17:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1348724' 00:06:13.529 killing process with pid 1348724 00:06:13.529 03:17:38 -- common/autotest_common.sh@955 -- # kill 1348724 00:06:13.529 03:17:38 -- common/autotest_common.sh@960 -- # wait 1348724 00:06:14.095 00:06:14.095 real 0m1.597s 00:06:14.095 user 0m1.963s 00:06:14.095 sys 0m0.468s 00:06:14.095 03:17:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:14.095 03:17:38 -- common/autotest_common.sh@10 -- # set +x 00:06:14.095 ************************************ 00:06:14.095 END TEST app_cmdline 00:06:14.095 ************************************ 00:06:14.095 03:17:38 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:14.095 03:17:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:14.095 03:17:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.095 03:17:38 -- common/autotest_common.sh@10 -- # set +x 00:06:14.095 ************************************ 00:06:14.095 START TEST version 00:06:14.095 ************************************ 00:06:14.095 03:17:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:14.353 * Looking for test storage... 00:06:14.353 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:14.353 03:17:39 -- app/version.sh@17 -- # get_header_version major 00:06:14.353 03:17:39 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:14.353 03:17:39 -- app/version.sh@14 -- # cut -f2 00:06:14.353 03:17:39 -- app/version.sh@14 -- # tr -d '"' 00:06:14.353 03:17:39 -- app/version.sh@17 -- # major=24 00:06:14.353 03:17:39 -- app/version.sh@18 -- # get_header_version minor 00:06:14.353 03:17:39 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:14.353 03:17:39 -- app/version.sh@14 -- # cut -f2 00:06:14.353 03:17:39 -- app/version.sh@14 -- # tr -d '"' 00:06:14.353 03:17:39 -- app/version.sh@18 -- # minor=5 00:06:14.353 03:17:39 -- app/version.sh@19 -- # get_header_version patch 00:06:14.354 03:17:39 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:14.354 03:17:39 -- app/version.sh@14 -- # cut -f2 00:06:14.354 03:17:39 -- app/version.sh@14 -- # tr -d '"' 00:06:14.354 03:17:39 -- app/version.sh@19 -- # patch=0 00:06:14.354 03:17:39 -- app/version.sh@20 -- # get_header_version suffix 00:06:14.354 03:17:39 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:14.354 03:17:39 -- app/version.sh@14 -- # cut -f2 00:06:14.354 03:17:39 -- app/version.sh@14 -- # tr -d '"' 00:06:14.354 03:17:39 -- app/version.sh@20 -- # suffix=-pre 00:06:14.354 03:17:39 -- app/version.sh@22 -- # version=24.5 00:06:14.354 03:17:39 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:14.354 03:17:39 -- app/version.sh@28 -- # version=24.5rc0 00:06:14.354 03:17:39 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:14.354 03:17:39 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:14.354 03:17:39 -- app/version.sh@30 -- # py_version=24.5rc0 00:06:14.354 03:17:39 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:06:14.354 00:06:14.354 real 0m0.112s 00:06:14.354 user 0m0.059s 00:06:14.354 sys 0m0.076s 00:06:14.354 03:17:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:14.354 03:17:39 -- common/autotest_common.sh@10 -- # set +x 00:06:14.354 ************************************ 00:06:14.354 END TEST version 00:06:14.354 ************************************ 00:06:14.354 03:17:39 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:06:14.354 03:17:39 -- spdk/autotest.sh@194 -- # uname -s 00:06:14.354 03:17:39 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:06:14.354 03:17:39 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:06:14.354 03:17:39 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:06:14.354 03:17:39 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:06:14.354 03:17:39 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:06:14.354 03:17:39 -- spdk/autotest.sh@258 -- # timing_exit lib 00:06:14.354 03:17:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:14.354 03:17:39 -- common/autotest_common.sh@10 -- # set +x 00:06:14.354 03:17:39 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:06:14.354 03:17:39 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:06:14.354 03:17:39 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:06:14.354 03:17:39 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:06:14.354 03:17:39 -- spdk/autotest.sh@281 -- # '[' tcp = rdma ']' 00:06:14.354 03:17:39 -- spdk/autotest.sh@284 -- # '[' tcp = tcp ']' 00:06:14.354 03:17:39 -- spdk/autotest.sh@285 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:14.354 03:17:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:14.354 03:17:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.354 03:17:39 -- common/autotest_common.sh@10 -- # set +x 00:06:14.354 ************************************ 00:06:14.354 START TEST nvmf_tcp 00:06:14.354 ************************************ 00:06:14.354 03:17:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:14.612 * Looking for test storage... 00:06:14.612 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:14.612 03:17:39 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:14.612 03:17:39 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:14.612 03:17:39 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:14.612 03:17:39 -- nvmf/common.sh@7 -- # uname -s 00:06:14.612 03:17:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:14.612 03:17:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:14.613 03:17:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:14.613 03:17:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:14.613 03:17:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:14.613 03:17:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:14.613 03:17:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:14.613 03:17:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:14.613 03:17:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:14.613 03:17:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:14.613 03:17:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:06:14.613 03:17:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:06:14.613 03:17:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:14.613 03:17:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:14.613 03:17:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:14.613 03:17:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:14.613 03:17:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:14.613 03:17:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:14.613 03:17:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:14.613 03:17:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:14.613 03:17:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:14.613 03:17:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:14.613 03:17:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:14.613 03:17:39 -- paths/export.sh@5 -- # export PATH 00:06:14.613 03:17:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:14.613 03:17:39 -- nvmf/common.sh@47 -- # : 0 00:06:14.613 03:17:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:14.613 03:17:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:14.613 03:17:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:14.613 03:17:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:14.613 03:17:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:14.613 03:17:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:14.613 03:17:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:14.613 03:17:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:14.613 03:17:39 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:14.613 03:17:39 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:14.613 03:17:39 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:14.613 03:17:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:14.613 03:17:39 -- common/autotest_common.sh@10 -- # set +x 00:06:14.613 03:17:39 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:14.613 03:17:39 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:14.613 03:17:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:14.613 03:17:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.613 03:17:39 -- common/autotest_common.sh@10 -- # set +x 00:06:14.613 ************************************ 00:06:14.613 START TEST nvmf_example 00:06:14.613 ************************************ 00:06:14.613 03:17:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:14.613 * Looking for test storage... 00:06:14.613 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:14.613 03:17:39 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:14.613 03:17:39 -- nvmf/common.sh@7 -- # uname -s 00:06:14.613 03:17:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:14.613 03:17:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:14.613 03:17:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:14.613 03:17:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:14.613 03:17:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:14.613 03:17:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:14.613 03:17:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:14.613 03:17:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:14.613 03:17:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:14.613 03:17:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:14.613 03:17:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:06:14.613 03:17:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:06:14.613 03:17:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:14.613 03:17:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:14.613 03:17:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:14.613 03:17:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:14.613 03:17:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:14.613 03:17:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:14.613 03:17:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:14.613 03:17:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:14.613 03:17:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:14.613 03:17:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:14.613 03:17:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:14.613 03:17:39 -- paths/export.sh@5 -- # export PATH 00:06:14.613 03:17:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:14.613 03:17:39 -- nvmf/common.sh@47 -- # : 0 00:06:14.613 03:17:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:14.613 03:17:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:14.613 03:17:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:14.613 03:17:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:14.613 03:17:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:14.613 03:17:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:14.613 03:17:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:14.613 03:17:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:14.613 03:17:39 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:14.613 03:17:39 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:14.613 03:17:39 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:14.613 03:17:39 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:14.613 03:17:39 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:14.613 03:17:39 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:14.613 03:17:39 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:14.613 03:17:39 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:14.613 03:17:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:14.613 03:17:39 -- common/autotest_common.sh@10 -- # set +x 00:06:14.613 03:17:39 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:14.613 03:17:39 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:06:14.613 03:17:39 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:14.613 03:17:39 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:14.613 03:17:39 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:14.613 03:17:39 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:14.613 03:17:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:14.613 03:17:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:14.613 03:17:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:14.613 03:17:39 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:06:14.613 03:17:39 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:14.613 03:17:39 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:14.613 03:17:39 -- common/autotest_common.sh@10 -- # set +x 00:06:17.207 03:17:41 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:17.207 03:17:41 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:17.207 03:17:41 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:17.207 03:17:41 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:17.208 03:17:41 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:17.208 03:17:41 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:17.208 03:17:41 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:17.208 03:17:41 -- nvmf/common.sh@295 -- # net_devs=() 00:06:17.208 03:17:41 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:17.208 03:17:41 -- nvmf/common.sh@296 -- # e810=() 00:06:17.208 03:17:41 -- nvmf/common.sh@296 -- # local -ga e810 00:06:17.208 03:17:41 -- nvmf/common.sh@297 -- # x722=() 00:06:17.208 03:17:41 -- nvmf/common.sh@297 -- # local -ga x722 00:06:17.208 03:17:41 -- nvmf/common.sh@298 -- # mlx=() 00:06:17.208 03:17:41 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:17.208 03:17:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:17.208 03:17:41 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:17.208 03:17:41 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:06:17.208 03:17:41 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:17.208 03:17:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:17.208 03:17:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:06:17.208 Found 0000:09:00.0 (0x8086 - 0x159b) 00:06:17.208 03:17:41 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:17.208 03:17:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:06:17.208 Found 0000:09:00.1 (0x8086 - 0x159b) 00:06:17.208 03:17:41 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:17.208 03:17:41 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:17.208 03:17:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:17.208 03:17:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:17.208 03:17:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:17.208 03:17:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:06:17.208 Found net devices under 0000:09:00.0: cvl_0_0 00:06:17.208 03:17:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:17.208 03:17:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:17.208 03:17:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:17.208 03:17:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:17.208 03:17:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:17.208 03:17:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:06:17.208 Found net devices under 0000:09:00.1: cvl_0_1 00:06:17.208 03:17:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:17.208 03:17:41 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:17.208 03:17:41 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:17.208 03:17:41 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:06:17.208 03:17:41 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:17.208 03:17:41 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:17.208 03:17:41 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:17.208 03:17:41 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:06:17.208 03:17:41 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:17.208 03:17:41 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:17.208 03:17:41 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:06:17.208 03:17:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:17.208 03:17:41 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:17.208 03:17:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:06:17.208 03:17:41 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:06:17.208 03:17:41 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:06:17.208 03:17:41 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:17.208 03:17:41 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:17.208 03:17:41 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:17.208 03:17:41 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:06:17.208 03:17:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:17.208 03:17:41 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:17.208 03:17:41 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:17.208 03:17:41 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:06:17.208 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:17.208 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:06:17.208 00:06:17.208 --- 10.0.0.2 ping statistics --- 00:06:17.208 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:17.208 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:06:17.208 03:17:41 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:17.208 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:17.208 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:06:17.208 00:06:17.208 --- 10.0.0.1 ping statistics --- 00:06:17.208 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:17.208 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:06:17.208 03:17:41 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:17.208 03:17:41 -- nvmf/common.sh@411 -- # return 0 00:06:17.208 03:17:41 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:17.208 03:17:41 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:17.208 03:17:41 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:06:17.208 03:17:41 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:17.208 03:17:41 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:06:17.208 03:17:41 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:06:17.208 03:17:41 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:17.208 03:17:41 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:17.208 03:17:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:17.208 03:17:41 -- common/autotest_common.sh@10 -- # set +x 00:06:17.208 03:17:41 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:17.208 03:17:41 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:17.208 03:17:41 -- target/nvmf_example.sh@34 -- # nvmfpid=1350772 00:06:17.208 03:17:41 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:17.208 03:17:41 -- target/nvmf_example.sh@36 -- # waitforlisten 1350772 00:06:17.208 03:17:41 -- common/autotest_common.sh@817 -- # '[' -z 1350772 ']' 00:06:17.208 03:17:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:17.208 03:17:41 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:17.208 03:17:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:17.208 03:17:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:17.208 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:17.208 03:17:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:17.208 03:17:41 -- common/autotest_common.sh@10 -- # set +x 00:06:17.208 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.140 03:17:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:18.141 03:17:42 -- common/autotest_common.sh@850 -- # return 0 00:06:18.141 03:17:42 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:18.141 03:17:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:18.141 03:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:18.141 03:17:42 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:18.141 03:17:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:18.141 03:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:18.141 03:17:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:18.141 03:17:42 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:18.141 03:17:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:18.141 03:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:18.141 03:17:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:18.141 03:17:42 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:18.141 03:17:42 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:18.141 03:17:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:18.141 03:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:18.141 03:17:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:18.141 03:17:42 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:18.141 03:17:42 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:18.141 03:17:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:18.141 03:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:18.141 03:17:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:18.141 03:17:42 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:18.141 03:17:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:18.141 03:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:18.141 03:17:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:18.141 03:17:42 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:18.141 03:17:42 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:18.141 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.109 Initializing NVMe Controllers 00:06:28.109 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:28.109 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:28.109 Initialization complete. Launching workers. 00:06:28.109 ======================================================== 00:06:28.109 Latency(us) 00:06:28.109 Device Information : IOPS MiB/s Average min max 00:06:28.109 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15161.40 59.22 4221.84 875.62 15302.93 00:06:28.109 ======================================================== 00:06:28.109 Total : 15161.40 59.22 4221.84 875.62 15302.93 00:06:28.109 00:06:28.109 03:17:53 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:28.109 03:17:53 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:28.109 03:17:53 -- nvmf/common.sh@477 -- # nvmfcleanup 00:06:28.109 03:17:53 -- nvmf/common.sh@117 -- # sync 00:06:28.109 03:17:53 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:06:28.109 03:17:53 -- nvmf/common.sh@120 -- # set +e 00:06:28.109 03:17:53 -- nvmf/common.sh@121 -- # for i in {1..20} 00:06:28.109 03:17:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:06:28.109 rmmod nvme_tcp 00:06:28.109 rmmod nvme_fabrics 00:06:28.366 rmmod nvme_keyring 00:06:28.366 03:17:53 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:06:28.366 03:17:53 -- nvmf/common.sh@124 -- # set -e 00:06:28.366 03:17:53 -- nvmf/common.sh@125 -- # return 0 00:06:28.366 03:17:53 -- nvmf/common.sh@478 -- # '[' -n 1350772 ']' 00:06:28.366 03:17:53 -- nvmf/common.sh@479 -- # killprocess 1350772 00:06:28.366 03:17:53 -- common/autotest_common.sh@936 -- # '[' -z 1350772 ']' 00:06:28.366 03:17:53 -- common/autotest_common.sh@940 -- # kill -0 1350772 00:06:28.366 03:17:53 -- common/autotest_common.sh@941 -- # uname 00:06:28.366 03:17:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:28.366 03:17:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1350772 00:06:28.366 03:17:53 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:28.366 03:17:53 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:28.366 03:17:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1350772' 00:06:28.366 killing process with pid 1350772 00:06:28.366 03:17:53 -- common/autotest_common.sh@955 -- # kill 1350772 00:06:28.366 03:17:53 -- common/autotest_common.sh@960 -- # wait 1350772 00:06:28.625 nvmf threads initialize successfully 00:06:28.625 bdev subsystem init successfully 00:06:28.625 created a nvmf target service 00:06:28.625 create targets's poll groups done 00:06:28.625 all subsystems of target started 00:06:28.625 nvmf target is running 00:06:28.625 all subsystems of target stopped 00:06:28.625 destroy targets's poll groups done 00:06:28.625 destroyed the nvmf target service 00:06:28.625 bdev subsystem finish successfully 00:06:28.625 nvmf threads destroy successfully 00:06:28.625 03:17:53 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:06:28.625 03:17:53 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:06:28.625 03:17:53 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:06:28.625 03:17:53 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:28.625 03:17:53 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:06:28.625 03:17:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:28.625 03:17:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:28.625 03:17:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:30.529 03:17:55 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:06:30.529 03:17:55 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:30.529 03:17:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:30.529 03:17:55 -- common/autotest_common.sh@10 -- # set +x 00:06:30.529 00:06:30.529 real 0m15.974s 00:06:30.529 user 0m45.182s 00:06:30.529 sys 0m3.296s 00:06:30.529 03:17:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:30.529 03:17:55 -- common/autotest_common.sh@10 -- # set +x 00:06:30.529 ************************************ 00:06:30.529 END TEST nvmf_example 00:06:30.529 ************************************ 00:06:30.529 03:17:55 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:30.529 03:17:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:30.529 03:17:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.529 03:17:55 -- common/autotest_common.sh@10 -- # set +x 00:06:30.790 ************************************ 00:06:30.790 START TEST nvmf_filesystem 00:06:30.790 ************************************ 00:06:30.790 03:17:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:30.790 * Looking for test storage... 00:06:30.790 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:30.790 03:17:55 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:30.790 03:17:55 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:30.790 03:17:55 -- common/autotest_common.sh@34 -- # set -e 00:06:30.790 03:17:55 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:30.790 03:17:55 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:30.790 03:17:55 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:30.790 03:17:55 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:30.790 03:17:55 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:30.790 03:17:55 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:30.790 03:17:55 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:30.790 03:17:55 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:30.790 03:17:55 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:30.790 03:17:55 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:30.790 03:17:55 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:30.790 03:17:55 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:30.790 03:17:55 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:30.790 03:17:55 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:30.790 03:17:55 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:30.790 03:17:55 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:30.790 03:17:55 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:30.790 03:17:55 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:30.790 03:17:55 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:30.790 03:17:55 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:30.790 03:17:55 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:30.790 03:17:55 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:30.790 03:17:55 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:30.790 03:17:55 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:30.790 03:17:55 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:30.790 03:17:55 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:30.790 03:17:55 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:30.790 03:17:55 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:30.790 03:17:55 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:30.790 03:17:55 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:30.790 03:17:55 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:30.790 03:17:55 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:30.790 03:17:55 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:30.790 03:17:55 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:30.790 03:17:55 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:30.790 03:17:55 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:30.790 03:17:55 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:30.790 03:17:55 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:30.790 03:17:55 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:30.790 03:17:55 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:30.790 03:17:55 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:30.790 03:17:55 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:30.790 03:17:55 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:30.790 03:17:55 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:30.790 03:17:55 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:30.790 03:17:55 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:30.790 03:17:55 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:30.790 03:17:55 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:30.790 03:17:55 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:30.790 03:17:55 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:30.790 03:17:55 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:30.790 03:17:55 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:30.790 03:17:55 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:30.790 03:17:55 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:30.790 03:17:55 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:30.790 03:17:55 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:06:30.790 03:17:55 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:30.790 03:17:55 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:06:30.790 03:17:55 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:06:30.790 03:17:55 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:06:30.790 03:17:55 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:06:30.790 03:17:55 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:06:30.790 03:17:55 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:06:30.790 03:17:55 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:06:30.790 03:17:55 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:06:30.790 03:17:55 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:06:30.790 03:17:55 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:06:30.790 03:17:55 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:06:30.790 03:17:55 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:06:30.790 03:17:55 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:06:30.790 03:17:55 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:06:30.790 03:17:55 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:06:30.790 03:17:55 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:30.790 03:17:55 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:06:30.790 03:17:55 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:06:30.790 03:17:55 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:06:30.790 03:17:55 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:06:30.790 03:17:55 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:06:30.790 03:17:55 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:06:30.790 03:17:55 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:06:30.790 03:17:55 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:06:30.790 03:17:55 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:06:30.790 03:17:55 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:06:30.790 03:17:55 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:06:30.790 03:17:55 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:30.790 03:17:55 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:06:30.790 03:17:55 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:06:30.790 03:17:55 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:30.790 03:17:55 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:30.790 03:17:55 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:30.790 03:17:55 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:30.790 03:17:55 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:30.790 03:17:55 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:30.791 03:17:55 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:30.791 03:17:55 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:30.791 03:17:55 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:30.791 03:17:55 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:30.791 03:17:55 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:30.791 03:17:55 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:30.791 03:17:55 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:30.791 03:17:55 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:30.791 03:17:55 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:30.791 03:17:55 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:30.791 #define SPDK_CONFIG_H 00:06:30.791 #define SPDK_CONFIG_APPS 1 00:06:30.791 #define SPDK_CONFIG_ARCH native 00:06:30.791 #undef SPDK_CONFIG_ASAN 00:06:30.791 #undef SPDK_CONFIG_AVAHI 00:06:30.791 #undef SPDK_CONFIG_CET 00:06:30.791 #define SPDK_CONFIG_COVERAGE 1 00:06:30.791 #define SPDK_CONFIG_CROSS_PREFIX 00:06:30.791 #undef SPDK_CONFIG_CRYPTO 00:06:30.791 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:30.791 #undef SPDK_CONFIG_CUSTOMOCF 00:06:30.791 #undef SPDK_CONFIG_DAOS 00:06:30.791 #define SPDK_CONFIG_DAOS_DIR 00:06:30.791 #define SPDK_CONFIG_DEBUG 1 00:06:30.791 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:30.791 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:30.791 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:30.791 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:30.791 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:30.791 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:30.791 #define SPDK_CONFIG_EXAMPLES 1 00:06:30.791 #undef SPDK_CONFIG_FC 00:06:30.791 #define SPDK_CONFIG_FC_PATH 00:06:30.791 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:30.791 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:30.791 #undef SPDK_CONFIG_FUSE 00:06:30.791 #undef SPDK_CONFIG_FUZZER 00:06:30.791 #define SPDK_CONFIG_FUZZER_LIB 00:06:30.791 #undef SPDK_CONFIG_GOLANG 00:06:30.791 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:30.791 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:06:30.791 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:30.791 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:06:30.791 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:30.791 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:30.791 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:30.791 #define SPDK_CONFIG_IDXD 1 00:06:30.791 #undef SPDK_CONFIG_IDXD_KERNEL 00:06:30.791 #undef SPDK_CONFIG_IPSEC_MB 00:06:30.791 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:30.791 #define SPDK_CONFIG_ISAL 1 00:06:30.791 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:30.791 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:30.791 #define SPDK_CONFIG_LIBDIR 00:06:30.791 #undef SPDK_CONFIG_LTO 00:06:30.791 #define SPDK_CONFIG_MAX_LCORES 00:06:30.791 #define SPDK_CONFIG_NVME_CUSE 1 00:06:30.791 #undef SPDK_CONFIG_OCF 00:06:30.791 #define SPDK_CONFIG_OCF_PATH 00:06:30.791 #define SPDK_CONFIG_OPENSSL_PATH 00:06:30.791 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:30.791 #define SPDK_CONFIG_PGO_DIR 00:06:30.791 #undef SPDK_CONFIG_PGO_USE 00:06:30.791 #define SPDK_CONFIG_PREFIX /usr/local 00:06:30.791 #undef SPDK_CONFIG_RAID5F 00:06:30.791 #undef SPDK_CONFIG_RBD 00:06:30.791 #define SPDK_CONFIG_RDMA 1 00:06:30.791 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:30.791 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:30.791 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:30.791 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:30.791 #define SPDK_CONFIG_SHARED 1 00:06:30.791 #undef SPDK_CONFIG_SMA 00:06:30.791 #define SPDK_CONFIG_TESTS 1 00:06:30.791 #undef SPDK_CONFIG_TSAN 00:06:30.791 #define SPDK_CONFIG_UBLK 1 00:06:30.791 #define SPDK_CONFIG_UBSAN 1 00:06:30.791 #undef SPDK_CONFIG_UNIT_TESTS 00:06:30.791 #undef SPDK_CONFIG_URING 00:06:30.791 #define SPDK_CONFIG_URING_PATH 00:06:30.791 #undef SPDK_CONFIG_URING_ZNS 00:06:30.791 #undef SPDK_CONFIG_USDT 00:06:30.791 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:30.791 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:30.791 #define SPDK_CONFIG_VFIO_USER 1 00:06:30.791 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:30.791 #define SPDK_CONFIG_VHOST 1 00:06:30.791 #define SPDK_CONFIG_VIRTIO 1 00:06:30.791 #undef SPDK_CONFIG_VTUNE 00:06:30.791 #define SPDK_CONFIG_VTUNE_DIR 00:06:30.791 #define SPDK_CONFIG_WERROR 1 00:06:30.791 #define SPDK_CONFIG_WPDK_DIR 00:06:30.791 #undef SPDK_CONFIG_XNVME 00:06:30.791 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:30.791 03:17:55 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:30.791 03:17:55 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:30.791 03:17:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:30.791 03:17:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:30.791 03:17:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:30.791 03:17:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.791 03:17:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.791 03:17:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.791 03:17:55 -- paths/export.sh@5 -- # export PATH 00:06:30.791 03:17:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.791 03:17:55 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:30.791 03:17:55 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:30.791 03:17:55 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:30.791 03:17:55 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:30.791 03:17:55 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:30.791 03:17:55 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:30.791 03:17:55 -- pm/common@67 -- # TEST_TAG=N/A 00:06:30.791 03:17:55 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:30.791 03:17:55 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:06:30.791 03:17:55 -- pm/common@71 -- # uname -s 00:06:30.791 03:17:55 -- pm/common@71 -- # PM_OS=Linux 00:06:30.791 03:17:55 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:06:30.791 03:17:55 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:06:30.791 03:17:55 -- pm/common@76 -- # [[ Linux == Linux ]] 00:06:30.791 03:17:55 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:06:30.791 03:17:55 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:06:30.791 03:17:55 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:06:30.791 03:17:55 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:06:30.791 03:17:55 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:06:30.791 03:17:55 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:06:30.791 03:17:55 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:06:30.791 03:17:55 -- common/autotest_common.sh@57 -- # : 0 00:06:30.791 03:17:55 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:06:30.791 03:17:55 -- common/autotest_common.sh@61 -- # : 0 00:06:30.791 03:17:55 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:30.791 03:17:55 -- common/autotest_common.sh@63 -- # : 0 00:06:30.791 03:17:55 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:06:30.791 03:17:55 -- common/autotest_common.sh@65 -- # : 1 00:06:30.791 03:17:55 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:30.791 03:17:55 -- common/autotest_common.sh@67 -- # : 0 00:06:30.791 03:17:55 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:06:30.791 03:17:55 -- common/autotest_common.sh@69 -- # : 00:06:30.791 03:17:55 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:06:30.791 03:17:55 -- common/autotest_common.sh@71 -- # : 0 00:06:30.791 03:17:55 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:06:30.791 03:17:55 -- common/autotest_common.sh@73 -- # : 0 00:06:30.791 03:17:55 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:06:30.791 03:17:55 -- common/autotest_common.sh@75 -- # : 0 00:06:30.791 03:17:55 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:06:30.791 03:17:55 -- common/autotest_common.sh@77 -- # : 0 00:06:30.791 03:17:55 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:30.791 03:17:55 -- common/autotest_common.sh@79 -- # : 0 00:06:30.791 03:17:55 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:06:30.791 03:17:55 -- common/autotest_common.sh@81 -- # : 0 00:06:30.791 03:17:55 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:06:30.791 03:17:55 -- common/autotest_common.sh@83 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:06:30.792 03:17:55 -- common/autotest_common.sh@85 -- # : 1 00:06:30.792 03:17:55 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:06:30.792 03:17:55 -- common/autotest_common.sh@87 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:06:30.792 03:17:55 -- common/autotest_common.sh@89 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:06:30.792 03:17:55 -- common/autotest_common.sh@91 -- # : 1 00:06:30.792 03:17:55 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:06:30.792 03:17:55 -- common/autotest_common.sh@93 -- # : 1 00:06:30.792 03:17:55 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:06:30.792 03:17:55 -- common/autotest_common.sh@95 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:30.792 03:17:55 -- common/autotest_common.sh@97 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:06:30.792 03:17:55 -- common/autotest_common.sh@99 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:06:30.792 03:17:55 -- common/autotest_common.sh@101 -- # : tcp 00:06:30.792 03:17:55 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:30.792 03:17:55 -- common/autotest_common.sh@103 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:06:30.792 03:17:55 -- common/autotest_common.sh@105 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:06:30.792 03:17:55 -- common/autotest_common.sh@107 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:06:30.792 03:17:55 -- common/autotest_common.sh@109 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:06:30.792 03:17:55 -- common/autotest_common.sh@111 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:06:30.792 03:17:55 -- common/autotest_common.sh@113 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:06:30.792 03:17:55 -- common/autotest_common.sh@115 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:06:30.792 03:17:55 -- common/autotest_common.sh@117 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:30.792 03:17:55 -- common/autotest_common.sh@119 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:06:30.792 03:17:55 -- common/autotest_common.sh@121 -- # : 1 00:06:30.792 03:17:55 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:06:30.792 03:17:55 -- common/autotest_common.sh@123 -- # : 00:06:30.792 03:17:55 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:30.792 03:17:55 -- common/autotest_common.sh@125 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:06:30.792 03:17:55 -- common/autotest_common.sh@127 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:06:30.792 03:17:55 -- common/autotest_common.sh@129 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:06:30.792 03:17:55 -- common/autotest_common.sh@131 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:06:30.792 03:17:55 -- common/autotest_common.sh@133 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:06:30.792 03:17:55 -- common/autotest_common.sh@135 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:06:30.792 03:17:55 -- common/autotest_common.sh@137 -- # : 00:06:30.792 03:17:55 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:06:30.792 03:17:55 -- common/autotest_common.sh@139 -- # : true 00:06:30.792 03:17:55 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:06:30.792 03:17:55 -- common/autotest_common.sh@141 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:06:30.792 03:17:55 -- common/autotest_common.sh@143 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:06:30.792 03:17:55 -- common/autotest_common.sh@145 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:06:30.792 03:17:55 -- common/autotest_common.sh@147 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:06:30.792 03:17:55 -- common/autotest_common.sh@149 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:06:30.792 03:17:55 -- common/autotest_common.sh@151 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:06:30.792 03:17:55 -- common/autotest_common.sh@153 -- # : e810 00:06:30.792 03:17:55 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:06:30.792 03:17:55 -- common/autotest_common.sh@155 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:06:30.792 03:17:55 -- common/autotest_common.sh@157 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:06:30.792 03:17:55 -- common/autotest_common.sh@159 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:06:30.792 03:17:55 -- common/autotest_common.sh@161 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:06:30.792 03:17:55 -- common/autotest_common.sh@163 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:06:30.792 03:17:55 -- common/autotest_common.sh@166 -- # : 00:06:30.792 03:17:55 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:06:30.792 03:17:55 -- common/autotest_common.sh@168 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:06:30.792 03:17:55 -- common/autotest_common.sh@170 -- # : 0 00:06:30.792 03:17:55 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:30.792 03:17:55 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:30.792 03:17:55 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:30.792 03:17:55 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:30.792 03:17:55 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:30.792 03:17:55 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:30.792 03:17:55 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:30.792 03:17:55 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:30.792 03:17:55 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:30.792 03:17:55 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:30.792 03:17:55 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:30.792 03:17:55 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:30.792 03:17:55 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:30.792 03:17:55 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:30.792 03:17:55 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:06:30.792 03:17:55 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:30.792 03:17:55 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:30.792 03:17:55 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:30.792 03:17:55 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:30.792 03:17:55 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:30.792 03:17:55 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:06:30.792 03:17:55 -- common/autotest_common.sh@199 -- # cat 00:06:30.792 03:17:55 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:06:30.792 03:17:55 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:30.792 03:17:55 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:30.792 03:17:55 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:30.792 03:17:55 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:30.792 03:17:55 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:06:30.792 03:17:55 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:06:30.792 03:17:55 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:30.792 03:17:55 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:30.792 03:17:55 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:30.792 03:17:55 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:30.793 03:17:55 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:30.793 03:17:55 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:30.793 03:17:55 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:30.793 03:17:55 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:30.793 03:17:55 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:30.793 03:17:55 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:30.793 03:17:55 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:30.793 03:17:55 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:30.793 03:17:55 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:06:30.793 03:17:55 -- common/autotest_common.sh@252 -- # export valgrind= 00:06:30.793 03:17:55 -- common/autotest_common.sh@252 -- # valgrind= 00:06:30.793 03:17:55 -- common/autotest_common.sh@258 -- # uname -s 00:06:30.793 03:17:55 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:06:30.793 03:17:55 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:06:30.793 03:17:55 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:06:30.793 03:17:55 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:06:30.793 03:17:55 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@268 -- # MAKE=make 00:06:30.793 03:17:55 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j48 00:06:30.793 03:17:55 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:06:30.793 03:17:55 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:06:30.793 03:17:55 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:06:30.793 03:17:55 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:06:30.793 03:17:55 -- common/autotest_common.sh@289 -- # for i in "$@" 00:06:30.793 03:17:55 -- common/autotest_common.sh@290 -- # case "$i" in 00:06:30.793 03:17:55 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=tcp 00:06:30.793 03:17:55 -- common/autotest_common.sh@307 -- # [[ -z 1352532 ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@307 -- # kill -0 1352532 00:06:30.793 03:17:55 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:06:30.793 03:17:55 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:06:30.793 03:17:55 -- common/autotest_common.sh@320 -- # local mount target_dir 00:06:30.793 03:17:55 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:06:30.793 03:17:55 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:06:30.793 03:17:55 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:06:30.793 03:17:55 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:06:30.793 03:17:55 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.AZ5bsb 00:06:30.793 03:17:55 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:30.793 03:17:55 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.AZ5bsb/tests/target /tmp/spdk.AZ5bsb 00:06:30.793 03:17:55 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:06:30.793 03:17:55 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:30.793 03:17:55 -- common/autotest_common.sh@316 -- # df -T 00:06:30.793 03:17:55 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:06:30.793 03:17:55 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:06:30.793 03:17:55 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # avails["$mount"]=1052192768 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:06:30.793 03:17:55 -- common/autotest_common.sh@352 -- # uses["$mount"]=4232237056 00:06:30.793 03:17:55 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # avails["$mount"]=50378211328 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # sizes["$mount"]=61994737664 00:06:30.793 03:17:55 -- common/autotest_common.sh@352 -- # uses["$mount"]=11616526336 00:06:30.793 03:17:55 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # avails["$mount"]=30943830016 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # sizes["$mount"]=30997368832 00:06:30.793 03:17:55 -- common/autotest_common.sh@352 -- # uses["$mount"]=53538816 00:06:30.793 03:17:55 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # avails["$mount"]=12390182912 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # sizes["$mount"]=12398948352 00:06:30.793 03:17:55 -- common/autotest_common.sh@352 -- # uses["$mount"]=8765440 00:06:30.793 03:17:55 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # avails["$mount"]=30996873216 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # sizes["$mount"]=30997368832 00:06:30.793 03:17:55 -- common/autotest_common.sh@352 -- # uses["$mount"]=495616 00:06:30.793 03:17:55 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:30.793 03:17:55 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # avails["$mount"]=6199468032 00:06:30.793 03:17:55 -- common/autotest_common.sh@351 -- # sizes["$mount"]=6199472128 00:06:30.793 03:17:55 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:06:30.793 03:17:55 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:30.793 03:17:55 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:06:30.793 * Looking for test storage... 00:06:30.793 03:17:55 -- common/autotest_common.sh@357 -- # local target_space new_size 00:06:30.793 03:17:55 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:06:30.793 03:17:55 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:30.793 03:17:55 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:30.793 03:17:55 -- common/autotest_common.sh@361 -- # mount=/ 00:06:30.793 03:17:55 -- common/autotest_common.sh@363 -- # target_space=50378211328 00:06:30.793 03:17:55 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:06:30.793 03:17:55 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:06:30.793 03:17:55 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@370 -- # new_size=13831118848 00:06:30.793 03:17:55 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:30.793 03:17:55 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:30.793 03:17:55 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:30.793 03:17:55 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:30.793 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:30.793 03:17:55 -- common/autotest_common.sh@378 -- # return 0 00:06:30.793 03:17:55 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:06:30.793 03:17:55 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:06:30.793 03:17:55 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:30.793 03:17:55 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:30.793 03:17:55 -- common/autotest_common.sh@1673 -- # true 00:06:30.793 03:17:55 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:06:30.793 03:17:55 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:30.793 03:17:55 -- common/autotest_common.sh@27 -- # exec 00:06:30.793 03:17:55 -- common/autotest_common.sh@29 -- # exec 00:06:30.793 03:17:55 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:30.793 03:17:55 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:30.793 03:17:55 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:30.793 03:17:55 -- common/autotest_common.sh@18 -- # set -x 00:06:30.793 03:17:55 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:30.793 03:17:55 -- nvmf/common.sh@7 -- # uname -s 00:06:30.793 03:17:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:30.793 03:17:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:30.793 03:17:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:30.793 03:17:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:30.793 03:17:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:30.793 03:17:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:30.793 03:17:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:30.793 03:17:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:30.793 03:17:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:30.793 03:17:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:30.793 03:17:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:06:30.793 03:17:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:06:30.794 03:17:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:30.794 03:17:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:30.794 03:17:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:30.794 03:17:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:30.794 03:17:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:30.794 03:17:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:30.794 03:17:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:30.794 03:17:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:30.794 03:17:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.794 03:17:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.794 03:17:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.794 03:17:55 -- paths/export.sh@5 -- # export PATH 00:06:30.794 03:17:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.794 03:17:55 -- nvmf/common.sh@47 -- # : 0 00:06:30.794 03:17:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:30.794 03:17:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:30.794 03:17:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:30.794 03:17:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:30.794 03:17:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:30.794 03:17:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:30.794 03:17:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:30.794 03:17:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:30.794 03:17:55 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:30.794 03:17:55 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:30.794 03:17:55 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:30.794 03:17:55 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:06:30.794 03:17:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:30.794 03:17:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:30.794 03:17:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:30.794 03:17:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:30.794 03:17:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:30.794 03:17:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:30.794 03:17:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:30.794 03:17:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:06:30.794 03:17:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:30.794 03:17:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:30.794 03:17:55 -- common/autotest_common.sh@10 -- # set +x 00:06:32.693 03:17:57 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:32.693 03:17:57 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:32.693 03:17:57 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:32.693 03:17:57 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:32.693 03:17:57 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:32.693 03:17:57 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:32.693 03:17:57 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:32.693 03:17:57 -- nvmf/common.sh@295 -- # net_devs=() 00:06:32.693 03:17:57 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:32.693 03:17:57 -- nvmf/common.sh@296 -- # e810=() 00:06:32.693 03:17:57 -- nvmf/common.sh@296 -- # local -ga e810 00:06:32.693 03:17:57 -- nvmf/common.sh@297 -- # x722=() 00:06:32.693 03:17:57 -- nvmf/common.sh@297 -- # local -ga x722 00:06:32.693 03:17:57 -- nvmf/common.sh@298 -- # mlx=() 00:06:32.693 03:17:57 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:32.693 03:17:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:32.693 03:17:57 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:32.693 03:17:57 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:06:32.693 03:17:57 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:32.693 03:17:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:32.693 03:17:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:06:32.693 Found 0000:09:00.0 (0x8086 - 0x159b) 00:06:32.693 03:17:57 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:32.693 03:17:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:06:32.693 Found 0000:09:00.1 (0x8086 - 0x159b) 00:06:32.693 03:17:57 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:32.693 03:17:57 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:06:32.693 03:17:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:32.693 03:17:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:32.693 03:17:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:32.693 03:17:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:32.693 03:17:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:06:32.693 Found net devices under 0000:09:00.0: cvl_0_0 00:06:32.693 03:17:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:32.693 03:17:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:32.693 03:17:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:32.693 03:17:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:32.693 03:17:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:32.693 03:17:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:06:32.693 Found net devices under 0000:09:00.1: cvl_0_1 00:06:32.693 03:17:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:32.693 03:17:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:32.694 03:17:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:32.694 03:17:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:32.694 03:17:57 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:06:32.694 03:17:57 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:06:32.694 03:17:57 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:32.694 03:17:57 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:32.694 03:17:57 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:32.694 03:17:57 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:06:32.694 03:17:57 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:32.694 03:17:57 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:32.694 03:17:57 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:06:32.694 03:17:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:32.694 03:17:57 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:32.694 03:17:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:06:32.694 03:17:57 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:06:32.694 03:17:57 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:06:32.694 03:17:57 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:32.694 03:17:57 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:32.694 03:17:57 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:32.694 03:17:57 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:06:32.694 03:17:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:32.694 03:17:57 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:32.952 03:17:57 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:32.952 03:17:57 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:06:32.952 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:32.952 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:06:32.952 00:06:32.952 --- 10.0.0.2 ping statistics --- 00:06:32.952 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:32.952 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:06:32.952 03:17:57 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:32.952 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:32.952 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:06:32.952 00:06:32.952 --- 10.0.0.1 ping statistics --- 00:06:32.952 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:32.952 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:06:32.952 03:17:57 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:32.952 03:17:57 -- nvmf/common.sh@411 -- # return 0 00:06:32.952 03:17:57 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:32.952 03:17:57 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:32.952 03:17:57 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:06:32.952 03:17:57 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:06:32.952 03:17:57 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:32.952 03:17:57 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:06:32.952 03:17:57 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:06:32.952 03:17:57 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:32.952 03:17:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:32.952 03:17:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.952 03:17:57 -- common/autotest_common.sh@10 -- # set +x 00:06:32.952 ************************************ 00:06:32.952 START TEST nvmf_filesystem_no_in_capsule 00:06:32.952 ************************************ 00:06:32.952 03:17:57 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 0 00:06:32.952 03:17:57 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:32.952 03:17:57 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:32.952 03:17:57 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:06:32.952 03:17:57 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:32.952 03:17:57 -- common/autotest_common.sh@10 -- # set +x 00:06:32.952 03:17:57 -- nvmf/common.sh@470 -- # nvmfpid=1354131 00:06:32.952 03:17:57 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:32.952 03:17:57 -- nvmf/common.sh@471 -- # waitforlisten 1354131 00:06:32.952 03:17:57 -- common/autotest_common.sh@817 -- # '[' -z 1354131 ']' 00:06:32.952 03:17:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:32.952 03:17:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:32.952 03:17:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:32.952 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:32.952 03:17:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:32.952 03:17:57 -- common/autotest_common.sh@10 -- # set +x 00:06:32.952 [2024-04-27 03:17:57.853424] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:32.952 [2024-04-27 03:17:57.853500] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:32.952 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.952 [2024-04-27 03:17:57.918967] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:33.212 [2024-04-27 03:17:58.026260] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:33.212 [2024-04-27 03:17:58.026336] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:33.212 [2024-04-27 03:17:58.026366] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:06:33.212 [2024-04-27 03:17:58.026378] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:06:33.212 [2024-04-27 03:17:58.026388] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:33.212 [2024-04-27 03:17:58.026440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:33.212 [2024-04-27 03:17:58.026496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:33.212 [2024-04-27 03:17:58.026523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:33.212 [2024-04-27 03:17:58.026526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.212 03:17:58 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:33.212 03:17:58 -- common/autotest_common.sh@850 -- # return 0 00:06:33.212 03:17:58 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:06:33.212 03:17:58 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:33.212 03:17:58 -- common/autotest_common.sh@10 -- # set +x 00:06:33.212 03:17:58 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:33.212 03:17:58 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:33.212 03:17:58 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:33.212 03:17:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.212 03:17:58 -- common/autotest_common.sh@10 -- # set +x 00:06:33.212 [2024-04-27 03:17:58.184960] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:33.471 03:17:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.471 03:17:58 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:33.471 03:17:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.471 03:17:58 -- common/autotest_common.sh@10 -- # set +x 00:06:33.471 Malloc1 00:06:33.471 03:17:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.471 03:17:58 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:33.471 03:17:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.471 03:17:58 -- common/autotest_common.sh@10 -- # set +x 00:06:33.471 03:17:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.471 03:17:58 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:33.471 03:17:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.471 03:17:58 -- common/autotest_common.sh@10 -- # set +x 00:06:33.471 03:17:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.471 03:17:58 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:33.471 03:17:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.471 03:17:58 -- common/autotest_common.sh@10 -- # set +x 00:06:33.471 [2024-04-27 03:17:58.371662] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:33.471 03:17:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.471 03:17:58 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:33.471 03:17:58 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:06:33.472 03:17:58 -- common/autotest_common.sh@1365 -- # local bdev_info 00:06:33.472 03:17:58 -- common/autotest_common.sh@1366 -- # local bs 00:06:33.472 03:17:58 -- common/autotest_common.sh@1367 -- # local nb 00:06:33.472 03:17:58 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:33.472 03:17:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.472 03:17:58 -- common/autotest_common.sh@10 -- # set +x 00:06:33.472 03:17:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.472 03:17:58 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:06:33.472 { 00:06:33.472 "name": "Malloc1", 00:06:33.472 "aliases": [ 00:06:33.472 "a6188350-eec8-4515-9e2a-dde22af6dcbf" 00:06:33.472 ], 00:06:33.472 "product_name": "Malloc disk", 00:06:33.472 "block_size": 512, 00:06:33.472 "num_blocks": 1048576, 00:06:33.472 "uuid": "a6188350-eec8-4515-9e2a-dde22af6dcbf", 00:06:33.472 "assigned_rate_limits": { 00:06:33.472 "rw_ios_per_sec": 0, 00:06:33.472 "rw_mbytes_per_sec": 0, 00:06:33.472 "r_mbytes_per_sec": 0, 00:06:33.472 "w_mbytes_per_sec": 0 00:06:33.472 }, 00:06:33.472 "claimed": true, 00:06:33.472 "claim_type": "exclusive_write", 00:06:33.472 "zoned": false, 00:06:33.472 "supported_io_types": { 00:06:33.472 "read": true, 00:06:33.472 "write": true, 00:06:33.472 "unmap": true, 00:06:33.472 "write_zeroes": true, 00:06:33.472 "flush": true, 00:06:33.472 "reset": true, 00:06:33.472 "compare": false, 00:06:33.472 "compare_and_write": false, 00:06:33.472 "abort": true, 00:06:33.472 "nvme_admin": false, 00:06:33.472 "nvme_io": false 00:06:33.472 }, 00:06:33.472 "memory_domains": [ 00:06:33.472 { 00:06:33.472 "dma_device_id": "system", 00:06:33.472 "dma_device_type": 1 00:06:33.472 }, 00:06:33.472 { 00:06:33.472 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:33.472 "dma_device_type": 2 00:06:33.472 } 00:06:33.472 ], 00:06:33.472 "driver_specific": {} 00:06:33.472 } 00:06:33.472 ]' 00:06:33.472 03:17:58 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:06:33.472 03:17:58 -- common/autotest_common.sh@1369 -- # bs=512 00:06:33.472 03:17:58 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:06:33.729 03:17:58 -- common/autotest_common.sh@1370 -- # nb=1048576 00:06:33.729 03:17:58 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:06:33.729 03:17:58 -- common/autotest_common.sh@1374 -- # echo 512 00:06:33.729 03:17:58 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:33.729 03:17:58 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:34.294 03:17:59 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:34.294 03:17:59 -- common/autotest_common.sh@1184 -- # local i=0 00:06:34.294 03:17:59 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:06:34.294 03:17:59 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:06:34.294 03:17:59 -- common/autotest_common.sh@1191 -- # sleep 2 00:06:36.191 03:18:01 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:06:36.191 03:18:01 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:06:36.191 03:18:01 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:06:36.448 03:18:01 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:06:36.448 03:18:01 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:06:36.448 03:18:01 -- common/autotest_common.sh@1194 -- # return 0 00:06:36.448 03:18:01 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:36.448 03:18:01 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:36.448 03:18:01 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:36.448 03:18:01 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:36.448 03:18:01 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:36.448 03:18:01 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:36.448 03:18:01 -- setup/common.sh@80 -- # echo 536870912 00:06:36.448 03:18:01 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:36.448 03:18:01 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:36.448 03:18:01 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:36.448 03:18:01 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:36.706 03:18:01 -- target/filesystem.sh@69 -- # partprobe 00:06:37.271 03:18:02 -- target/filesystem.sh@70 -- # sleep 1 00:06:38.203 03:18:03 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:38.203 03:18:03 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:38.203 03:18:03 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:38.203 03:18:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.203 03:18:03 -- common/autotest_common.sh@10 -- # set +x 00:06:38.203 ************************************ 00:06:38.203 START TEST filesystem_ext4 00:06:38.203 ************************************ 00:06:38.203 03:18:03 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:38.203 03:18:03 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:38.203 03:18:03 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:38.203 03:18:03 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:38.203 03:18:03 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:38.203 03:18:03 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:38.203 03:18:03 -- common/autotest_common.sh@914 -- # local i=0 00:06:38.203 03:18:03 -- common/autotest_common.sh@915 -- # local force 00:06:38.203 03:18:03 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:38.203 03:18:03 -- common/autotest_common.sh@918 -- # force=-F 00:06:38.203 03:18:03 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:38.203 mke2fs 1.46.5 (30-Dec-2021) 00:06:38.460 Discarding device blocks: 0/522240 done 00:06:38.460 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:38.460 Filesystem UUID: 92e58a38-3154-4642-bc0d-e7ee04fd248d 00:06:38.460 Superblock backups stored on blocks: 00:06:38.460 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:38.460 00:06:38.460 Allocating group tables: 0/64 done 00:06:38.460 Writing inode tables: 0/64 done 00:06:38.460 Creating journal (8192 blocks): done 00:06:38.460 Writing superblocks and filesystem accounting information: 0/64 done 00:06:38.460 00:06:38.460 03:18:03 -- common/autotest_common.sh@931 -- # return 0 00:06:38.460 03:18:03 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:39.025 03:18:03 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:39.025 03:18:03 -- target/filesystem.sh@25 -- # sync 00:06:39.025 03:18:03 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:39.025 03:18:03 -- target/filesystem.sh@27 -- # sync 00:06:39.025 03:18:03 -- target/filesystem.sh@29 -- # i=0 00:06:39.025 03:18:03 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:39.025 03:18:03 -- target/filesystem.sh@37 -- # kill -0 1354131 00:06:39.025 03:18:03 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:39.025 03:18:03 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:39.025 03:18:03 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:39.025 03:18:03 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:39.025 00:06:39.025 real 0m0.727s 00:06:39.025 user 0m0.014s 00:06:39.025 sys 0m0.054s 00:06:39.025 03:18:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:39.025 03:18:03 -- common/autotest_common.sh@10 -- # set +x 00:06:39.025 ************************************ 00:06:39.025 END TEST filesystem_ext4 00:06:39.025 ************************************ 00:06:39.025 03:18:03 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:39.025 03:18:03 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:39.025 03:18:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.025 03:18:03 -- common/autotest_common.sh@10 -- # set +x 00:06:39.025 ************************************ 00:06:39.025 START TEST filesystem_btrfs 00:06:39.025 ************************************ 00:06:39.025 03:18:03 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:39.025 03:18:03 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:39.025 03:18:03 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:39.025 03:18:03 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:39.025 03:18:03 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:39.025 03:18:03 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:39.025 03:18:03 -- common/autotest_common.sh@914 -- # local i=0 00:06:39.025 03:18:03 -- common/autotest_common.sh@915 -- # local force 00:06:39.025 03:18:03 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:39.025 03:18:03 -- common/autotest_common.sh@920 -- # force=-f 00:06:39.025 03:18:03 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:39.591 btrfs-progs v6.6.2 00:06:39.591 See https://btrfs.readthedocs.io for more information. 00:06:39.591 00:06:39.591 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:39.591 NOTE: several default settings have changed in version 5.15, please make sure 00:06:39.591 this does not affect your deployments: 00:06:39.591 - DUP for metadata (-m dup) 00:06:39.591 - enabled no-holes (-O no-holes) 00:06:39.591 - enabled free-space-tree (-R free-space-tree) 00:06:39.591 00:06:39.591 Label: (null) 00:06:39.591 UUID: 914e1784-f9ba-4a92-8644-81923cbefad4 00:06:39.591 Node size: 16384 00:06:39.591 Sector size: 4096 00:06:39.591 Filesystem size: 510.00MiB 00:06:39.591 Block group profiles: 00:06:39.591 Data: single 8.00MiB 00:06:39.591 Metadata: DUP 32.00MiB 00:06:39.591 System: DUP 8.00MiB 00:06:39.591 SSD detected: yes 00:06:39.591 Zoned device: no 00:06:39.591 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:06:39.591 Runtime features: free-space-tree 00:06:39.591 Checksum: crc32c 00:06:39.591 Number of devices: 1 00:06:39.591 Devices: 00:06:39.591 ID SIZE PATH 00:06:39.591 1 510.00MiB /dev/nvme0n1p1 00:06:39.591 00:06:39.591 03:18:04 -- common/autotest_common.sh@931 -- # return 0 00:06:39.591 03:18:04 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:40.583 03:18:05 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:40.583 03:18:05 -- target/filesystem.sh@25 -- # sync 00:06:40.583 03:18:05 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:40.583 03:18:05 -- target/filesystem.sh@27 -- # sync 00:06:40.584 03:18:05 -- target/filesystem.sh@29 -- # i=0 00:06:40.584 03:18:05 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:40.584 03:18:05 -- target/filesystem.sh@37 -- # kill -0 1354131 00:06:40.584 03:18:05 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:40.584 03:18:05 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:40.584 03:18:05 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:40.584 03:18:05 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:40.584 00:06:40.584 real 0m1.403s 00:06:40.584 user 0m0.016s 00:06:40.584 sys 0m0.120s 00:06:40.584 03:18:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:40.584 03:18:05 -- common/autotest_common.sh@10 -- # set +x 00:06:40.584 ************************************ 00:06:40.584 END TEST filesystem_btrfs 00:06:40.584 ************************************ 00:06:40.584 03:18:05 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:40.584 03:18:05 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:40.584 03:18:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.584 03:18:05 -- common/autotest_common.sh@10 -- # set +x 00:06:40.584 ************************************ 00:06:40.584 START TEST filesystem_xfs 00:06:40.584 ************************************ 00:06:40.584 03:18:05 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:06:40.584 03:18:05 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:40.584 03:18:05 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:40.584 03:18:05 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:40.584 03:18:05 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:40.584 03:18:05 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:40.584 03:18:05 -- common/autotest_common.sh@914 -- # local i=0 00:06:40.584 03:18:05 -- common/autotest_common.sh@915 -- # local force 00:06:40.584 03:18:05 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:40.584 03:18:05 -- common/autotest_common.sh@920 -- # force=-f 00:06:40.584 03:18:05 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:40.584 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:40.584 = sectsz=512 attr=2, projid32bit=1 00:06:40.584 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:40.584 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:40.584 data = bsize=4096 blocks=130560, imaxpct=25 00:06:40.584 = sunit=0 swidth=0 blks 00:06:40.584 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:40.584 log =internal log bsize=4096 blocks=16384, version=2 00:06:40.584 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:40.584 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:41.517 Discarding blocks...Done. 00:06:41.517 03:18:06 -- common/autotest_common.sh@931 -- # return 0 00:06:41.517 03:18:06 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:43.416 03:18:08 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:43.416 03:18:08 -- target/filesystem.sh@25 -- # sync 00:06:43.416 03:18:08 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:43.416 03:18:08 -- target/filesystem.sh@27 -- # sync 00:06:43.416 03:18:08 -- target/filesystem.sh@29 -- # i=0 00:06:43.416 03:18:08 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:43.416 03:18:08 -- target/filesystem.sh@37 -- # kill -0 1354131 00:06:43.416 03:18:08 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:43.416 03:18:08 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:43.416 03:18:08 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:43.416 03:18:08 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:43.416 00:06:43.416 real 0m2.788s 00:06:43.416 user 0m0.012s 00:06:43.416 sys 0m0.065s 00:06:43.416 03:18:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:43.416 03:18:08 -- common/autotest_common.sh@10 -- # set +x 00:06:43.416 ************************************ 00:06:43.416 END TEST filesystem_xfs 00:06:43.416 ************************************ 00:06:43.416 03:18:08 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:43.416 03:18:08 -- target/filesystem.sh@93 -- # sync 00:06:43.416 03:18:08 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:43.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:43.674 03:18:08 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:43.674 03:18:08 -- common/autotest_common.sh@1205 -- # local i=0 00:06:43.674 03:18:08 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:06:43.674 03:18:08 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:43.674 03:18:08 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:06:43.674 03:18:08 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:43.674 03:18:08 -- common/autotest_common.sh@1217 -- # return 0 00:06:43.674 03:18:08 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:43.674 03:18:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:43.674 03:18:08 -- common/autotest_common.sh@10 -- # set +x 00:06:43.674 03:18:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:43.674 03:18:08 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:43.674 03:18:08 -- target/filesystem.sh@101 -- # killprocess 1354131 00:06:43.674 03:18:08 -- common/autotest_common.sh@936 -- # '[' -z 1354131 ']' 00:06:43.674 03:18:08 -- common/autotest_common.sh@940 -- # kill -0 1354131 00:06:43.674 03:18:08 -- common/autotest_common.sh@941 -- # uname 00:06:43.674 03:18:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:43.674 03:18:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1354131 00:06:43.674 03:18:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:43.674 03:18:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:43.674 03:18:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1354131' 00:06:43.674 killing process with pid 1354131 00:06:43.674 03:18:08 -- common/autotest_common.sh@955 -- # kill 1354131 00:06:43.674 03:18:08 -- common/autotest_common.sh@960 -- # wait 1354131 00:06:44.240 03:18:08 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:44.240 00:06:44.240 real 0m11.168s 00:06:44.240 user 0m42.686s 00:06:44.240 sys 0m1.837s 00:06:44.240 03:18:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:44.240 03:18:08 -- common/autotest_common.sh@10 -- # set +x 00:06:44.240 ************************************ 00:06:44.240 END TEST nvmf_filesystem_no_in_capsule 00:06:44.240 ************************************ 00:06:44.240 03:18:08 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:44.240 03:18:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:44.240 03:18:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.240 03:18:08 -- common/autotest_common.sh@10 -- # set +x 00:06:44.240 ************************************ 00:06:44.240 START TEST nvmf_filesystem_in_capsule 00:06:44.240 ************************************ 00:06:44.240 03:18:09 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 4096 00:06:44.240 03:18:09 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:44.240 03:18:09 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:44.240 03:18:09 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:06:44.240 03:18:09 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:44.240 03:18:09 -- common/autotest_common.sh@10 -- # set +x 00:06:44.240 03:18:09 -- nvmf/common.sh@470 -- # nvmfpid=1356308 00:06:44.240 03:18:09 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:44.240 03:18:09 -- nvmf/common.sh@471 -- # waitforlisten 1356308 00:06:44.241 03:18:09 -- common/autotest_common.sh@817 -- # '[' -z 1356308 ']' 00:06:44.241 03:18:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:44.241 03:18:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:44.241 03:18:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:44.241 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:44.241 03:18:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:44.241 03:18:09 -- common/autotest_common.sh@10 -- # set +x 00:06:44.241 [2024-04-27 03:18:09.138801] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:06:44.241 [2024-04-27 03:18:09.138866] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:44.241 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.241 [2024-04-27 03:18:09.211960] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:44.499 [2024-04-27 03:18:09.327241] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:44.499 [2024-04-27 03:18:09.327313] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:44.499 [2024-04-27 03:18:09.327329] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:06:44.499 [2024-04-27 03:18:09.327342] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:06:44.499 [2024-04-27 03:18:09.327354] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:44.499 [2024-04-27 03:18:09.327418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:44.499 [2024-04-27 03:18:09.327496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:44.499 [2024-04-27 03:18:09.327591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:44.499 [2024-04-27 03:18:09.327593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.431 03:18:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:45.431 03:18:10 -- common/autotest_common.sh@850 -- # return 0 00:06:45.431 03:18:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:06:45.431 03:18:10 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:45.431 03:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.431 03:18:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:45.431 03:18:10 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:45.431 03:18:10 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:06:45.431 03:18:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:45.431 03:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.431 [2024-04-27 03:18:10.163295] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:45.431 03:18:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:45.431 03:18:10 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:45.431 03:18:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:45.431 03:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.431 Malloc1 00:06:45.431 03:18:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:45.431 03:18:10 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:45.431 03:18:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:45.431 03:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.431 03:18:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:45.431 03:18:10 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:45.431 03:18:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:45.431 03:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.431 03:18:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:45.431 03:18:10 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:45.431 03:18:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:45.431 03:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.431 [2024-04-27 03:18:10.341868] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:45.431 03:18:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:45.431 03:18:10 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:45.431 03:18:10 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:06:45.431 03:18:10 -- common/autotest_common.sh@1365 -- # local bdev_info 00:06:45.431 03:18:10 -- common/autotest_common.sh@1366 -- # local bs 00:06:45.431 03:18:10 -- common/autotest_common.sh@1367 -- # local nb 00:06:45.431 03:18:10 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:45.431 03:18:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:45.431 03:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:45.431 03:18:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:45.431 03:18:10 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:06:45.431 { 00:06:45.431 "name": "Malloc1", 00:06:45.431 "aliases": [ 00:06:45.431 "04a24ccf-5b45-44f8-a7c7-c1a82693261e" 00:06:45.431 ], 00:06:45.431 "product_name": "Malloc disk", 00:06:45.431 "block_size": 512, 00:06:45.431 "num_blocks": 1048576, 00:06:45.431 "uuid": "04a24ccf-5b45-44f8-a7c7-c1a82693261e", 00:06:45.431 "assigned_rate_limits": { 00:06:45.431 "rw_ios_per_sec": 0, 00:06:45.431 "rw_mbytes_per_sec": 0, 00:06:45.431 "r_mbytes_per_sec": 0, 00:06:45.431 "w_mbytes_per_sec": 0 00:06:45.431 }, 00:06:45.431 "claimed": true, 00:06:45.431 "claim_type": "exclusive_write", 00:06:45.431 "zoned": false, 00:06:45.431 "supported_io_types": { 00:06:45.431 "read": true, 00:06:45.431 "write": true, 00:06:45.431 "unmap": true, 00:06:45.431 "write_zeroes": true, 00:06:45.431 "flush": true, 00:06:45.431 "reset": true, 00:06:45.431 "compare": false, 00:06:45.431 "compare_and_write": false, 00:06:45.431 "abort": true, 00:06:45.431 "nvme_admin": false, 00:06:45.431 "nvme_io": false 00:06:45.431 }, 00:06:45.431 "memory_domains": [ 00:06:45.431 { 00:06:45.431 "dma_device_id": "system", 00:06:45.431 "dma_device_type": 1 00:06:45.431 }, 00:06:45.431 { 00:06:45.431 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:45.431 "dma_device_type": 2 00:06:45.431 } 00:06:45.431 ], 00:06:45.431 "driver_specific": {} 00:06:45.431 } 00:06:45.431 ]' 00:06:45.431 03:18:10 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:06:45.431 03:18:10 -- common/autotest_common.sh@1369 -- # bs=512 00:06:45.431 03:18:10 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:06:45.688 03:18:10 -- common/autotest_common.sh@1370 -- # nb=1048576 00:06:45.688 03:18:10 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:06:45.688 03:18:10 -- common/autotest_common.sh@1374 -- # echo 512 00:06:45.688 03:18:10 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:45.688 03:18:10 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:46.264 03:18:11 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:46.264 03:18:11 -- common/autotest_common.sh@1184 -- # local i=0 00:06:46.264 03:18:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:06:46.264 03:18:11 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:06:46.264 03:18:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:06:48.165 03:18:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:06:48.165 03:18:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:06:48.165 03:18:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:06:48.165 03:18:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:06:48.165 03:18:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:06:48.165 03:18:13 -- common/autotest_common.sh@1194 -- # return 0 00:06:48.165 03:18:13 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:48.165 03:18:13 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:48.165 03:18:13 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:48.165 03:18:13 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:48.165 03:18:13 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:48.165 03:18:13 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:48.165 03:18:13 -- setup/common.sh@80 -- # echo 536870912 00:06:48.165 03:18:13 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:48.165 03:18:13 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:48.165 03:18:13 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:48.165 03:18:13 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:48.737 03:18:13 -- target/filesystem.sh@69 -- # partprobe 00:06:48.993 03:18:13 -- target/filesystem.sh@70 -- # sleep 1 00:06:49.925 03:18:14 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:06:49.925 03:18:14 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:49.925 03:18:14 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:49.925 03:18:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.925 03:18:14 -- common/autotest_common.sh@10 -- # set +x 00:06:49.925 ************************************ 00:06:49.925 START TEST filesystem_in_capsule_ext4 00:06:49.925 ************************************ 00:06:49.925 03:18:14 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:49.925 03:18:14 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:49.925 03:18:14 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:49.925 03:18:14 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:49.925 03:18:14 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:49.925 03:18:14 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:49.925 03:18:14 -- common/autotest_common.sh@914 -- # local i=0 00:06:49.925 03:18:14 -- common/autotest_common.sh@915 -- # local force 00:06:49.925 03:18:14 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:49.925 03:18:14 -- common/autotest_common.sh@918 -- # force=-F 00:06:49.925 03:18:14 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:49.925 mke2fs 1.46.5 (30-Dec-2021) 00:06:50.183 Discarding device blocks: 0/522240 done 00:06:50.183 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:50.183 Filesystem UUID: 6927c452-ead0-4abe-acc6-2ae6017b5baf 00:06:50.183 Superblock backups stored on blocks: 00:06:50.183 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:50.183 00:06:50.183 Allocating group tables: 0/64 done 00:06:50.183 Writing inode tables: 0/64 done 00:06:50.748 Creating journal (8192 blocks): done 00:06:51.313 Writing superblocks and filesystem accounting information: 0/6426/64 done 00:06:51.313 00:06:51.313 03:18:16 -- common/autotest_common.sh@931 -- # return 0 00:06:51.313 03:18:16 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:52.246 03:18:16 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:52.247 03:18:16 -- target/filesystem.sh@25 -- # sync 00:06:52.247 03:18:16 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:52.247 03:18:16 -- target/filesystem.sh@27 -- # sync 00:06:52.247 03:18:16 -- target/filesystem.sh@29 -- # i=0 00:06:52.247 03:18:16 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:52.247 03:18:16 -- target/filesystem.sh@37 -- # kill -0 1356308 00:06:52.247 03:18:16 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:52.247 03:18:16 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:52.247 03:18:16 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:52.247 03:18:16 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:52.247 00:06:52.247 real 0m2.109s 00:06:52.247 user 0m0.014s 00:06:52.247 sys 0m0.057s 00:06:52.247 03:18:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:52.247 03:18:16 -- common/autotest_common.sh@10 -- # set +x 00:06:52.247 ************************************ 00:06:52.247 END TEST filesystem_in_capsule_ext4 00:06:52.247 ************************************ 00:06:52.247 03:18:17 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:52.247 03:18:17 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:52.247 03:18:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:52.247 03:18:17 -- common/autotest_common.sh@10 -- # set +x 00:06:52.247 ************************************ 00:06:52.247 START TEST filesystem_in_capsule_btrfs 00:06:52.247 ************************************ 00:06:52.247 03:18:17 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:52.247 03:18:17 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:52.247 03:18:17 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:52.247 03:18:17 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:52.247 03:18:17 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:52.247 03:18:17 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:52.247 03:18:17 -- common/autotest_common.sh@914 -- # local i=0 00:06:52.247 03:18:17 -- common/autotest_common.sh@915 -- # local force 00:06:52.247 03:18:17 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:52.247 03:18:17 -- common/autotest_common.sh@920 -- # force=-f 00:06:52.247 03:18:17 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:52.504 btrfs-progs v6.6.2 00:06:52.504 See https://btrfs.readthedocs.io for more information. 00:06:52.504 00:06:52.504 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:52.504 NOTE: several default settings have changed in version 5.15, please make sure 00:06:52.504 this does not affect your deployments: 00:06:52.504 - DUP for metadata (-m dup) 00:06:52.504 - enabled no-holes (-O no-holes) 00:06:52.504 - enabled free-space-tree (-R free-space-tree) 00:06:52.504 00:06:52.504 Label: (null) 00:06:52.504 UUID: 7bfb542c-a13f-422b-9fc7-4c64f5e4e25b 00:06:52.504 Node size: 16384 00:06:52.504 Sector size: 4096 00:06:52.504 Filesystem size: 510.00MiB 00:06:52.504 Block group profiles: 00:06:52.504 Data: single 8.00MiB 00:06:52.504 Metadata: DUP 32.00MiB 00:06:52.504 System: DUP 8.00MiB 00:06:52.504 SSD detected: yes 00:06:52.504 Zoned device: no 00:06:52.504 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:06:52.504 Runtime features: free-space-tree 00:06:52.504 Checksum: crc32c 00:06:52.504 Number of devices: 1 00:06:52.504 Devices: 00:06:52.504 ID SIZE PATH 00:06:52.504 1 510.00MiB /dev/nvme0n1p1 00:06:52.504 00:06:52.504 03:18:17 -- common/autotest_common.sh@931 -- # return 0 00:06:52.504 03:18:17 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:53.069 03:18:18 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:53.069 03:18:18 -- target/filesystem.sh@25 -- # sync 00:06:53.069 03:18:18 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:53.069 03:18:18 -- target/filesystem.sh@27 -- # sync 00:06:53.327 03:18:18 -- target/filesystem.sh@29 -- # i=0 00:06:53.327 03:18:18 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:53.327 03:18:18 -- target/filesystem.sh@37 -- # kill -0 1356308 00:06:53.327 03:18:18 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:53.327 03:18:18 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:53.327 03:18:18 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:53.327 03:18:18 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:53.327 00:06:53.327 real 0m0.967s 00:06:53.327 user 0m0.021s 00:06:53.327 sys 0m0.116s 00:06:53.327 03:18:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:53.327 03:18:18 -- common/autotest_common.sh@10 -- # set +x 00:06:53.327 ************************************ 00:06:53.327 END TEST filesystem_in_capsule_btrfs 00:06:53.327 ************************************ 00:06:53.327 03:18:18 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:06:53.327 03:18:18 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:53.327 03:18:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.327 03:18:18 -- common/autotest_common.sh@10 -- # set +x 00:06:53.327 ************************************ 00:06:53.327 START TEST filesystem_in_capsule_xfs 00:06:53.327 ************************************ 00:06:53.327 03:18:18 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:06:53.327 03:18:18 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:53.327 03:18:18 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:53.327 03:18:18 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:53.327 03:18:18 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:53.327 03:18:18 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:53.327 03:18:18 -- common/autotest_common.sh@914 -- # local i=0 00:06:53.327 03:18:18 -- common/autotest_common.sh@915 -- # local force 00:06:53.327 03:18:18 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:53.327 03:18:18 -- common/autotest_common.sh@920 -- # force=-f 00:06:53.327 03:18:18 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:53.327 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:53.327 = sectsz=512 attr=2, projid32bit=1 00:06:53.327 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:53.327 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:53.327 data = bsize=4096 blocks=130560, imaxpct=25 00:06:53.327 = sunit=0 swidth=0 blks 00:06:53.327 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:53.327 log =internal log bsize=4096 blocks=16384, version=2 00:06:53.327 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:53.327 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:54.259 Discarding blocks...Done. 00:06:54.259 03:18:19 -- common/autotest_common.sh@931 -- # return 0 00:06:54.259 03:18:19 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:56.785 03:18:21 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:56.785 03:18:21 -- target/filesystem.sh@25 -- # sync 00:06:56.785 03:18:21 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:56.785 03:18:21 -- target/filesystem.sh@27 -- # sync 00:06:56.785 03:18:21 -- target/filesystem.sh@29 -- # i=0 00:06:56.785 03:18:21 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:56.785 03:18:21 -- target/filesystem.sh@37 -- # kill -0 1356308 00:06:56.785 03:18:21 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:56.785 03:18:21 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:56.785 03:18:21 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:56.785 03:18:21 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:56.785 00:06:56.785 real 0m3.065s 00:06:56.785 user 0m0.018s 00:06:56.785 sys 0m0.056s 00:06:56.785 03:18:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:56.785 03:18:21 -- common/autotest_common.sh@10 -- # set +x 00:06:56.785 ************************************ 00:06:56.785 END TEST filesystem_in_capsule_xfs 00:06:56.785 ************************************ 00:06:56.785 03:18:21 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:56.785 03:18:21 -- target/filesystem.sh@93 -- # sync 00:06:56.785 03:18:21 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:56.785 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:56.785 03:18:21 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:56.785 03:18:21 -- common/autotest_common.sh@1205 -- # local i=0 00:06:56.785 03:18:21 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:06:56.785 03:18:21 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:56.785 03:18:21 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:06:56.785 03:18:21 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:56.785 03:18:21 -- common/autotest_common.sh@1217 -- # return 0 00:06:56.785 03:18:21 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:56.785 03:18:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:56.785 03:18:21 -- common/autotest_common.sh@10 -- # set +x 00:06:56.785 03:18:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:56.785 03:18:21 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:56.785 03:18:21 -- target/filesystem.sh@101 -- # killprocess 1356308 00:06:56.785 03:18:21 -- common/autotest_common.sh@936 -- # '[' -z 1356308 ']' 00:06:56.785 03:18:21 -- common/autotest_common.sh@940 -- # kill -0 1356308 00:06:56.785 03:18:21 -- common/autotest_common.sh@941 -- # uname 00:06:56.785 03:18:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:56.785 03:18:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1356308 00:06:56.785 03:18:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:56.785 03:18:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:56.785 03:18:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1356308' 00:06:56.785 killing process with pid 1356308 00:06:56.785 03:18:21 -- common/autotest_common.sh@955 -- # kill 1356308 00:06:56.785 03:18:21 -- common/autotest_common.sh@960 -- # wait 1356308 00:06:57.352 03:18:22 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:57.352 00:06:57.352 real 0m13.064s 00:06:57.352 user 0m50.337s 00:06:57.352 sys 0m2.032s 00:06:57.352 03:18:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:57.352 03:18:22 -- common/autotest_common.sh@10 -- # set +x 00:06:57.352 ************************************ 00:06:57.352 END TEST nvmf_filesystem_in_capsule 00:06:57.352 ************************************ 00:06:57.352 03:18:22 -- target/filesystem.sh@108 -- # nvmftestfini 00:06:57.352 03:18:22 -- nvmf/common.sh@477 -- # nvmfcleanup 00:06:57.352 03:18:22 -- nvmf/common.sh@117 -- # sync 00:06:57.352 03:18:22 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:06:57.352 03:18:22 -- nvmf/common.sh@120 -- # set +e 00:06:57.352 03:18:22 -- nvmf/common.sh@121 -- # for i in {1..20} 00:06:57.352 03:18:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:06:57.352 rmmod nvme_tcp 00:06:57.352 rmmod nvme_fabrics 00:06:57.352 rmmod nvme_keyring 00:06:57.352 03:18:22 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:06:57.352 03:18:22 -- nvmf/common.sh@124 -- # set -e 00:06:57.352 03:18:22 -- nvmf/common.sh@125 -- # return 0 00:06:57.352 03:18:22 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:06:57.352 03:18:22 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:06:57.352 03:18:22 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:06:57.352 03:18:22 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:06:57.352 03:18:22 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:57.352 03:18:22 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:06:57.352 03:18:22 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:57.352 03:18:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:57.352 03:18:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:59.935 03:18:24 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:06:59.935 00:06:59.935 real 0m28.725s 00:06:59.935 user 1m33.922s 00:06:59.935 sys 0m5.443s 00:06:59.935 03:18:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:59.935 03:18:24 -- common/autotest_common.sh@10 -- # set +x 00:06:59.935 ************************************ 00:06:59.935 END TEST nvmf_filesystem 00:06:59.935 ************************************ 00:06:59.935 03:18:24 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:06:59.935 03:18:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:59.935 03:18:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.935 03:18:24 -- common/autotest_common.sh@10 -- # set +x 00:06:59.935 ************************************ 00:06:59.935 START TEST nvmf_discovery 00:06:59.935 ************************************ 00:06:59.935 03:18:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:06:59.935 * Looking for test storage... 00:06:59.935 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.935 03:18:24 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:59.935 03:18:24 -- nvmf/common.sh@7 -- # uname -s 00:06:59.935 03:18:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:59.935 03:18:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:59.935 03:18:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:59.935 03:18:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:59.935 03:18:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:59.935 03:18:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:59.935 03:18:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:59.935 03:18:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:59.935 03:18:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:59.935 03:18:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:59.935 03:18:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:06:59.935 03:18:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:06:59.935 03:18:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:59.935 03:18:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:59.935 03:18:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:59.935 03:18:24 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:59.935 03:18:24 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:59.935 03:18:24 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:59.935 03:18:24 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:59.935 03:18:24 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:59.935 03:18:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.935 03:18:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.935 03:18:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.935 03:18:24 -- paths/export.sh@5 -- # export PATH 00:06:59.935 03:18:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.935 03:18:24 -- nvmf/common.sh@47 -- # : 0 00:06:59.935 03:18:24 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:59.935 03:18:24 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:59.935 03:18:24 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:59.935 03:18:24 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:59.935 03:18:24 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:59.935 03:18:24 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:59.935 03:18:24 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:59.935 03:18:24 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:59.935 03:18:24 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:06:59.935 03:18:24 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:06:59.935 03:18:24 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:06:59.935 03:18:24 -- target/discovery.sh@15 -- # hash nvme 00:06:59.936 03:18:24 -- target/discovery.sh@20 -- # nvmftestinit 00:06:59.936 03:18:24 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:06:59.936 03:18:24 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:59.936 03:18:24 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:59.936 03:18:24 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:59.936 03:18:24 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:59.936 03:18:24 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:59.936 03:18:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:59.936 03:18:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:59.936 03:18:24 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:06:59.936 03:18:24 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:59.936 03:18:24 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:59.936 03:18:24 -- common/autotest_common.sh@10 -- # set +x 00:07:01.839 03:18:26 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:01.839 03:18:26 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:01.839 03:18:26 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:01.839 03:18:26 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:01.839 03:18:26 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:01.839 03:18:26 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:01.839 03:18:26 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:01.839 03:18:26 -- nvmf/common.sh@295 -- # net_devs=() 00:07:01.839 03:18:26 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:01.839 03:18:26 -- nvmf/common.sh@296 -- # e810=() 00:07:01.839 03:18:26 -- nvmf/common.sh@296 -- # local -ga e810 00:07:01.839 03:18:26 -- nvmf/common.sh@297 -- # x722=() 00:07:01.839 03:18:26 -- nvmf/common.sh@297 -- # local -ga x722 00:07:01.839 03:18:26 -- nvmf/common.sh@298 -- # mlx=() 00:07:01.839 03:18:26 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:01.839 03:18:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:01.839 03:18:26 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:01.839 03:18:26 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:07:01.839 03:18:26 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:01.839 03:18:26 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:01.839 03:18:26 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:07:01.839 Found 0000:09:00.0 (0x8086 - 0x159b) 00:07:01.839 03:18:26 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:01.839 03:18:26 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:07:01.839 Found 0000:09:00.1 (0x8086 - 0x159b) 00:07:01.839 03:18:26 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:01.839 03:18:26 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:07:01.839 03:18:26 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:01.839 03:18:26 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:01.839 03:18:26 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:01.839 03:18:26 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:01.839 03:18:26 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:07:01.839 Found net devices under 0000:09:00.0: cvl_0_0 00:07:01.839 03:18:26 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:01.839 03:18:26 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:01.839 03:18:26 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:01.839 03:18:26 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:01.839 03:18:26 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:01.839 03:18:26 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:07:01.839 Found net devices under 0000:09:00.1: cvl_0_1 00:07:01.839 03:18:26 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:01.840 03:18:26 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:01.840 03:18:26 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:01.840 03:18:26 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:01.840 03:18:26 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:07:01.840 03:18:26 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:07:01.840 03:18:26 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:01.840 03:18:26 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:01.840 03:18:26 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:01.840 03:18:26 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:07:01.840 03:18:26 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:01.840 03:18:26 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:01.840 03:18:26 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:07:01.840 03:18:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:01.840 03:18:26 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:01.840 03:18:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:07:01.840 03:18:26 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:07:01.840 03:18:26 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:07:01.840 03:18:26 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:01.840 03:18:26 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:01.840 03:18:26 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:01.840 03:18:26 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:07:01.840 03:18:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:01.840 03:18:26 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:01.840 03:18:26 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:01.840 03:18:26 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:07:01.840 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:01.840 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.137 ms 00:07:01.840 00:07:01.840 --- 10.0.0.2 ping statistics --- 00:07:01.840 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:01.840 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:07:01.840 03:18:26 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:01.840 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:01.840 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:07:01.840 00:07:01.840 --- 10.0.0.1 ping statistics --- 00:07:01.840 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:01.840 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:07:01.840 03:18:26 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:01.840 03:18:26 -- nvmf/common.sh@411 -- # return 0 00:07:01.840 03:18:26 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:01.840 03:18:26 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:01.840 03:18:26 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:07:01.840 03:18:26 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:07:01.840 03:18:26 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:01.840 03:18:26 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:07:01.840 03:18:26 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:07:01.840 03:18:26 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:01.840 03:18:26 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:01.840 03:18:26 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:01.840 03:18:26 -- common/autotest_common.sh@10 -- # set +x 00:07:01.840 03:18:26 -- nvmf/common.sh@470 -- # nvmfpid=1360080 00:07:01.840 03:18:26 -- nvmf/common.sh@471 -- # waitforlisten 1360080 00:07:01.840 03:18:26 -- common/autotest_common.sh@817 -- # '[' -z 1360080 ']' 00:07:01.840 03:18:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:01.840 03:18:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:01.840 03:18:26 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:01.840 03:18:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:01.840 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:01.840 03:18:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:01.840 03:18:26 -- common/autotest_common.sh@10 -- # set +x 00:07:01.840 [2024-04-27 03:18:26.782703] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:07:01.840 [2024-04-27 03:18:26.782784] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:01.840 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.098 [2024-04-27 03:18:26.852008] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:02.098 [2024-04-27 03:18:26.971673] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:02.098 [2024-04-27 03:18:26.971739] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:02.098 [2024-04-27 03:18:26.971756] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:02.098 [2024-04-27 03:18:26.971770] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:02.098 [2024-04-27 03:18:26.971781] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:02.098 [2024-04-27 03:18:26.971849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:02.098 [2024-04-27 03:18:26.971904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:02.098 [2024-04-27 03:18:26.971955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:02.098 [2024-04-27 03:18:26.971958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.031 03:18:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:03.031 03:18:27 -- common/autotest_common.sh@850 -- # return 0 00:07:03.031 03:18:27 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:03.031 03:18:27 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:03.031 03:18:27 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 [2024-04-27 03:18:27.784351] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@26 -- # seq 1 4 00:07:03.031 03:18:27 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:03.031 03:18:27 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 Null1 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 [2024-04-27 03:18:27.824661] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:03.031 03:18:27 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 Null2 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:03.031 03:18:27 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 Null3 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:03.031 03:18:27 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 Null4 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.031 03:18:27 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:03.031 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.031 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.031 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.032 03:18:27 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:03.032 03:18:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.032 03:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.032 03:18:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.032 03:18:27 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 4420 00:07:03.290 00:07:03.290 Discovery Log Number of Records 6, Generation counter 6 00:07:03.290 =====Discovery Log Entry 0====== 00:07:03.290 trtype: tcp 00:07:03.290 adrfam: ipv4 00:07:03.290 subtype: current discovery subsystem 00:07:03.290 treq: not required 00:07:03.290 portid: 0 00:07:03.290 trsvcid: 4420 00:07:03.290 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:03.290 traddr: 10.0.0.2 00:07:03.290 eflags: explicit discovery connections, duplicate discovery information 00:07:03.290 sectype: none 00:07:03.290 =====Discovery Log Entry 1====== 00:07:03.290 trtype: tcp 00:07:03.290 adrfam: ipv4 00:07:03.290 subtype: nvme subsystem 00:07:03.290 treq: not required 00:07:03.290 portid: 0 00:07:03.290 trsvcid: 4420 00:07:03.290 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:03.290 traddr: 10.0.0.2 00:07:03.290 eflags: none 00:07:03.290 sectype: none 00:07:03.290 =====Discovery Log Entry 2====== 00:07:03.290 trtype: tcp 00:07:03.290 adrfam: ipv4 00:07:03.290 subtype: nvme subsystem 00:07:03.290 treq: not required 00:07:03.290 portid: 0 00:07:03.290 trsvcid: 4420 00:07:03.290 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:03.290 traddr: 10.0.0.2 00:07:03.290 eflags: none 00:07:03.290 sectype: none 00:07:03.290 =====Discovery Log Entry 3====== 00:07:03.290 trtype: tcp 00:07:03.290 adrfam: ipv4 00:07:03.290 subtype: nvme subsystem 00:07:03.290 treq: not required 00:07:03.290 portid: 0 00:07:03.290 trsvcid: 4420 00:07:03.290 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:03.290 traddr: 10.0.0.2 00:07:03.290 eflags: none 00:07:03.290 sectype: none 00:07:03.290 =====Discovery Log Entry 4====== 00:07:03.290 trtype: tcp 00:07:03.290 adrfam: ipv4 00:07:03.290 subtype: nvme subsystem 00:07:03.290 treq: not required 00:07:03.290 portid: 0 00:07:03.290 trsvcid: 4420 00:07:03.290 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:03.290 traddr: 10.0.0.2 00:07:03.290 eflags: none 00:07:03.290 sectype: none 00:07:03.290 =====Discovery Log Entry 5====== 00:07:03.290 trtype: tcp 00:07:03.290 adrfam: ipv4 00:07:03.290 subtype: discovery subsystem referral 00:07:03.290 treq: not required 00:07:03.290 portid: 0 00:07:03.290 trsvcid: 4430 00:07:03.290 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:03.290 traddr: 10.0.0.2 00:07:03.291 eflags: none 00:07:03.291 sectype: none 00:07:03.291 03:18:28 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:03.291 Perform nvmf subsystem discovery via RPC 00:07:03.291 03:18:28 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:03.291 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.291 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.291 [2024-04-27 03:18:28.109391] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:03.291 [ 00:07:03.291 { 00:07:03.291 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:03.291 "subtype": "Discovery", 00:07:03.291 "listen_addresses": [ 00:07:03.291 { 00:07:03.291 "transport": "TCP", 00:07:03.291 "trtype": "TCP", 00:07:03.291 "adrfam": "IPv4", 00:07:03.291 "traddr": "10.0.0.2", 00:07:03.291 "trsvcid": "4420" 00:07:03.291 } 00:07:03.291 ], 00:07:03.291 "allow_any_host": true, 00:07:03.291 "hosts": [] 00:07:03.291 }, 00:07:03.291 { 00:07:03.291 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:03.291 "subtype": "NVMe", 00:07:03.291 "listen_addresses": [ 00:07:03.291 { 00:07:03.291 "transport": "TCP", 00:07:03.291 "trtype": "TCP", 00:07:03.291 "adrfam": "IPv4", 00:07:03.291 "traddr": "10.0.0.2", 00:07:03.291 "trsvcid": "4420" 00:07:03.291 } 00:07:03.291 ], 00:07:03.291 "allow_any_host": true, 00:07:03.291 "hosts": [], 00:07:03.291 "serial_number": "SPDK00000000000001", 00:07:03.291 "model_number": "SPDK bdev Controller", 00:07:03.291 "max_namespaces": 32, 00:07:03.291 "min_cntlid": 1, 00:07:03.291 "max_cntlid": 65519, 00:07:03.291 "namespaces": [ 00:07:03.291 { 00:07:03.291 "nsid": 1, 00:07:03.291 "bdev_name": "Null1", 00:07:03.291 "name": "Null1", 00:07:03.291 "nguid": "A4CA2A3E8C084AE5846153D4ED832028", 00:07:03.291 "uuid": "a4ca2a3e-8c08-4ae5-8461-53d4ed832028" 00:07:03.291 } 00:07:03.291 ] 00:07:03.291 }, 00:07:03.291 { 00:07:03.291 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:03.291 "subtype": "NVMe", 00:07:03.291 "listen_addresses": [ 00:07:03.291 { 00:07:03.291 "transport": "TCP", 00:07:03.291 "trtype": "TCP", 00:07:03.291 "adrfam": "IPv4", 00:07:03.291 "traddr": "10.0.0.2", 00:07:03.291 "trsvcid": "4420" 00:07:03.291 } 00:07:03.291 ], 00:07:03.291 "allow_any_host": true, 00:07:03.291 "hosts": [], 00:07:03.291 "serial_number": "SPDK00000000000002", 00:07:03.291 "model_number": "SPDK bdev Controller", 00:07:03.291 "max_namespaces": 32, 00:07:03.291 "min_cntlid": 1, 00:07:03.291 "max_cntlid": 65519, 00:07:03.291 "namespaces": [ 00:07:03.291 { 00:07:03.291 "nsid": 1, 00:07:03.291 "bdev_name": "Null2", 00:07:03.291 "name": "Null2", 00:07:03.291 "nguid": "02DBC6870EB74043A7E996D70F95A952", 00:07:03.291 "uuid": "02dbc687-0eb7-4043-a7e9-96d70f95a952" 00:07:03.291 } 00:07:03.291 ] 00:07:03.291 }, 00:07:03.291 { 00:07:03.291 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:03.291 "subtype": "NVMe", 00:07:03.291 "listen_addresses": [ 00:07:03.291 { 00:07:03.291 "transport": "TCP", 00:07:03.291 "trtype": "TCP", 00:07:03.291 "adrfam": "IPv4", 00:07:03.291 "traddr": "10.0.0.2", 00:07:03.291 "trsvcid": "4420" 00:07:03.291 } 00:07:03.291 ], 00:07:03.291 "allow_any_host": true, 00:07:03.291 "hosts": [], 00:07:03.291 "serial_number": "SPDK00000000000003", 00:07:03.291 "model_number": "SPDK bdev Controller", 00:07:03.291 "max_namespaces": 32, 00:07:03.291 "min_cntlid": 1, 00:07:03.291 "max_cntlid": 65519, 00:07:03.291 "namespaces": [ 00:07:03.291 { 00:07:03.291 "nsid": 1, 00:07:03.291 "bdev_name": "Null3", 00:07:03.291 "name": "Null3", 00:07:03.291 "nguid": "3D68C67CE1A1421CB9ED1068B9BEE31D", 00:07:03.291 "uuid": "3d68c67c-e1a1-421c-b9ed-1068b9bee31d" 00:07:03.291 } 00:07:03.291 ] 00:07:03.291 }, 00:07:03.291 { 00:07:03.291 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:03.291 "subtype": "NVMe", 00:07:03.291 "listen_addresses": [ 00:07:03.291 { 00:07:03.291 "transport": "TCP", 00:07:03.291 "trtype": "TCP", 00:07:03.291 "adrfam": "IPv4", 00:07:03.291 "traddr": "10.0.0.2", 00:07:03.291 "trsvcid": "4420" 00:07:03.291 } 00:07:03.291 ], 00:07:03.291 "allow_any_host": true, 00:07:03.291 "hosts": [], 00:07:03.291 "serial_number": "SPDK00000000000004", 00:07:03.291 "model_number": "SPDK bdev Controller", 00:07:03.291 "max_namespaces": 32, 00:07:03.291 "min_cntlid": 1, 00:07:03.291 "max_cntlid": 65519, 00:07:03.291 "namespaces": [ 00:07:03.291 { 00:07:03.291 "nsid": 1, 00:07:03.291 "bdev_name": "Null4", 00:07:03.291 "name": "Null4", 00:07:03.291 "nguid": "120CE4A10F4F441EB30F5A3C31CA130F", 00:07:03.291 "uuid": "120ce4a1-0f4f-441e-b30f-5a3c31ca130f" 00:07:03.291 } 00:07:03.291 ] 00:07:03.291 } 00:07:03.291 ] 00:07:03.291 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.291 03:18:28 -- target/discovery.sh@42 -- # seq 1 4 00:07:03.291 03:18:28 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:03.291 03:18:28 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:03.291 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.291 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.291 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.291 03:18:28 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:03.291 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.291 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.291 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.291 03:18:28 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:03.291 03:18:28 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:03.291 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.291 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.291 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.291 03:18:28 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:03.291 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.291 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.291 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.291 03:18:28 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:03.291 03:18:28 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:03.291 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.291 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.291 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.291 03:18:28 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:03.291 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.291 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.292 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.292 03:18:28 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:03.292 03:18:28 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:03.292 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.292 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.292 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.292 03:18:28 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:03.292 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.292 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.292 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.292 03:18:28 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:03.292 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.292 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.292 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.292 03:18:28 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:03.292 03:18:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.292 03:18:28 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:03.292 03:18:28 -- common/autotest_common.sh@10 -- # set +x 00:07:03.292 03:18:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.292 03:18:28 -- target/discovery.sh@49 -- # check_bdevs= 00:07:03.292 03:18:28 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:03.292 03:18:28 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:03.292 03:18:28 -- target/discovery.sh@57 -- # nvmftestfini 00:07:03.292 03:18:28 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:03.292 03:18:28 -- nvmf/common.sh@117 -- # sync 00:07:03.292 03:18:28 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:07:03.292 03:18:28 -- nvmf/common.sh@120 -- # set +e 00:07:03.292 03:18:28 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:03.292 03:18:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:07:03.292 rmmod nvme_tcp 00:07:03.292 rmmod nvme_fabrics 00:07:03.550 rmmod nvme_keyring 00:07:03.550 03:18:28 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:03.550 03:18:28 -- nvmf/common.sh@124 -- # set -e 00:07:03.550 03:18:28 -- nvmf/common.sh@125 -- # return 0 00:07:03.550 03:18:28 -- nvmf/common.sh@478 -- # '[' -n 1360080 ']' 00:07:03.550 03:18:28 -- nvmf/common.sh@479 -- # killprocess 1360080 00:07:03.550 03:18:28 -- common/autotest_common.sh@936 -- # '[' -z 1360080 ']' 00:07:03.550 03:18:28 -- common/autotest_common.sh@940 -- # kill -0 1360080 00:07:03.550 03:18:28 -- common/autotest_common.sh@941 -- # uname 00:07:03.550 03:18:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:03.550 03:18:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1360080 00:07:03.550 03:18:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:03.550 03:18:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:03.550 03:18:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1360080' 00:07:03.550 killing process with pid 1360080 00:07:03.550 03:18:28 -- common/autotest_common.sh@955 -- # kill 1360080 00:07:03.550 [2024-04-27 03:18:28.317283] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:03.550 03:18:28 -- common/autotest_common.sh@960 -- # wait 1360080 00:07:03.810 03:18:28 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:03.810 03:18:28 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:07:03.810 03:18:28 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:07:03.810 03:18:28 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:03.810 03:18:28 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:07:03.810 03:18:28 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:03.810 03:18:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:03.810 03:18:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:05.714 03:18:30 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:07:05.714 00:07:05.714 real 0m6.234s 00:07:05.714 user 0m7.399s 00:07:05.714 sys 0m1.913s 00:07:05.714 03:18:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:05.714 03:18:30 -- common/autotest_common.sh@10 -- # set +x 00:07:05.714 ************************************ 00:07:05.714 END TEST nvmf_discovery 00:07:05.714 ************************************ 00:07:05.714 03:18:30 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:05.714 03:18:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:05.714 03:18:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.714 03:18:30 -- common/autotest_common.sh@10 -- # set +x 00:07:05.972 ************************************ 00:07:05.972 START TEST nvmf_referrals 00:07:05.973 ************************************ 00:07:05.973 03:18:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:05.973 * Looking for test storage... 00:07:05.973 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:05.973 03:18:30 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:05.973 03:18:30 -- nvmf/common.sh@7 -- # uname -s 00:07:05.973 03:18:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:05.973 03:18:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:05.973 03:18:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:05.973 03:18:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:05.973 03:18:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:05.973 03:18:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:05.973 03:18:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:05.973 03:18:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:05.973 03:18:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:05.973 03:18:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:05.973 03:18:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:07:05.973 03:18:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:07:05.973 03:18:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:05.973 03:18:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:05.973 03:18:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:05.973 03:18:30 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:05.973 03:18:30 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:05.973 03:18:30 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:05.973 03:18:30 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:05.973 03:18:30 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:05.973 03:18:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:05.973 03:18:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:05.973 03:18:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:05.973 03:18:30 -- paths/export.sh@5 -- # export PATH 00:07:05.973 03:18:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:05.973 03:18:30 -- nvmf/common.sh@47 -- # : 0 00:07:05.973 03:18:30 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:05.973 03:18:30 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:05.973 03:18:30 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:05.973 03:18:30 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:05.973 03:18:30 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:05.973 03:18:30 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:05.973 03:18:30 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:05.973 03:18:30 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:05.973 03:18:30 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:05.973 03:18:30 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:05.973 03:18:30 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:05.973 03:18:30 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:05.973 03:18:30 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:05.973 03:18:30 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:05.973 03:18:30 -- target/referrals.sh@37 -- # nvmftestinit 00:07:05.973 03:18:30 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:07:05.973 03:18:30 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:05.973 03:18:30 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:05.973 03:18:30 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:05.973 03:18:30 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:05.973 03:18:30 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:05.973 03:18:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:05.973 03:18:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:05.973 03:18:30 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:05.973 03:18:30 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:05.973 03:18:30 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:05.973 03:18:30 -- common/autotest_common.sh@10 -- # set +x 00:07:07.875 03:18:32 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:07.875 03:18:32 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:07.875 03:18:32 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:07.875 03:18:32 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:07.875 03:18:32 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:07.875 03:18:32 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:07.875 03:18:32 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:07.875 03:18:32 -- nvmf/common.sh@295 -- # net_devs=() 00:07:07.875 03:18:32 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:07.875 03:18:32 -- nvmf/common.sh@296 -- # e810=() 00:07:07.875 03:18:32 -- nvmf/common.sh@296 -- # local -ga e810 00:07:07.875 03:18:32 -- nvmf/common.sh@297 -- # x722=() 00:07:07.875 03:18:32 -- nvmf/common.sh@297 -- # local -ga x722 00:07:07.875 03:18:32 -- nvmf/common.sh@298 -- # mlx=() 00:07:07.875 03:18:32 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:07.875 03:18:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:07.875 03:18:32 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:07.875 03:18:32 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:07:07.875 03:18:32 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:07.875 03:18:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:07.875 03:18:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:07:07.875 Found 0000:09:00.0 (0x8086 - 0x159b) 00:07:07.875 03:18:32 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:07.875 03:18:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:07:07.875 Found 0000:09:00.1 (0x8086 - 0x159b) 00:07:07.875 03:18:32 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:07.875 03:18:32 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:07.875 03:18:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:07.875 03:18:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:07.875 03:18:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:07.875 03:18:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:07:07.875 Found net devices under 0000:09:00.0: cvl_0_0 00:07:07.875 03:18:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:07.875 03:18:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:07.875 03:18:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:07.875 03:18:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:07.875 03:18:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:07.875 03:18:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:07:07.875 Found net devices under 0000:09:00.1: cvl_0_1 00:07:07.875 03:18:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:07.875 03:18:32 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:07.875 03:18:32 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:07.875 03:18:32 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:07:07.875 03:18:32 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:07:07.875 03:18:32 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:07.875 03:18:32 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:07.875 03:18:32 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:07.875 03:18:32 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:07:07.875 03:18:32 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:07.875 03:18:32 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:07.875 03:18:32 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:07:07.875 03:18:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:07.875 03:18:32 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:07.876 03:18:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:07:07.876 03:18:32 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:07:07.876 03:18:32 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:07:07.876 03:18:32 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:08.134 03:18:32 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:08.134 03:18:32 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:08.134 03:18:32 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:07:08.134 03:18:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:08.134 03:18:32 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:08.134 03:18:32 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:08.134 03:18:32 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:07:08.134 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:08.134 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:07:08.134 00:07:08.134 --- 10.0.0.2 ping statistics --- 00:07:08.134 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:08.134 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:07:08.134 03:18:32 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:08.134 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:08.134 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:07:08.134 00:07:08.134 --- 10.0.0.1 ping statistics --- 00:07:08.134 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:08.134 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:07:08.134 03:18:32 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:08.134 03:18:32 -- nvmf/common.sh@411 -- # return 0 00:07:08.134 03:18:32 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:08.134 03:18:32 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:08.134 03:18:32 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:07:08.134 03:18:32 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:07:08.134 03:18:32 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:08.134 03:18:32 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:07:08.134 03:18:32 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:07:08.134 03:18:32 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:08.134 03:18:32 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:08.134 03:18:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:08.134 03:18:32 -- common/autotest_common.sh@10 -- # set +x 00:07:08.134 03:18:32 -- nvmf/common.sh@470 -- # nvmfpid=1362190 00:07:08.134 03:18:32 -- nvmf/common.sh@471 -- # waitforlisten 1362190 00:07:08.134 03:18:32 -- common/autotest_common.sh@817 -- # '[' -z 1362190 ']' 00:07:08.134 03:18:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:08.134 03:18:32 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:08.134 03:18:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:08.134 03:18:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:08.134 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:08.134 03:18:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:08.134 03:18:32 -- common/autotest_common.sh@10 -- # set +x 00:07:08.134 [2024-04-27 03:18:33.041559] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:07:08.134 [2024-04-27 03:18:33.041635] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:08.134 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.134 [2024-04-27 03:18:33.110543] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:08.393 [2024-04-27 03:18:33.231127] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:08.393 [2024-04-27 03:18:33.231189] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:08.393 [2024-04-27 03:18:33.231205] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:08.393 [2024-04-27 03:18:33.231219] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:08.393 [2024-04-27 03:18:33.231241] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:08.393 [2024-04-27 03:18:33.231321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:08.393 [2024-04-27 03:18:33.231374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:08.393 [2024-04-27 03:18:33.231407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:08.393 [2024-04-27 03:18:33.231410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.326 03:18:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:09.326 03:18:33 -- common/autotest_common.sh@850 -- # return 0 00:07:09.326 03:18:33 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:09.326 03:18:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:09.326 03:18:33 -- common/autotest_common.sh@10 -- # set +x 00:07:09.326 03:18:34 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:09.326 03:18:34 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:09.326 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.326 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.326 [2024-04-27 03:18:34.019345] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:09.326 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.326 03:18:34 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:09.326 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.326 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.326 [2024-04-27 03:18:34.031541] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:09.326 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.326 03:18:34 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:09.326 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.326 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.326 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.326 03:18:34 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:09.326 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.326 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.326 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.326 03:18:34 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:09.326 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.326 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.326 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.326 03:18:34 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:09.326 03:18:34 -- target/referrals.sh@48 -- # jq length 00:07:09.326 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.326 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.326 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.326 03:18:34 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:09.326 03:18:34 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:09.326 03:18:34 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:09.326 03:18:34 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:09.326 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.326 03:18:34 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:09.326 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.326 03:18:34 -- target/referrals.sh@21 -- # sort 00:07:09.326 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.326 03:18:34 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:09.326 03:18:34 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:09.326 03:18:34 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:09.327 03:18:34 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:09.327 03:18:34 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:09.327 03:18:34 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:09.327 03:18:34 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:09.327 03:18:34 -- target/referrals.sh@26 -- # sort 00:07:09.327 03:18:34 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:09.327 03:18:34 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:09.327 03:18:34 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:09.327 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.327 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.584 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.584 03:18:34 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:09.584 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.584 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.584 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.584 03:18:34 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:09.584 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.584 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.584 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.584 03:18:34 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:09.584 03:18:34 -- target/referrals.sh@56 -- # jq length 00:07:09.584 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.584 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.584 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.584 03:18:34 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:09.584 03:18:34 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:09.584 03:18:34 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:09.584 03:18:34 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:09.584 03:18:34 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:09.584 03:18:34 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:09.584 03:18:34 -- target/referrals.sh@26 -- # sort 00:07:09.584 03:18:34 -- target/referrals.sh@26 -- # echo 00:07:09.584 03:18:34 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:09.584 03:18:34 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:09.584 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.584 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.584 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.584 03:18:34 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:09.584 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.584 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.584 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.584 03:18:34 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:09.584 03:18:34 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:09.584 03:18:34 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:09.584 03:18:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.584 03:18:34 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:09.584 03:18:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.584 03:18:34 -- target/referrals.sh@21 -- # sort 00:07:09.584 03:18:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.584 03:18:34 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:09.584 03:18:34 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:09.584 03:18:34 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:09.584 03:18:34 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:09.584 03:18:34 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:09.584 03:18:34 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:09.584 03:18:34 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:09.584 03:18:34 -- target/referrals.sh@26 -- # sort 00:07:09.841 03:18:34 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:09.841 03:18:34 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:09.841 03:18:34 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:09.841 03:18:34 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:09.841 03:18:34 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:09.841 03:18:34 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:09.841 03:18:34 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:10.099 03:18:34 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:10.099 03:18:34 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:10.099 03:18:34 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:10.099 03:18:34 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:10.099 03:18:34 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:10.099 03:18:34 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:10.099 03:18:35 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:10.099 03:18:35 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:10.099 03:18:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:10.099 03:18:35 -- common/autotest_common.sh@10 -- # set +x 00:07:10.099 03:18:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:10.099 03:18:35 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:10.099 03:18:35 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:10.099 03:18:35 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:10.099 03:18:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:10.099 03:18:35 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:10.099 03:18:35 -- common/autotest_common.sh@10 -- # set +x 00:07:10.099 03:18:35 -- target/referrals.sh@21 -- # sort 00:07:10.099 03:18:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:10.357 03:18:35 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:10.357 03:18:35 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:10.357 03:18:35 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:10.357 03:18:35 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:10.357 03:18:35 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:10.357 03:18:35 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:10.357 03:18:35 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:10.357 03:18:35 -- target/referrals.sh@26 -- # sort 00:07:10.357 03:18:35 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:10.357 03:18:35 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:10.357 03:18:35 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:10.357 03:18:35 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:10.357 03:18:35 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:10.357 03:18:35 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:10.357 03:18:35 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:10.357 03:18:35 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:10.357 03:18:35 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:10.357 03:18:35 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:10.357 03:18:35 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:10.357 03:18:35 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:10.357 03:18:35 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:10.615 03:18:35 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:10.615 03:18:35 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:10.615 03:18:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:10.615 03:18:35 -- common/autotest_common.sh@10 -- # set +x 00:07:10.615 03:18:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:10.615 03:18:35 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:10.615 03:18:35 -- target/referrals.sh@82 -- # jq length 00:07:10.615 03:18:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:10.615 03:18:35 -- common/autotest_common.sh@10 -- # set +x 00:07:10.615 03:18:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:10.615 03:18:35 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:10.615 03:18:35 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:10.615 03:18:35 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:10.615 03:18:35 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:10.615 03:18:35 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:10.615 03:18:35 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:10.615 03:18:35 -- target/referrals.sh@26 -- # sort 00:07:10.873 03:18:35 -- target/referrals.sh@26 -- # echo 00:07:10.873 03:18:35 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:10.873 03:18:35 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:10.873 03:18:35 -- target/referrals.sh@86 -- # nvmftestfini 00:07:10.873 03:18:35 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:10.873 03:18:35 -- nvmf/common.sh@117 -- # sync 00:07:10.873 03:18:35 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:07:10.873 03:18:35 -- nvmf/common.sh@120 -- # set +e 00:07:10.873 03:18:35 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:10.873 03:18:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:07:10.873 rmmod nvme_tcp 00:07:10.873 rmmod nvme_fabrics 00:07:10.873 rmmod nvme_keyring 00:07:10.873 03:18:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:10.873 03:18:35 -- nvmf/common.sh@124 -- # set -e 00:07:10.873 03:18:35 -- nvmf/common.sh@125 -- # return 0 00:07:10.873 03:18:35 -- nvmf/common.sh@478 -- # '[' -n 1362190 ']' 00:07:10.873 03:18:35 -- nvmf/common.sh@479 -- # killprocess 1362190 00:07:10.873 03:18:35 -- common/autotest_common.sh@936 -- # '[' -z 1362190 ']' 00:07:10.873 03:18:35 -- common/autotest_common.sh@940 -- # kill -0 1362190 00:07:10.873 03:18:35 -- common/autotest_common.sh@941 -- # uname 00:07:10.873 03:18:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:10.873 03:18:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1362190 00:07:10.873 03:18:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:10.873 03:18:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:10.873 03:18:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1362190' 00:07:10.873 killing process with pid 1362190 00:07:10.873 03:18:35 -- common/autotest_common.sh@955 -- # kill 1362190 00:07:10.873 03:18:35 -- common/autotest_common.sh@960 -- # wait 1362190 00:07:11.133 03:18:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:11.133 03:18:35 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:07:11.133 03:18:35 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:07:11.133 03:18:35 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:11.133 03:18:35 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:07:11.133 03:18:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:11.133 03:18:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:11.133 03:18:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:13.670 03:18:38 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:07:13.670 00:07:13.670 real 0m7.253s 00:07:13.670 user 0m12.355s 00:07:13.670 sys 0m2.164s 00:07:13.670 03:18:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:13.670 03:18:38 -- common/autotest_common.sh@10 -- # set +x 00:07:13.670 ************************************ 00:07:13.670 END TEST nvmf_referrals 00:07:13.670 ************************************ 00:07:13.670 03:18:38 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:13.670 03:18:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:13.670 03:18:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.670 03:18:38 -- common/autotest_common.sh@10 -- # set +x 00:07:13.670 ************************************ 00:07:13.670 START TEST nvmf_connect_disconnect 00:07:13.670 ************************************ 00:07:13.670 03:18:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:13.670 * Looking for test storage... 00:07:13.670 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:13.670 03:18:38 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:13.670 03:18:38 -- nvmf/common.sh@7 -- # uname -s 00:07:13.670 03:18:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:13.670 03:18:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:13.670 03:18:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:13.670 03:18:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:13.670 03:18:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:13.670 03:18:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:13.670 03:18:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:13.670 03:18:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:13.670 03:18:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:13.670 03:18:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:13.670 03:18:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:07:13.670 03:18:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:07:13.670 03:18:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:13.670 03:18:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:13.670 03:18:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:13.670 03:18:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:13.670 03:18:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:13.670 03:18:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:13.670 03:18:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:13.670 03:18:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:13.670 03:18:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:13.670 03:18:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:13.670 03:18:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:13.670 03:18:38 -- paths/export.sh@5 -- # export PATH 00:07:13.670 03:18:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:13.670 03:18:38 -- nvmf/common.sh@47 -- # : 0 00:07:13.670 03:18:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:13.670 03:18:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:13.670 03:18:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:13.670 03:18:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:13.670 03:18:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:13.670 03:18:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:13.670 03:18:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:13.670 03:18:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:13.670 03:18:38 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:13.670 03:18:38 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:13.670 03:18:38 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:13.670 03:18:38 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:07:13.670 03:18:38 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:13.670 03:18:38 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:13.670 03:18:38 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:13.670 03:18:38 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:13.670 03:18:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:13.670 03:18:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:13.670 03:18:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:13.670 03:18:38 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:13.670 03:18:38 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:13.670 03:18:38 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:13.670 03:18:38 -- common/autotest_common.sh@10 -- # set +x 00:07:15.573 03:18:40 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:15.573 03:18:40 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:15.573 03:18:40 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:15.573 03:18:40 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:15.573 03:18:40 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:15.573 03:18:40 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:15.573 03:18:40 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:15.573 03:18:40 -- nvmf/common.sh@295 -- # net_devs=() 00:07:15.573 03:18:40 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:15.573 03:18:40 -- nvmf/common.sh@296 -- # e810=() 00:07:15.573 03:18:40 -- nvmf/common.sh@296 -- # local -ga e810 00:07:15.573 03:18:40 -- nvmf/common.sh@297 -- # x722=() 00:07:15.573 03:18:40 -- nvmf/common.sh@297 -- # local -ga x722 00:07:15.573 03:18:40 -- nvmf/common.sh@298 -- # mlx=() 00:07:15.573 03:18:40 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:15.573 03:18:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:15.573 03:18:40 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:15.573 03:18:40 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:15.573 03:18:40 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:15.573 03:18:40 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:15.573 03:18:40 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:15.573 03:18:40 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:15.573 03:18:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:15.574 03:18:40 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:15.574 03:18:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:15.574 03:18:40 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:15.574 03:18:40 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:15.574 03:18:40 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:07:15.574 03:18:40 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:15.574 03:18:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:15.574 03:18:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:07:15.574 Found 0000:09:00.0 (0x8086 - 0x159b) 00:07:15.574 03:18:40 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:15.574 03:18:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:07:15.574 Found 0000:09:00.1 (0x8086 - 0x159b) 00:07:15.574 03:18:40 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:15.574 03:18:40 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:15.574 03:18:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:15.574 03:18:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:15.574 03:18:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:15.574 03:18:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:07:15.574 Found net devices under 0000:09:00.0: cvl_0_0 00:07:15.574 03:18:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:15.574 03:18:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:15.574 03:18:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:15.574 03:18:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:15.574 03:18:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:15.574 03:18:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:07:15.574 Found net devices under 0000:09:00.1: cvl_0_1 00:07:15.574 03:18:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:15.574 03:18:40 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:15.574 03:18:40 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:15.574 03:18:40 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:07:15.574 03:18:40 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:15.574 03:18:40 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:15.574 03:18:40 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:15.574 03:18:40 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:07:15.574 03:18:40 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:15.574 03:18:40 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:15.574 03:18:40 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:07:15.574 03:18:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:15.574 03:18:40 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:15.574 03:18:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:07:15.574 03:18:40 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:07:15.574 03:18:40 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:07:15.574 03:18:40 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:15.574 03:18:40 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:15.574 03:18:40 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:15.574 03:18:40 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:07:15.574 03:18:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:15.574 03:18:40 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:15.574 03:18:40 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:15.574 03:18:40 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:07:15.574 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:15.574 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:07:15.574 00:07:15.574 --- 10.0.0.2 ping statistics --- 00:07:15.574 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:15.574 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:07:15.574 03:18:40 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:15.574 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:15.574 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:07:15.574 00:07:15.574 --- 10.0.0.1 ping statistics --- 00:07:15.574 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:15.574 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:07:15.574 03:18:40 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:15.574 03:18:40 -- nvmf/common.sh@411 -- # return 0 00:07:15.574 03:18:40 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:15.574 03:18:40 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:15.574 03:18:40 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:07:15.574 03:18:40 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:15.574 03:18:40 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:07:15.574 03:18:40 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:07:15.574 03:18:40 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:15.574 03:18:40 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:15.574 03:18:40 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:15.574 03:18:40 -- common/autotest_common.sh@10 -- # set +x 00:07:15.574 03:18:40 -- nvmf/common.sh@470 -- # nvmfpid=1364612 00:07:15.574 03:18:40 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:15.574 03:18:40 -- nvmf/common.sh@471 -- # waitforlisten 1364612 00:07:15.574 03:18:40 -- common/autotest_common.sh@817 -- # '[' -z 1364612 ']' 00:07:15.574 03:18:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:15.574 03:18:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:15.574 03:18:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:15.574 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:15.574 03:18:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:15.574 03:18:40 -- common/autotest_common.sh@10 -- # set +x 00:07:15.574 [2024-04-27 03:18:40.372944] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:07:15.574 [2024-04-27 03:18:40.373043] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:15.574 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.574 [2024-04-27 03:18:40.443243] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:15.832 [2024-04-27 03:18:40.557297] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:15.832 [2024-04-27 03:18:40.557345] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:15.832 [2024-04-27 03:18:40.557374] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:15.832 [2024-04-27 03:18:40.557386] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:15.833 [2024-04-27 03:18:40.557396] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:15.833 [2024-04-27 03:18:40.557461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:15.833 [2024-04-27 03:18:40.557515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:15.833 [2024-04-27 03:18:40.557519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.833 [2024-04-27 03:18:40.557486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:15.833 03:18:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:15.833 03:18:40 -- common/autotest_common.sh@850 -- # return 0 00:07:15.833 03:18:40 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:15.833 03:18:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:15.833 03:18:40 -- common/autotest_common.sh@10 -- # set +x 00:07:15.833 03:18:40 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:15.833 03:18:40 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:15.833 03:18:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:15.833 03:18:40 -- common/autotest_common.sh@10 -- # set +x 00:07:15.833 [2024-04-27 03:18:40.711847] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:15.833 03:18:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:15.833 03:18:40 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:15.833 03:18:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:15.833 03:18:40 -- common/autotest_common.sh@10 -- # set +x 00:07:15.833 03:18:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:15.833 03:18:40 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:15.833 03:18:40 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:15.833 03:18:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:15.833 03:18:40 -- common/autotest_common.sh@10 -- # set +x 00:07:15.833 03:18:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:15.833 03:18:40 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:15.833 03:18:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:15.833 03:18:40 -- common/autotest_common.sh@10 -- # set +x 00:07:15.833 03:18:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:15.833 03:18:40 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:15.833 03:18:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:15.833 03:18:40 -- common/autotest_common.sh@10 -- # set +x 00:07:15.833 [2024-04-27 03:18:40.762856] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:15.833 03:18:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:15.833 03:18:40 -- target/connect_disconnect.sh@26 -- # '[' 0 -eq 1 ']' 00:07:15.833 03:18:40 -- target/connect_disconnect.sh@31 -- # num_iterations=5 00:07:15.833 03:18:40 -- target/connect_disconnect.sh@34 -- # set +x 00:07:19.112 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:21.643 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:24.169 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:26.692 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:29.968 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:29.968 03:18:54 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:07:29.968 03:18:54 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:07:29.968 03:18:54 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:29.968 03:18:54 -- nvmf/common.sh@117 -- # sync 00:07:29.968 03:18:54 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:07:29.968 03:18:54 -- nvmf/common.sh@120 -- # set +e 00:07:29.968 03:18:54 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:29.968 03:18:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:07:29.968 rmmod nvme_tcp 00:07:29.968 rmmod nvme_fabrics 00:07:29.968 rmmod nvme_keyring 00:07:29.968 03:18:54 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:29.968 03:18:54 -- nvmf/common.sh@124 -- # set -e 00:07:29.968 03:18:54 -- nvmf/common.sh@125 -- # return 0 00:07:29.968 03:18:54 -- nvmf/common.sh@478 -- # '[' -n 1364612 ']' 00:07:29.968 03:18:54 -- nvmf/common.sh@479 -- # killprocess 1364612 00:07:29.968 03:18:54 -- common/autotest_common.sh@936 -- # '[' -z 1364612 ']' 00:07:29.968 03:18:54 -- common/autotest_common.sh@940 -- # kill -0 1364612 00:07:29.968 03:18:54 -- common/autotest_common.sh@941 -- # uname 00:07:29.968 03:18:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:29.968 03:18:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1364612 00:07:29.968 03:18:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:29.968 03:18:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:29.968 03:18:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1364612' 00:07:29.968 killing process with pid 1364612 00:07:29.968 03:18:54 -- common/autotest_common.sh@955 -- # kill 1364612 00:07:29.968 03:18:54 -- common/autotest_common.sh@960 -- # wait 1364612 00:07:29.968 03:18:54 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:29.968 03:18:54 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:07:29.968 03:18:54 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:07:29.968 03:18:54 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:29.968 03:18:54 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:07:29.968 03:18:54 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:29.968 03:18:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:29.968 03:18:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:31.875 03:18:56 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:07:31.875 00:07:31.875 real 0m18.644s 00:07:31.875 user 0m56.075s 00:07:31.875 sys 0m3.308s 00:07:31.875 03:18:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:31.875 03:18:56 -- common/autotest_common.sh@10 -- # set +x 00:07:31.875 ************************************ 00:07:31.875 END TEST nvmf_connect_disconnect 00:07:31.875 ************************************ 00:07:31.875 03:18:56 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:07:31.875 03:18:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:31.875 03:18:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:31.875 03:18:56 -- common/autotest_common.sh@10 -- # set +x 00:07:32.134 ************************************ 00:07:32.134 START TEST nvmf_multitarget 00:07:32.134 ************************************ 00:07:32.134 03:18:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:07:32.134 * Looking for test storage... 00:07:32.134 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:32.134 03:18:56 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:32.134 03:18:56 -- nvmf/common.sh@7 -- # uname -s 00:07:32.134 03:18:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:32.134 03:18:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:32.134 03:18:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:32.134 03:18:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:32.134 03:18:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:32.134 03:18:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:32.134 03:18:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:32.134 03:18:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:32.134 03:18:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:32.134 03:18:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:32.134 03:18:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:07:32.134 03:18:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:07:32.134 03:18:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:32.134 03:18:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:32.134 03:18:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:32.134 03:18:56 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:32.134 03:18:56 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:32.134 03:18:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:32.134 03:18:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:32.134 03:18:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:32.134 03:18:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:32.134 03:18:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:32.134 03:18:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:32.134 03:18:56 -- paths/export.sh@5 -- # export PATH 00:07:32.134 03:18:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:32.134 03:18:56 -- nvmf/common.sh@47 -- # : 0 00:07:32.134 03:18:56 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:32.134 03:18:56 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:32.134 03:18:56 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:32.134 03:18:56 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:32.134 03:18:56 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:32.134 03:18:56 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:32.134 03:18:56 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:32.134 03:18:56 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:32.134 03:18:56 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:07:32.134 03:18:56 -- target/multitarget.sh@15 -- # nvmftestinit 00:07:32.134 03:18:56 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:07:32.134 03:18:56 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:32.134 03:18:56 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:32.135 03:18:56 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:32.135 03:18:56 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:32.135 03:18:56 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:32.135 03:18:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:32.135 03:18:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:32.135 03:18:56 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:32.135 03:18:56 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:32.135 03:18:56 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:32.135 03:18:56 -- common/autotest_common.sh@10 -- # set +x 00:07:34.037 03:18:58 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:34.037 03:18:58 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:34.037 03:18:58 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:34.037 03:18:58 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:34.037 03:18:58 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:34.037 03:18:58 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:34.037 03:18:58 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:34.037 03:18:58 -- nvmf/common.sh@295 -- # net_devs=() 00:07:34.037 03:18:58 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:34.037 03:18:58 -- nvmf/common.sh@296 -- # e810=() 00:07:34.037 03:18:58 -- nvmf/common.sh@296 -- # local -ga e810 00:07:34.037 03:18:58 -- nvmf/common.sh@297 -- # x722=() 00:07:34.037 03:18:58 -- nvmf/common.sh@297 -- # local -ga x722 00:07:34.037 03:18:58 -- nvmf/common.sh@298 -- # mlx=() 00:07:34.037 03:18:58 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:34.037 03:18:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:34.037 03:18:58 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:34.037 03:18:58 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:07:34.037 03:18:58 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:34.037 03:18:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:34.037 03:18:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:07:34.037 Found 0000:09:00.0 (0x8086 - 0x159b) 00:07:34.037 03:18:58 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:34.037 03:18:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:07:34.037 Found 0000:09:00.1 (0x8086 - 0x159b) 00:07:34.037 03:18:58 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:34.037 03:18:58 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:34.037 03:18:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:34.037 03:18:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:34.037 03:18:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:34.037 03:18:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:07:34.037 Found net devices under 0000:09:00.0: cvl_0_0 00:07:34.037 03:18:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:34.037 03:18:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:34.037 03:18:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:34.037 03:18:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:34.037 03:18:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:34.037 03:18:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:07:34.037 Found net devices under 0000:09:00.1: cvl_0_1 00:07:34.037 03:18:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:34.037 03:18:58 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:34.037 03:18:58 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:34.037 03:18:58 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:07:34.037 03:18:58 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:07:34.037 03:18:58 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:34.037 03:18:58 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:34.037 03:18:58 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:34.037 03:18:58 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:07:34.037 03:18:58 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:34.037 03:18:58 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:34.037 03:18:58 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:07:34.037 03:18:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:34.037 03:18:58 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:34.037 03:18:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:07:34.037 03:18:58 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:07:34.037 03:18:58 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:07:34.037 03:18:58 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:34.037 03:18:59 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:34.037 03:18:59 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:34.296 03:18:59 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:07:34.296 03:18:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:34.296 03:18:59 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:34.296 03:18:59 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:34.296 03:18:59 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:07:34.296 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:34.296 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.167 ms 00:07:34.296 00:07:34.296 --- 10.0.0.2 ping statistics --- 00:07:34.296 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:34.296 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:07:34.296 03:18:59 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:34.296 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:34.296 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:07:34.296 00:07:34.296 --- 10.0.0.1 ping statistics --- 00:07:34.296 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:34.296 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:07:34.296 03:18:59 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:34.296 03:18:59 -- nvmf/common.sh@411 -- # return 0 00:07:34.296 03:18:59 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:34.296 03:18:59 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:34.296 03:18:59 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:07:34.296 03:18:59 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:07:34.296 03:18:59 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:34.296 03:18:59 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:07:34.296 03:18:59 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:07:34.296 03:18:59 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:07:34.296 03:18:59 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:34.296 03:18:59 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:34.296 03:18:59 -- common/autotest_common.sh@10 -- # set +x 00:07:34.296 03:18:59 -- nvmf/common.sh@470 -- # nvmfpid=1368269 00:07:34.296 03:18:59 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:34.296 03:18:59 -- nvmf/common.sh@471 -- # waitforlisten 1368269 00:07:34.296 03:18:59 -- common/autotest_common.sh@817 -- # '[' -z 1368269 ']' 00:07:34.296 03:18:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:34.296 03:18:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:34.296 03:18:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:34.296 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:34.296 03:18:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:34.296 03:18:59 -- common/autotest_common.sh@10 -- # set +x 00:07:34.296 [2024-04-27 03:18:59.153593] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:07:34.296 [2024-04-27 03:18:59.153666] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:34.296 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.296 [2024-04-27 03:18:59.222312] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:34.554 [2024-04-27 03:18:59.342941] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:34.554 [2024-04-27 03:18:59.343009] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:34.554 [2024-04-27 03:18:59.343026] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:34.554 [2024-04-27 03:18:59.343039] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:34.554 [2024-04-27 03:18:59.343051] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:34.554 [2024-04-27 03:18:59.343116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:34.554 [2024-04-27 03:18:59.343172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:34.554 [2024-04-27 03:18:59.343205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:34.554 [2024-04-27 03:18:59.343207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.486 03:19:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:35.486 03:19:00 -- common/autotest_common.sh@850 -- # return 0 00:07:35.486 03:19:00 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:35.486 03:19:00 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:35.486 03:19:00 -- common/autotest_common.sh@10 -- # set +x 00:07:35.486 03:19:00 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:35.486 03:19:00 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:07:35.486 03:19:00 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:07:35.486 03:19:00 -- target/multitarget.sh@21 -- # jq length 00:07:35.486 03:19:00 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:07:35.486 03:19:00 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:07:35.486 "nvmf_tgt_1" 00:07:35.486 03:19:00 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:07:35.744 "nvmf_tgt_2" 00:07:35.744 03:19:00 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:07:35.744 03:19:00 -- target/multitarget.sh@28 -- # jq length 00:07:35.744 03:19:00 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:07:35.744 03:19:00 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:07:35.744 true 00:07:35.744 03:19:00 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:07:36.002 true 00:07:36.002 03:19:00 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:07:36.002 03:19:00 -- target/multitarget.sh@35 -- # jq length 00:07:36.002 03:19:00 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:07:36.002 03:19:00 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:07:36.002 03:19:00 -- target/multitarget.sh@41 -- # nvmftestfini 00:07:36.002 03:19:00 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:36.002 03:19:00 -- nvmf/common.sh@117 -- # sync 00:07:36.002 03:19:00 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:07:36.002 03:19:00 -- nvmf/common.sh@120 -- # set +e 00:07:36.002 03:19:00 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:36.002 03:19:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:07:36.002 rmmod nvme_tcp 00:07:36.002 rmmod nvme_fabrics 00:07:36.002 rmmod nvme_keyring 00:07:36.261 03:19:00 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:36.261 03:19:00 -- nvmf/common.sh@124 -- # set -e 00:07:36.261 03:19:00 -- nvmf/common.sh@125 -- # return 0 00:07:36.261 03:19:00 -- nvmf/common.sh@478 -- # '[' -n 1368269 ']' 00:07:36.261 03:19:00 -- nvmf/common.sh@479 -- # killprocess 1368269 00:07:36.261 03:19:00 -- common/autotest_common.sh@936 -- # '[' -z 1368269 ']' 00:07:36.261 03:19:00 -- common/autotest_common.sh@940 -- # kill -0 1368269 00:07:36.261 03:19:01 -- common/autotest_common.sh@941 -- # uname 00:07:36.261 03:19:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:36.261 03:19:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1368269 00:07:36.261 03:19:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:36.261 03:19:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:36.261 03:19:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1368269' 00:07:36.261 killing process with pid 1368269 00:07:36.261 03:19:01 -- common/autotest_common.sh@955 -- # kill 1368269 00:07:36.261 03:19:01 -- common/autotest_common.sh@960 -- # wait 1368269 00:07:36.521 03:19:01 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:36.521 03:19:01 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:07:36.521 03:19:01 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:07:36.521 03:19:01 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:36.521 03:19:01 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:07:36.521 03:19:01 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:36.521 03:19:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:36.521 03:19:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:38.427 03:19:03 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:07:38.427 00:07:38.427 real 0m6.449s 00:07:38.427 user 0m9.364s 00:07:38.427 sys 0m1.980s 00:07:38.427 03:19:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:38.427 03:19:03 -- common/autotest_common.sh@10 -- # set +x 00:07:38.427 ************************************ 00:07:38.427 END TEST nvmf_multitarget 00:07:38.427 ************************************ 00:07:38.427 03:19:03 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:07:38.427 03:19:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:38.427 03:19:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.427 03:19:03 -- common/autotest_common.sh@10 -- # set +x 00:07:38.685 ************************************ 00:07:38.685 START TEST nvmf_rpc 00:07:38.685 ************************************ 00:07:38.685 03:19:03 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:07:38.685 * Looking for test storage... 00:07:38.685 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:38.685 03:19:03 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:38.685 03:19:03 -- nvmf/common.sh@7 -- # uname -s 00:07:38.685 03:19:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:38.685 03:19:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:38.685 03:19:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:38.685 03:19:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:38.685 03:19:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:38.685 03:19:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:38.685 03:19:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:38.685 03:19:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:38.685 03:19:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:38.685 03:19:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:38.685 03:19:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:07:38.685 03:19:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:07:38.685 03:19:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:38.685 03:19:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:38.685 03:19:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:38.685 03:19:03 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:38.685 03:19:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:38.685 03:19:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:38.685 03:19:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:38.685 03:19:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:38.686 03:19:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.686 03:19:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.686 03:19:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.686 03:19:03 -- paths/export.sh@5 -- # export PATH 00:07:38.686 03:19:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.686 03:19:03 -- nvmf/common.sh@47 -- # : 0 00:07:38.686 03:19:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:38.686 03:19:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:38.686 03:19:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:38.686 03:19:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:38.686 03:19:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:38.686 03:19:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:38.686 03:19:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:38.686 03:19:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:38.686 03:19:03 -- target/rpc.sh@11 -- # loops=5 00:07:38.686 03:19:03 -- target/rpc.sh@23 -- # nvmftestinit 00:07:38.686 03:19:03 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:07:38.686 03:19:03 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:38.686 03:19:03 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:38.686 03:19:03 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:38.686 03:19:03 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:38.686 03:19:03 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:38.686 03:19:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:38.686 03:19:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:38.686 03:19:03 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:38.686 03:19:03 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:38.686 03:19:03 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:38.686 03:19:03 -- common/autotest_common.sh@10 -- # set +x 00:07:41.218 03:19:05 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:41.218 03:19:05 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:41.218 03:19:05 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:41.218 03:19:05 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:41.218 03:19:05 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:41.218 03:19:05 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:41.218 03:19:05 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:41.218 03:19:05 -- nvmf/common.sh@295 -- # net_devs=() 00:07:41.218 03:19:05 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:41.218 03:19:05 -- nvmf/common.sh@296 -- # e810=() 00:07:41.218 03:19:05 -- nvmf/common.sh@296 -- # local -ga e810 00:07:41.218 03:19:05 -- nvmf/common.sh@297 -- # x722=() 00:07:41.218 03:19:05 -- nvmf/common.sh@297 -- # local -ga x722 00:07:41.218 03:19:05 -- nvmf/common.sh@298 -- # mlx=() 00:07:41.218 03:19:05 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:41.218 03:19:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:41.218 03:19:05 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:41.218 03:19:05 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:07:41.218 03:19:05 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:41.218 03:19:05 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:41.218 03:19:05 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:07:41.218 Found 0000:09:00.0 (0x8086 - 0x159b) 00:07:41.218 03:19:05 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:41.218 03:19:05 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:07:41.218 Found 0000:09:00.1 (0x8086 - 0x159b) 00:07:41.218 03:19:05 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:41.218 03:19:05 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:41.218 03:19:05 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.218 03:19:05 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:41.218 03:19:05 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.218 03:19:05 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:07:41.218 Found net devices under 0000:09:00.0: cvl_0_0 00:07:41.218 03:19:05 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.218 03:19:05 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:41.218 03:19:05 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.218 03:19:05 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:41.218 03:19:05 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.218 03:19:05 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:07:41.218 Found net devices under 0000:09:00.1: cvl_0_1 00:07:41.218 03:19:05 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.218 03:19:05 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:41.218 03:19:05 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:41.218 03:19:05 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:07:41.218 03:19:05 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:41.218 03:19:05 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:41.218 03:19:05 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:41.218 03:19:05 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:07:41.218 03:19:05 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:41.218 03:19:05 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:41.218 03:19:05 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:07:41.218 03:19:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:41.218 03:19:05 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:41.218 03:19:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:07:41.218 03:19:05 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:07:41.218 03:19:05 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:07:41.218 03:19:05 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:41.218 03:19:05 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:41.218 03:19:05 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:41.218 03:19:05 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:07:41.218 03:19:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:41.218 03:19:05 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:41.218 03:19:05 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:41.218 03:19:05 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:07:41.218 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:41.218 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:07:41.218 00:07:41.218 --- 10.0.0.2 ping statistics --- 00:07:41.218 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:41.218 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:07:41.218 03:19:05 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:41.218 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:41.218 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:07:41.218 00:07:41.218 --- 10.0.0.1 ping statistics --- 00:07:41.218 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:41.218 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:07:41.218 03:19:05 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:41.218 03:19:05 -- nvmf/common.sh@411 -- # return 0 00:07:41.218 03:19:05 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:41.218 03:19:05 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:41.218 03:19:05 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:07:41.218 03:19:05 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:41.218 03:19:05 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:07:41.218 03:19:05 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:07:41.218 03:19:05 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:07:41.219 03:19:05 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:41.219 03:19:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:41.219 03:19:05 -- common/autotest_common.sh@10 -- # set +x 00:07:41.219 03:19:05 -- nvmf/common.sh@470 -- # nvmfpid=1370503 00:07:41.219 03:19:05 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:41.219 03:19:05 -- nvmf/common.sh@471 -- # waitforlisten 1370503 00:07:41.219 03:19:05 -- common/autotest_common.sh@817 -- # '[' -z 1370503 ']' 00:07:41.219 03:19:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:41.219 03:19:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:41.219 03:19:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:41.219 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:41.219 03:19:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:41.219 03:19:05 -- common/autotest_common.sh@10 -- # set +x 00:07:41.219 [2024-04-27 03:19:05.782113] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:07:41.219 [2024-04-27 03:19:05.782193] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:41.219 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.219 [2024-04-27 03:19:05.849849] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:41.219 [2024-04-27 03:19:05.968434] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:41.219 [2024-04-27 03:19:05.968498] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:41.219 [2024-04-27 03:19:05.968514] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:41.219 [2024-04-27 03:19:05.968526] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:41.219 [2024-04-27 03:19:05.968550] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:41.219 [2024-04-27 03:19:05.968637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:41.219 [2024-04-27 03:19:05.968690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:41.219 [2024-04-27 03:19:05.968724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:41.219 [2024-04-27 03:19:05.968726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.785 03:19:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:41.785 03:19:06 -- common/autotest_common.sh@850 -- # return 0 00:07:41.785 03:19:06 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:41.785 03:19:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:41.785 03:19:06 -- common/autotest_common.sh@10 -- # set +x 00:07:42.044 03:19:06 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:42.044 03:19:06 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:07:42.044 03:19:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:42.044 03:19:06 -- common/autotest_common.sh@10 -- # set +x 00:07:42.044 03:19:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:42.044 03:19:06 -- target/rpc.sh@26 -- # stats='{ 00:07:42.044 "tick_rate": 2700000000, 00:07:42.044 "poll_groups": [ 00:07:42.044 { 00:07:42.044 "name": "nvmf_tgt_poll_group_0", 00:07:42.044 "admin_qpairs": 0, 00:07:42.044 "io_qpairs": 0, 00:07:42.044 "current_admin_qpairs": 0, 00:07:42.044 "current_io_qpairs": 0, 00:07:42.044 "pending_bdev_io": 0, 00:07:42.044 "completed_nvme_io": 0, 00:07:42.044 "transports": [] 00:07:42.044 }, 00:07:42.044 { 00:07:42.044 "name": "nvmf_tgt_poll_group_1", 00:07:42.044 "admin_qpairs": 0, 00:07:42.044 "io_qpairs": 0, 00:07:42.044 "current_admin_qpairs": 0, 00:07:42.044 "current_io_qpairs": 0, 00:07:42.044 "pending_bdev_io": 0, 00:07:42.044 "completed_nvme_io": 0, 00:07:42.044 "transports": [] 00:07:42.044 }, 00:07:42.044 { 00:07:42.044 "name": "nvmf_tgt_poll_group_2", 00:07:42.044 "admin_qpairs": 0, 00:07:42.044 "io_qpairs": 0, 00:07:42.044 "current_admin_qpairs": 0, 00:07:42.044 "current_io_qpairs": 0, 00:07:42.044 "pending_bdev_io": 0, 00:07:42.044 "completed_nvme_io": 0, 00:07:42.044 "transports": [] 00:07:42.044 }, 00:07:42.044 { 00:07:42.044 "name": "nvmf_tgt_poll_group_3", 00:07:42.044 "admin_qpairs": 0, 00:07:42.044 "io_qpairs": 0, 00:07:42.044 "current_admin_qpairs": 0, 00:07:42.044 "current_io_qpairs": 0, 00:07:42.044 "pending_bdev_io": 0, 00:07:42.044 "completed_nvme_io": 0, 00:07:42.044 "transports": [] 00:07:42.044 } 00:07:42.044 ] 00:07:42.044 }' 00:07:42.044 03:19:06 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:07:42.044 03:19:06 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:07:42.044 03:19:06 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:07:42.044 03:19:06 -- target/rpc.sh@15 -- # wc -l 00:07:42.044 03:19:06 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:07:42.044 03:19:06 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:07:42.044 03:19:06 -- target/rpc.sh@29 -- # [[ null == null ]] 00:07:42.044 03:19:06 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:42.044 03:19:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:42.044 03:19:06 -- common/autotest_common.sh@10 -- # set +x 00:07:42.044 [2024-04-27 03:19:06.869623] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:42.044 03:19:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:42.044 03:19:06 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:07:42.044 03:19:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:42.044 03:19:06 -- common/autotest_common.sh@10 -- # set +x 00:07:42.044 03:19:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:42.044 03:19:06 -- target/rpc.sh@33 -- # stats='{ 00:07:42.044 "tick_rate": 2700000000, 00:07:42.044 "poll_groups": [ 00:07:42.044 { 00:07:42.044 "name": "nvmf_tgt_poll_group_0", 00:07:42.044 "admin_qpairs": 0, 00:07:42.044 "io_qpairs": 0, 00:07:42.044 "current_admin_qpairs": 0, 00:07:42.044 "current_io_qpairs": 0, 00:07:42.044 "pending_bdev_io": 0, 00:07:42.044 "completed_nvme_io": 0, 00:07:42.044 "transports": [ 00:07:42.044 { 00:07:42.044 "trtype": "TCP" 00:07:42.044 } 00:07:42.044 ] 00:07:42.044 }, 00:07:42.044 { 00:07:42.044 "name": "nvmf_tgt_poll_group_1", 00:07:42.044 "admin_qpairs": 0, 00:07:42.044 "io_qpairs": 0, 00:07:42.044 "current_admin_qpairs": 0, 00:07:42.044 "current_io_qpairs": 0, 00:07:42.044 "pending_bdev_io": 0, 00:07:42.044 "completed_nvme_io": 0, 00:07:42.044 "transports": [ 00:07:42.044 { 00:07:42.044 "trtype": "TCP" 00:07:42.044 } 00:07:42.044 ] 00:07:42.044 }, 00:07:42.044 { 00:07:42.044 "name": "nvmf_tgt_poll_group_2", 00:07:42.044 "admin_qpairs": 0, 00:07:42.044 "io_qpairs": 0, 00:07:42.044 "current_admin_qpairs": 0, 00:07:42.044 "current_io_qpairs": 0, 00:07:42.044 "pending_bdev_io": 0, 00:07:42.044 "completed_nvme_io": 0, 00:07:42.044 "transports": [ 00:07:42.044 { 00:07:42.044 "trtype": "TCP" 00:07:42.044 } 00:07:42.044 ] 00:07:42.044 }, 00:07:42.044 { 00:07:42.044 "name": "nvmf_tgt_poll_group_3", 00:07:42.044 "admin_qpairs": 0, 00:07:42.044 "io_qpairs": 0, 00:07:42.044 "current_admin_qpairs": 0, 00:07:42.044 "current_io_qpairs": 0, 00:07:42.044 "pending_bdev_io": 0, 00:07:42.044 "completed_nvme_io": 0, 00:07:42.044 "transports": [ 00:07:42.044 { 00:07:42.044 "trtype": "TCP" 00:07:42.044 } 00:07:42.044 ] 00:07:42.044 } 00:07:42.044 ] 00:07:42.044 }' 00:07:42.044 03:19:06 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:07:42.044 03:19:06 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:07:42.044 03:19:06 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:07:42.044 03:19:06 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:07:42.044 03:19:06 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:07:42.044 03:19:06 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:07:42.044 03:19:06 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:07:42.044 03:19:06 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:07:42.044 03:19:06 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:07:42.044 03:19:06 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:07:42.044 03:19:06 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:07:42.044 03:19:06 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:07:42.044 03:19:06 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:07:42.044 03:19:06 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:07:42.044 03:19:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:42.044 03:19:06 -- common/autotest_common.sh@10 -- # set +x 00:07:42.044 Malloc1 00:07:42.044 03:19:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:42.044 03:19:06 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:42.044 03:19:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:42.044 03:19:06 -- common/autotest_common.sh@10 -- # set +x 00:07:42.044 03:19:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:42.044 03:19:06 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:42.044 03:19:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:42.044 03:19:06 -- common/autotest_common.sh@10 -- # set +x 00:07:42.044 03:19:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:42.044 03:19:06 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:07:42.044 03:19:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:42.044 03:19:06 -- common/autotest_common.sh@10 -- # set +x 00:07:42.044 03:19:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:42.044 03:19:07 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:42.044 03:19:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:42.044 03:19:07 -- common/autotest_common.sh@10 -- # set +x 00:07:42.044 [2024-04-27 03:19:07.010001] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:42.044 03:19:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:42.044 03:19:07 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a -a 10.0.0.2 -s 4420 00:07:42.044 03:19:07 -- common/autotest_common.sh@638 -- # local es=0 00:07:42.044 03:19:07 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a -a 10.0.0.2 -s 4420 00:07:42.044 03:19:07 -- common/autotest_common.sh@626 -- # local arg=nvme 00:07:42.044 03:19:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:42.045 03:19:07 -- common/autotest_common.sh@630 -- # type -t nvme 00:07:42.045 03:19:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:42.045 03:19:07 -- common/autotest_common.sh@632 -- # type -P nvme 00:07:42.045 03:19:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:42.045 03:19:07 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:07:42.045 03:19:07 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:07:42.045 03:19:07 -- common/autotest_common.sh@641 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a -a 10.0.0.2 -s 4420 00:07:42.302 [2024-04-27 03:19:07.032555] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a' 00:07:42.302 Failed to write to /dev/nvme-fabrics: Input/output error 00:07:42.302 could not add new controller: failed to write to nvme-fabrics device 00:07:42.302 03:19:07 -- common/autotest_common.sh@641 -- # es=1 00:07:42.302 03:19:07 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:42.302 03:19:07 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:42.302 03:19:07 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:42.302 03:19:07 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:07:42.302 03:19:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:42.302 03:19:07 -- common/autotest_common.sh@10 -- # set +x 00:07:42.302 03:19:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:42.302 03:19:07 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:42.901 03:19:07 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:07:42.901 03:19:07 -- common/autotest_common.sh@1184 -- # local i=0 00:07:42.901 03:19:07 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:42.901 03:19:07 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:42.901 03:19:07 -- common/autotest_common.sh@1191 -- # sleep 2 00:07:44.799 03:19:09 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:07:44.799 03:19:09 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:07:44.799 03:19:09 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:07:44.799 03:19:09 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:07:44.799 03:19:09 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:07:44.799 03:19:09 -- common/autotest_common.sh@1194 -- # return 0 00:07:44.799 03:19:09 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:45.057 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:45.057 03:19:09 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:45.057 03:19:09 -- common/autotest_common.sh@1205 -- # local i=0 00:07:45.057 03:19:09 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:07:45.057 03:19:09 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:45.057 03:19:09 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:07:45.057 03:19:09 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:45.057 03:19:09 -- common/autotest_common.sh@1217 -- # return 0 00:07:45.057 03:19:09 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:07:45.057 03:19:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:45.057 03:19:09 -- common/autotest_common.sh@10 -- # set +x 00:07:45.057 03:19:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:45.057 03:19:09 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:45.057 03:19:09 -- common/autotest_common.sh@638 -- # local es=0 00:07:45.057 03:19:09 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:45.057 03:19:09 -- common/autotest_common.sh@626 -- # local arg=nvme 00:07:45.057 03:19:09 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:45.057 03:19:09 -- common/autotest_common.sh@630 -- # type -t nvme 00:07:45.057 03:19:09 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:45.057 03:19:09 -- common/autotest_common.sh@632 -- # type -P nvme 00:07:45.057 03:19:09 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:45.057 03:19:09 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:07:45.057 03:19:09 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:07:45.057 03:19:09 -- common/autotest_common.sh@641 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:45.057 [2024-04-27 03:19:09.906430] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a' 00:07:45.057 Failed to write to /dev/nvme-fabrics: Input/output error 00:07:45.057 could not add new controller: failed to write to nvme-fabrics device 00:07:45.057 03:19:09 -- common/autotest_common.sh@641 -- # es=1 00:07:45.057 03:19:09 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:45.057 03:19:09 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:45.057 03:19:09 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:45.057 03:19:09 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:07:45.057 03:19:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:45.057 03:19:09 -- common/autotest_common.sh@10 -- # set +x 00:07:45.057 03:19:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:45.057 03:19:09 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:45.990 03:19:10 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:07:45.990 03:19:10 -- common/autotest_common.sh@1184 -- # local i=0 00:07:45.990 03:19:10 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:45.990 03:19:10 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:45.990 03:19:10 -- common/autotest_common.sh@1191 -- # sleep 2 00:07:47.888 03:19:12 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:07:47.888 03:19:12 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:07:47.888 03:19:12 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:07:47.888 03:19:12 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:07:47.888 03:19:12 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:07:47.888 03:19:12 -- common/autotest_common.sh@1194 -- # return 0 00:07:47.888 03:19:12 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:47.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:47.888 03:19:12 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:47.888 03:19:12 -- common/autotest_common.sh@1205 -- # local i=0 00:07:47.888 03:19:12 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:07:47.888 03:19:12 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:47.888 03:19:12 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:07:47.888 03:19:12 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:47.888 03:19:12 -- common/autotest_common.sh@1217 -- # return 0 00:07:47.888 03:19:12 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:47.888 03:19:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:47.888 03:19:12 -- common/autotest_common.sh@10 -- # set +x 00:07:47.888 03:19:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:47.888 03:19:12 -- target/rpc.sh@81 -- # seq 1 5 00:07:47.888 03:19:12 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:07:47.888 03:19:12 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:07:47.888 03:19:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:47.888 03:19:12 -- common/autotest_common.sh@10 -- # set +x 00:07:47.888 03:19:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:47.888 03:19:12 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:47.888 03:19:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:47.888 03:19:12 -- common/autotest_common.sh@10 -- # set +x 00:07:47.888 [2024-04-27 03:19:12.734983] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:47.888 03:19:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:47.889 03:19:12 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:07:47.889 03:19:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:47.889 03:19:12 -- common/autotest_common.sh@10 -- # set +x 00:07:47.889 03:19:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:47.889 03:19:12 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:07:47.889 03:19:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:47.889 03:19:12 -- common/autotest_common.sh@10 -- # set +x 00:07:47.889 03:19:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:47.889 03:19:12 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:48.821 03:19:13 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:07:48.821 03:19:13 -- common/autotest_common.sh@1184 -- # local i=0 00:07:48.821 03:19:13 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:48.821 03:19:13 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:48.821 03:19:13 -- common/autotest_common.sh@1191 -- # sleep 2 00:07:50.720 03:19:15 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:07:50.720 03:19:15 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:07:50.720 03:19:15 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:07:50.720 03:19:15 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:07:50.720 03:19:15 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:07:50.720 03:19:15 -- common/autotest_common.sh@1194 -- # return 0 00:07:50.720 03:19:15 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:50.720 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:50.720 03:19:15 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:50.720 03:19:15 -- common/autotest_common.sh@1205 -- # local i=0 00:07:50.720 03:19:15 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:07:50.720 03:19:15 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:50.720 03:19:15 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:07:50.720 03:19:15 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:50.720 03:19:15 -- common/autotest_common.sh@1217 -- # return 0 00:07:50.720 03:19:15 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:07:50.720 03:19:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:50.720 03:19:15 -- common/autotest_common.sh@10 -- # set +x 00:07:50.720 03:19:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:50.720 03:19:15 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:50.720 03:19:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:50.720 03:19:15 -- common/autotest_common.sh@10 -- # set +x 00:07:50.720 03:19:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:50.720 03:19:15 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:07:50.720 03:19:15 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:07:50.720 03:19:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:50.720 03:19:15 -- common/autotest_common.sh@10 -- # set +x 00:07:50.720 03:19:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:50.720 03:19:15 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:50.720 03:19:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:50.720 03:19:15 -- common/autotest_common.sh@10 -- # set +x 00:07:50.720 [2024-04-27 03:19:15.594352] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:50.720 03:19:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:50.720 03:19:15 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:07:50.720 03:19:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:50.720 03:19:15 -- common/autotest_common.sh@10 -- # set +x 00:07:50.720 03:19:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:50.720 03:19:15 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:07:50.720 03:19:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:50.720 03:19:15 -- common/autotest_common.sh@10 -- # set +x 00:07:50.720 03:19:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:50.720 03:19:15 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:51.285 03:19:16 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:07:51.285 03:19:16 -- common/autotest_common.sh@1184 -- # local i=0 00:07:51.285 03:19:16 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:51.285 03:19:16 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:51.285 03:19:16 -- common/autotest_common.sh@1191 -- # sleep 2 00:07:53.813 03:19:18 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:07:53.813 03:19:18 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:07:53.813 03:19:18 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:07:53.813 03:19:18 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:07:53.813 03:19:18 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:07:53.813 03:19:18 -- common/autotest_common.sh@1194 -- # return 0 00:07:53.813 03:19:18 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:53.813 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:53.813 03:19:18 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:53.813 03:19:18 -- common/autotest_common.sh@1205 -- # local i=0 00:07:53.813 03:19:18 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:07:53.813 03:19:18 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:53.813 03:19:18 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:07:53.813 03:19:18 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:53.813 03:19:18 -- common/autotest_common.sh@1217 -- # return 0 00:07:53.813 03:19:18 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:07:53.813 03:19:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:53.813 03:19:18 -- common/autotest_common.sh@10 -- # set +x 00:07:53.813 03:19:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:53.813 03:19:18 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:53.813 03:19:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:53.813 03:19:18 -- common/autotest_common.sh@10 -- # set +x 00:07:53.813 03:19:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:53.813 03:19:18 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:07:53.813 03:19:18 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:07:53.813 03:19:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:53.813 03:19:18 -- common/autotest_common.sh@10 -- # set +x 00:07:53.813 03:19:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:53.813 03:19:18 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:53.813 03:19:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:53.813 03:19:18 -- common/autotest_common.sh@10 -- # set +x 00:07:53.813 [2024-04-27 03:19:18.368032] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:53.813 03:19:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:53.814 03:19:18 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:07:53.814 03:19:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:53.814 03:19:18 -- common/autotest_common.sh@10 -- # set +x 00:07:53.814 03:19:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:53.814 03:19:18 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:07:53.814 03:19:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:53.814 03:19:18 -- common/autotest_common.sh@10 -- # set +x 00:07:53.814 03:19:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:53.814 03:19:18 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:54.377 03:19:19 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:07:54.377 03:19:19 -- common/autotest_common.sh@1184 -- # local i=0 00:07:54.377 03:19:19 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:54.377 03:19:19 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:54.377 03:19:19 -- common/autotest_common.sh@1191 -- # sleep 2 00:07:56.272 03:19:21 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:07:56.272 03:19:21 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:07:56.272 03:19:21 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:07:56.272 03:19:21 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:07:56.272 03:19:21 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:07:56.272 03:19:21 -- common/autotest_common.sh@1194 -- # return 0 00:07:56.272 03:19:21 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:56.272 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:56.272 03:19:21 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:56.272 03:19:21 -- common/autotest_common.sh@1205 -- # local i=0 00:07:56.272 03:19:21 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:07:56.272 03:19:21 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:56.272 03:19:21 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:07:56.272 03:19:21 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:56.272 03:19:21 -- common/autotest_common.sh@1217 -- # return 0 00:07:56.272 03:19:21 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:07:56.272 03:19:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:56.272 03:19:21 -- common/autotest_common.sh@10 -- # set +x 00:07:56.272 03:19:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:56.272 03:19:21 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:56.272 03:19:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:56.272 03:19:21 -- common/autotest_common.sh@10 -- # set +x 00:07:56.529 03:19:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:56.529 03:19:21 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:07:56.529 03:19:21 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:07:56.529 03:19:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:56.529 03:19:21 -- common/autotest_common.sh@10 -- # set +x 00:07:56.529 03:19:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:56.529 03:19:21 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:56.529 03:19:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:56.529 03:19:21 -- common/autotest_common.sh@10 -- # set +x 00:07:56.529 [2024-04-27 03:19:21.264266] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:56.529 03:19:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:56.529 03:19:21 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:07:56.529 03:19:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:56.529 03:19:21 -- common/autotest_common.sh@10 -- # set +x 00:07:56.529 03:19:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:56.529 03:19:21 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:07:56.529 03:19:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:56.529 03:19:21 -- common/autotest_common.sh@10 -- # set +x 00:07:56.529 03:19:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:56.529 03:19:21 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:57.093 03:19:21 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:07:57.093 03:19:21 -- common/autotest_common.sh@1184 -- # local i=0 00:07:57.093 03:19:21 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:57.093 03:19:21 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:57.093 03:19:21 -- common/autotest_common.sh@1191 -- # sleep 2 00:07:58.990 03:19:23 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:07:58.990 03:19:23 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:07:58.990 03:19:23 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:07:58.990 03:19:23 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:07:58.990 03:19:23 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:07:58.990 03:19:23 -- common/autotest_common.sh@1194 -- # return 0 00:07:58.990 03:19:23 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:59.249 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:59.249 03:19:24 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:59.249 03:19:24 -- common/autotest_common.sh@1205 -- # local i=0 00:07:59.249 03:19:24 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:07:59.249 03:19:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:59.249 03:19:24 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:07:59.249 03:19:24 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:59.249 03:19:24 -- common/autotest_common.sh@1217 -- # return 0 00:07:59.249 03:19:24 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:07:59.249 03:19:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:59.249 03:19:24 -- common/autotest_common.sh@10 -- # set +x 00:07:59.249 03:19:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:59.249 03:19:24 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:59.249 03:19:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:59.249 03:19:24 -- common/autotest_common.sh@10 -- # set +x 00:07:59.249 03:19:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:59.249 03:19:24 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:07:59.249 03:19:24 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:07:59.249 03:19:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:59.249 03:19:24 -- common/autotest_common.sh@10 -- # set +x 00:07:59.249 03:19:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:59.249 03:19:24 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:59.249 03:19:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:59.249 03:19:24 -- common/autotest_common.sh@10 -- # set +x 00:07:59.249 [2024-04-27 03:19:24.064353] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:59.249 03:19:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:59.249 03:19:24 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:07:59.249 03:19:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:59.249 03:19:24 -- common/autotest_common.sh@10 -- # set +x 00:07:59.249 03:19:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:59.249 03:19:24 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:07:59.249 03:19:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:59.249 03:19:24 -- common/autotest_common.sh@10 -- # set +x 00:07:59.249 03:19:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:59.249 03:19:24 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:59.814 03:19:24 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:07:59.814 03:19:24 -- common/autotest_common.sh@1184 -- # local i=0 00:07:59.814 03:19:24 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:59.814 03:19:24 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:59.814 03:19:24 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:02.341 03:19:26 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:02.341 03:19:26 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:02.341 03:19:26 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:02.341 03:19:26 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:02.341 03:19:26 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:02.341 03:19:26 -- common/autotest_common.sh@1194 -- # return 0 00:08:02.341 03:19:26 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:02.341 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.341 03:19:26 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:02.341 03:19:26 -- common/autotest_common.sh@1205 -- # local i=0 00:08:02.341 03:19:26 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:02.341 03:19:26 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:02.341 03:19:26 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:02.341 03:19:26 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:02.341 03:19:26 -- common/autotest_common.sh@1217 -- # return 0 00:08:02.341 03:19:26 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:02.341 03:19:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:26 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:26 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:02.341 03:19:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:26 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:26 -- target/rpc.sh@99 -- # seq 1 5 00:08:02.341 03:19:26 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:08:02.341 03:19:26 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:02.341 03:19:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:26 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:26 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:02.341 03:19:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:26 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 [2024-04-27 03:19:26.966406] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:02.341 03:19:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:26 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:02.341 03:19:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:26 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:26 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:02.341 03:19:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:26 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:26 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:02.341 03:19:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:26 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:26 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:02.341 03:19:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:26 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:08:02.341 03:19:27 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 [2024-04-27 03:19:27.014461] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:08:02.341 03:19:27 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 [2024-04-27 03:19:27.062643] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.341 03:19:27 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:02.341 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.341 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.341 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:08:02.342 03:19:27 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 [2024-04-27 03:19:27.110772] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:08:02.342 03:19:27 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 [2024-04-27 03:19:27.158937] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:08:02.342 03:19:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:02.342 03:19:27 -- common/autotest_common.sh@10 -- # set +x 00:08:02.342 03:19:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:02.342 03:19:27 -- target/rpc.sh@110 -- # stats='{ 00:08:02.342 "tick_rate": 2700000000, 00:08:02.342 "poll_groups": [ 00:08:02.342 { 00:08:02.342 "name": "nvmf_tgt_poll_group_0", 00:08:02.342 "admin_qpairs": 2, 00:08:02.342 "io_qpairs": 84, 00:08:02.342 "current_admin_qpairs": 0, 00:08:02.342 "current_io_qpairs": 0, 00:08:02.342 "pending_bdev_io": 0, 00:08:02.342 "completed_nvme_io": 162, 00:08:02.342 "transports": [ 00:08:02.342 { 00:08:02.342 "trtype": "TCP" 00:08:02.342 } 00:08:02.342 ] 00:08:02.342 }, 00:08:02.342 { 00:08:02.342 "name": "nvmf_tgt_poll_group_1", 00:08:02.342 "admin_qpairs": 2, 00:08:02.342 "io_qpairs": 84, 00:08:02.342 "current_admin_qpairs": 0, 00:08:02.342 "current_io_qpairs": 0, 00:08:02.342 "pending_bdev_io": 0, 00:08:02.342 "completed_nvme_io": 156, 00:08:02.342 "transports": [ 00:08:02.342 { 00:08:02.342 "trtype": "TCP" 00:08:02.342 } 00:08:02.342 ] 00:08:02.342 }, 00:08:02.342 { 00:08:02.342 "name": "nvmf_tgt_poll_group_2", 00:08:02.342 "admin_qpairs": 1, 00:08:02.342 "io_qpairs": 84, 00:08:02.342 "current_admin_qpairs": 0, 00:08:02.342 "current_io_qpairs": 0, 00:08:02.342 "pending_bdev_io": 0, 00:08:02.342 "completed_nvme_io": 186, 00:08:02.342 "transports": [ 00:08:02.342 { 00:08:02.342 "trtype": "TCP" 00:08:02.342 } 00:08:02.342 ] 00:08:02.342 }, 00:08:02.342 { 00:08:02.342 "name": "nvmf_tgt_poll_group_3", 00:08:02.342 "admin_qpairs": 2, 00:08:02.342 "io_qpairs": 84, 00:08:02.342 "current_admin_qpairs": 0, 00:08:02.342 "current_io_qpairs": 0, 00:08:02.342 "pending_bdev_io": 0, 00:08:02.342 "completed_nvme_io": 182, 00:08:02.342 "transports": [ 00:08:02.342 { 00:08:02.342 "trtype": "TCP" 00:08:02.342 } 00:08:02.342 ] 00:08:02.342 } 00:08:02.342 ] 00:08:02.342 }' 00:08:02.342 03:19:27 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:08:02.342 03:19:27 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:08:02.342 03:19:27 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:08:02.342 03:19:27 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:08:02.342 03:19:27 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:08:02.342 03:19:27 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:08:02.342 03:19:27 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:08:02.342 03:19:27 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:08:02.342 03:19:27 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:08:02.342 03:19:27 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:08:02.342 03:19:27 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:08:02.342 03:19:27 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:08:02.342 03:19:27 -- target/rpc.sh@123 -- # nvmftestfini 00:08:02.342 03:19:27 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:02.342 03:19:27 -- nvmf/common.sh@117 -- # sync 00:08:02.342 03:19:27 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:08:02.342 03:19:27 -- nvmf/common.sh@120 -- # set +e 00:08:02.342 03:19:27 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:02.342 03:19:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:08:02.342 rmmod nvme_tcp 00:08:02.601 rmmod nvme_fabrics 00:08:02.601 rmmod nvme_keyring 00:08:02.601 03:19:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:02.601 03:19:27 -- nvmf/common.sh@124 -- # set -e 00:08:02.601 03:19:27 -- nvmf/common.sh@125 -- # return 0 00:08:02.601 03:19:27 -- nvmf/common.sh@478 -- # '[' -n 1370503 ']' 00:08:02.601 03:19:27 -- nvmf/common.sh@479 -- # killprocess 1370503 00:08:02.601 03:19:27 -- common/autotest_common.sh@936 -- # '[' -z 1370503 ']' 00:08:02.601 03:19:27 -- common/autotest_common.sh@940 -- # kill -0 1370503 00:08:02.601 03:19:27 -- common/autotest_common.sh@941 -- # uname 00:08:02.601 03:19:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:02.601 03:19:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1370503 00:08:02.601 03:19:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:02.601 03:19:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:02.601 03:19:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1370503' 00:08:02.601 killing process with pid 1370503 00:08:02.601 03:19:27 -- common/autotest_common.sh@955 -- # kill 1370503 00:08:02.601 03:19:27 -- common/autotest_common.sh@960 -- # wait 1370503 00:08:02.888 03:19:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:02.888 03:19:27 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:08:02.888 03:19:27 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:08:02.888 03:19:27 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:02.888 03:19:27 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:08:02.888 03:19:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:02.888 03:19:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:02.888 03:19:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:04.816 03:19:29 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:08:04.816 00:08:04.816 real 0m26.270s 00:08:04.816 user 1m26.137s 00:08:04.816 sys 0m4.218s 00:08:04.816 03:19:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:04.816 03:19:29 -- common/autotest_common.sh@10 -- # set +x 00:08:04.816 ************************************ 00:08:04.816 END TEST nvmf_rpc 00:08:04.816 ************************************ 00:08:04.816 03:19:29 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:08:04.816 03:19:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:04.816 03:19:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:04.816 03:19:29 -- common/autotest_common.sh@10 -- # set +x 00:08:05.074 ************************************ 00:08:05.074 START TEST nvmf_invalid 00:08:05.074 ************************************ 00:08:05.074 03:19:29 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:08:05.074 * Looking for test storage... 00:08:05.074 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:05.074 03:19:29 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:05.074 03:19:29 -- nvmf/common.sh@7 -- # uname -s 00:08:05.074 03:19:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:05.074 03:19:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:05.074 03:19:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:05.074 03:19:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:05.074 03:19:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:05.074 03:19:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:05.074 03:19:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:05.074 03:19:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:05.074 03:19:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:05.074 03:19:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:05.074 03:19:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:08:05.074 03:19:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:08:05.075 03:19:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:05.075 03:19:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:05.075 03:19:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:05.075 03:19:29 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:05.075 03:19:29 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:05.075 03:19:29 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:05.075 03:19:29 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:05.075 03:19:29 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:05.075 03:19:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.075 03:19:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.075 03:19:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.075 03:19:29 -- paths/export.sh@5 -- # export PATH 00:08:05.075 03:19:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.075 03:19:29 -- nvmf/common.sh@47 -- # : 0 00:08:05.075 03:19:29 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:05.075 03:19:29 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:05.075 03:19:29 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:05.075 03:19:29 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:05.075 03:19:29 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:05.075 03:19:29 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:05.075 03:19:29 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:05.075 03:19:29 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:05.075 03:19:29 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:08:05.075 03:19:29 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:05.075 03:19:29 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:08:05.075 03:19:29 -- target/invalid.sh@14 -- # target=foobar 00:08:05.075 03:19:29 -- target/invalid.sh@16 -- # RANDOM=0 00:08:05.075 03:19:29 -- target/invalid.sh@34 -- # nvmftestinit 00:08:05.075 03:19:29 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:08:05.075 03:19:29 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:05.075 03:19:29 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:05.075 03:19:29 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:05.075 03:19:29 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:05.075 03:19:29 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:05.075 03:19:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:05.075 03:19:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:05.075 03:19:29 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:05.075 03:19:29 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:05.075 03:19:29 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:05.075 03:19:29 -- common/autotest_common.sh@10 -- # set +x 00:08:07.603 03:19:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:07.603 03:19:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:07.603 03:19:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:07.603 03:19:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:07.603 03:19:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:07.603 03:19:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:07.603 03:19:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:07.603 03:19:31 -- nvmf/common.sh@295 -- # net_devs=() 00:08:07.603 03:19:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:07.603 03:19:31 -- nvmf/common.sh@296 -- # e810=() 00:08:07.603 03:19:31 -- nvmf/common.sh@296 -- # local -ga e810 00:08:07.603 03:19:31 -- nvmf/common.sh@297 -- # x722=() 00:08:07.603 03:19:31 -- nvmf/common.sh@297 -- # local -ga x722 00:08:07.603 03:19:31 -- nvmf/common.sh@298 -- # mlx=() 00:08:07.603 03:19:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:07.603 03:19:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:07.603 03:19:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:07.603 03:19:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:07.603 03:19:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:07.603 03:19:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:07.603 03:19:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:07.603 03:19:32 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:07.603 03:19:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:07.603 03:19:32 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:07.603 03:19:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:07.603 03:19:32 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:07.603 03:19:32 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:07.603 03:19:32 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:08:07.603 03:19:32 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:07.603 03:19:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:07.603 03:19:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:08:07.603 Found 0000:09:00.0 (0x8086 - 0x159b) 00:08:07.603 03:19:32 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:07.603 03:19:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:08:07.603 Found 0000:09:00.1 (0x8086 - 0x159b) 00:08:07.603 03:19:32 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:07.603 03:19:32 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:08:07.603 03:19:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:07.603 03:19:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:07.603 03:19:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:07.603 03:19:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:07.603 03:19:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:08:07.603 Found net devices under 0000:09:00.0: cvl_0_0 00:08:07.603 03:19:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:07.603 03:19:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:07.603 03:19:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:07.603 03:19:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:07.604 03:19:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:07.604 03:19:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:08:07.604 Found net devices under 0000:09:00.1: cvl_0_1 00:08:07.604 03:19:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:07.604 03:19:32 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:07.604 03:19:32 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:07.604 03:19:32 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:07.604 03:19:32 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:08:07.604 03:19:32 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:08:07.604 03:19:32 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:07.604 03:19:32 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:07.604 03:19:32 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:07.604 03:19:32 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:08:07.604 03:19:32 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:07.604 03:19:32 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:07.604 03:19:32 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:08:07.604 03:19:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:07.604 03:19:32 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:07.604 03:19:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:08:07.604 03:19:32 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:08:07.604 03:19:32 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:08:07.604 03:19:32 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:07.604 03:19:32 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:07.604 03:19:32 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:07.604 03:19:32 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:08:07.604 03:19:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:07.604 03:19:32 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:07.604 03:19:32 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:07.604 03:19:32 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:08:07.604 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:07.604 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.176 ms 00:08:07.604 00:08:07.604 --- 10.0.0.2 ping statistics --- 00:08:07.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:07.604 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:08:07.604 03:19:32 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:07.604 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:07.604 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.060 ms 00:08:07.604 00:08:07.604 --- 10.0.0.1 ping statistics --- 00:08:07.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:07.604 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:08:07.604 03:19:32 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:07.604 03:19:32 -- nvmf/common.sh@411 -- # return 0 00:08:07.604 03:19:32 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:07.604 03:19:32 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:07.604 03:19:32 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:08:07.604 03:19:32 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:08:07.604 03:19:32 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:07.604 03:19:32 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:08:07.604 03:19:32 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:08:07.604 03:19:32 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:08:07.604 03:19:32 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:07.604 03:19:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:07.604 03:19:32 -- common/autotest_common.sh@10 -- # set +x 00:08:07.604 03:19:32 -- nvmf/common.sh@470 -- # nvmfpid=1375158 00:08:07.604 03:19:32 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:07.604 03:19:32 -- nvmf/common.sh@471 -- # waitforlisten 1375158 00:08:07.604 03:19:32 -- common/autotest_common.sh@817 -- # '[' -z 1375158 ']' 00:08:07.604 03:19:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:07.604 03:19:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:07.604 03:19:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:07.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:07.604 03:19:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:07.604 03:19:32 -- common/autotest_common.sh@10 -- # set +x 00:08:07.604 [2024-04-27 03:19:32.212509] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:08:07.604 [2024-04-27 03:19:32.212604] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:07.604 EAL: No free 2048 kB hugepages reported on node 1 00:08:07.604 [2024-04-27 03:19:32.281610] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:07.604 [2024-04-27 03:19:32.400138] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:07.604 [2024-04-27 03:19:32.400201] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:07.604 [2024-04-27 03:19:32.400217] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:07.604 [2024-04-27 03:19:32.400231] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:07.604 [2024-04-27 03:19:32.400243] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:07.604 [2024-04-27 03:19:32.400323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:07.604 [2024-04-27 03:19:32.400351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:07.604 [2024-04-27 03:19:32.400403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:07.604 [2024-04-27 03:19:32.400407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:08.169 03:19:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:08.169 03:19:33 -- common/autotest_common.sh@850 -- # return 0 00:08:08.169 03:19:33 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:08.169 03:19:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:08.169 03:19:33 -- common/autotest_common.sh@10 -- # set +x 00:08:08.425 03:19:33 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:08.425 03:19:33 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:08:08.425 03:19:33 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode2626 00:08:08.682 [2024-04-27 03:19:33.435950] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:08:08.682 03:19:33 -- target/invalid.sh@40 -- # out='request: 00:08:08.682 { 00:08:08.682 "nqn": "nqn.2016-06.io.spdk:cnode2626", 00:08:08.682 "tgt_name": "foobar", 00:08:08.682 "method": "nvmf_create_subsystem", 00:08:08.682 "req_id": 1 00:08:08.682 } 00:08:08.682 Got JSON-RPC error response 00:08:08.682 response: 00:08:08.682 { 00:08:08.682 "code": -32603, 00:08:08.682 "message": "Unable to find target foobar" 00:08:08.682 }' 00:08:08.682 03:19:33 -- target/invalid.sh@41 -- # [[ request: 00:08:08.682 { 00:08:08.682 "nqn": "nqn.2016-06.io.spdk:cnode2626", 00:08:08.682 "tgt_name": "foobar", 00:08:08.682 "method": "nvmf_create_subsystem", 00:08:08.682 "req_id": 1 00:08:08.682 } 00:08:08.682 Got JSON-RPC error response 00:08:08.682 response: 00:08:08.682 { 00:08:08.682 "code": -32603, 00:08:08.682 "message": "Unable to find target foobar" 00:08:08.682 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:08:08.682 03:19:33 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:08:08.682 03:19:33 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode963 00:08:08.941 [2024-04-27 03:19:33.720882] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode963: invalid serial number 'SPDKISFASTANDAWESOME' 00:08:08.941 03:19:33 -- target/invalid.sh@45 -- # out='request: 00:08:08.941 { 00:08:08.941 "nqn": "nqn.2016-06.io.spdk:cnode963", 00:08:08.941 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:08:08.941 "method": "nvmf_create_subsystem", 00:08:08.941 "req_id": 1 00:08:08.941 } 00:08:08.941 Got JSON-RPC error response 00:08:08.941 response: 00:08:08.941 { 00:08:08.941 "code": -32602, 00:08:08.941 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:08:08.941 }' 00:08:08.941 03:19:33 -- target/invalid.sh@46 -- # [[ request: 00:08:08.941 { 00:08:08.941 "nqn": "nqn.2016-06.io.spdk:cnode963", 00:08:08.941 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:08:08.941 "method": "nvmf_create_subsystem", 00:08:08.941 "req_id": 1 00:08:08.941 } 00:08:08.941 Got JSON-RPC error response 00:08:08.941 response: 00:08:08.941 { 00:08:08.941 "code": -32602, 00:08:08.941 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:08:08.941 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:08:08.941 03:19:33 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:08:08.941 03:19:33 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode15969 00:08:09.200 [2024-04-27 03:19:33.965670] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15969: invalid model number 'SPDK_Controller' 00:08:09.200 03:19:33 -- target/invalid.sh@50 -- # out='request: 00:08:09.200 { 00:08:09.200 "nqn": "nqn.2016-06.io.spdk:cnode15969", 00:08:09.200 "model_number": "SPDK_Controller\u001f", 00:08:09.200 "method": "nvmf_create_subsystem", 00:08:09.200 "req_id": 1 00:08:09.200 } 00:08:09.200 Got JSON-RPC error response 00:08:09.200 response: 00:08:09.200 { 00:08:09.200 "code": -32602, 00:08:09.200 "message": "Invalid MN SPDK_Controller\u001f" 00:08:09.200 }' 00:08:09.200 03:19:33 -- target/invalid.sh@51 -- # [[ request: 00:08:09.200 { 00:08:09.200 "nqn": "nqn.2016-06.io.spdk:cnode15969", 00:08:09.200 "model_number": "SPDK_Controller\u001f", 00:08:09.200 "method": "nvmf_create_subsystem", 00:08:09.200 "req_id": 1 00:08:09.200 } 00:08:09.200 Got JSON-RPC error response 00:08:09.200 response: 00:08:09.200 { 00:08:09.200 "code": -32602, 00:08:09.200 "message": "Invalid MN SPDK_Controller\u001f" 00:08:09.200 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:08:09.200 03:19:33 -- target/invalid.sh@54 -- # gen_random_s 21 00:08:09.200 03:19:33 -- target/invalid.sh@19 -- # local length=21 ll 00:08:09.200 03:19:33 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:08:09.200 03:19:33 -- target/invalid.sh@21 -- # local chars 00:08:09.200 03:19:33 -- target/invalid.sh@22 -- # local string 00:08:09.200 03:19:33 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:08:09.200 03:19:33 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # printf %x 36 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # echo -e '\x24' 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # string+='$' 00:08:09.200 03:19:33 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.200 03:19:33 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # printf %x 32 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # echo -e '\x20' 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # string+=' ' 00:08:09.200 03:19:33 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.200 03:19:33 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # printf %x 106 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # string+=j 00:08:09.200 03:19:33 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.200 03:19:33 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # printf %x 118 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # echo -e '\x76' 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # string+=v 00:08:09.200 03:19:33 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.200 03:19:33 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.200 03:19:33 -- target/invalid.sh@25 -- # printf %x 65 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x41' 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # string+=A 00:08:09.200 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.200 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # printf %x 59 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # string+=';' 00:08:09.200 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.200 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # printf %x 65 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x41' 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # string+=A 00:08:09.200 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.200 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # printf %x 79 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:08:09.200 03:19:34 -- target/invalid.sh@25 -- # string+=O 00:08:09.200 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 61 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+== 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 90 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=Z 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 103 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x67' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=g 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 65 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x41' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=A 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 91 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+='[' 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 89 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x59' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=Y 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 73 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x49' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=I 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 79 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=O 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 53 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x35' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=5 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 95 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=_ 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 82 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x52' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=R 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 119 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x77' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=w 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # printf %x 107 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:08:09.201 03:19:34 -- target/invalid.sh@25 -- # string+=k 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.201 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.201 03:19:34 -- target/invalid.sh@28 -- # [[ $ == \- ]] 00:08:09.201 03:19:34 -- target/invalid.sh@31 -- # echo '$ jvA;AO=ZgA[YIO5_Rwk' 00:08:09.201 03:19:34 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '$ jvA;AO=ZgA[YIO5_Rwk' nqn.2016-06.io.spdk:cnode25499 00:08:09.459 [2024-04-27 03:19:34.266691] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25499: invalid serial number '$ jvA;AO=ZgA[YIO5_Rwk' 00:08:09.459 03:19:34 -- target/invalid.sh@54 -- # out='request: 00:08:09.459 { 00:08:09.459 "nqn": "nqn.2016-06.io.spdk:cnode25499", 00:08:09.459 "serial_number": "$ jvA;AO=ZgA[YIO5_Rwk", 00:08:09.459 "method": "nvmf_create_subsystem", 00:08:09.459 "req_id": 1 00:08:09.459 } 00:08:09.459 Got JSON-RPC error response 00:08:09.459 response: 00:08:09.459 { 00:08:09.459 "code": -32602, 00:08:09.459 "message": "Invalid SN $ jvA;AO=ZgA[YIO5_Rwk" 00:08:09.459 }' 00:08:09.459 03:19:34 -- target/invalid.sh@55 -- # [[ request: 00:08:09.459 { 00:08:09.459 "nqn": "nqn.2016-06.io.spdk:cnode25499", 00:08:09.459 "serial_number": "$ jvA;AO=ZgA[YIO5_Rwk", 00:08:09.459 "method": "nvmf_create_subsystem", 00:08:09.459 "req_id": 1 00:08:09.459 } 00:08:09.459 Got JSON-RPC error response 00:08:09.459 response: 00:08:09.459 { 00:08:09.459 "code": -32602, 00:08:09.459 "message": "Invalid SN $ jvA;AO=ZgA[YIO5_Rwk" 00:08:09.459 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:08:09.459 03:19:34 -- target/invalid.sh@58 -- # gen_random_s 41 00:08:09.459 03:19:34 -- target/invalid.sh@19 -- # local length=41 ll 00:08:09.459 03:19:34 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:08:09.459 03:19:34 -- target/invalid.sh@21 -- # local chars 00:08:09.459 03:19:34 -- target/invalid.sh@22 -- # local string 00:08:09.459 03:19:34 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:08:09.459 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 79 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=O 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 75 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=K 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 66 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x42' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=B 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 35 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x23' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+='#' 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 74 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=J 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 111 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=o 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 115 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x73' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=s 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 127 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=$'\177' 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 105 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x69' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=i 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 89 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x59' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=Y 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 113 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x71' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=q 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 69 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x45' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=E 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 102 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x66' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=f 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 119 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x77' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=w 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 49 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x31' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=1 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 96 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x60' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+='`' 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 43 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=+ 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 69 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x45' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=E 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 117 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x75' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=u 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 90 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=Z 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 45 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=- 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 63 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+='?' 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 48 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x30' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=0 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 39 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x27' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=\' 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 33 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x21' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+='!' 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 62 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+='>' 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 57 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x39' 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # string+=9 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.460 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # printf %x 102 00:08:09.460 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x66' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=f 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 104 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x68' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=h 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 38 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x26' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+='&' 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 78 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=N 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 78 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=N 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 104 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x68' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=h 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 43 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=+ 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 117 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x75' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=u 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 122 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=z 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 105 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x69' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=i 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 59 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=';' 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # printf %x 76 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:08:09.461 03:19:34 -- target/invalid.sh@25 -- # string+=L 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.461 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.719 03:19:34 -- target/invalid.sh@25 -- # printf %x 83 00:08:09.719 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x53' 00:08:09.719 03:19:34 -- target/invalid.sh@25 -- # string+=S 00:08:09.719 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.719 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.719 03:19:34 -- target/invalid.sh@25 -- # printf %x 85 00:08:09.719 03:19:34 -- target/invalid.sh@25 -- # echo -e '\x55' 00:08:09.719 03:19:34 -- target/invalid.sh@25 -- # string+=U 00:08:09.719 03:19:34 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:09.719 03:19:34 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:09.719 03:19:34 -- target/invalid.sh@28 -- # [[ O == \- ]] 00:08:09.719 03:19:34 -- target/invalid.sh@31 -- # echo 'OKB#JosiYqEfw1`+EuZ-?0'\''!>9fh&NNh+uzi;LSU' 00:08:09.719 03:19:34 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'OKB#JosiYqEfw1`+EuZ-?0'\''!>9fh&NNh+uzi;LSU' nqn.2016-06.io.spdk:cnode30444 00:08:09.719 [2024-04-27 03:19:34.663988] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30444: invalid model number 'OKB#JosiYqEfw1`+EuZ-?0'!>9fh&NNh+uzi;LSU' 00:08:09.719 03:19:34 -- target/invalid.sh@58 -- # out='request: 00:08:09.719 { 00:08:09.719 "nqn": "nqn.2016-06.io.spdk:cnode30444", 00:08:09.719 "model_number": "OKB#Jos\u007fiYqEfw1`+EuZ-?0'\''!>9fh&NNh+uzi;LSU", 00:08:09.719 "method": "nvmf_create_subsystem", 00:08:09.719 "req_id": 1 00:08:09.719 } 00:08:09.719 Got JSON-RPC error response 00:08:09.719 response: 00:08:09.719 { 00:08:09.719 "code": -32602, 00:08:09.719 "message": "Invalid MN OKB#Jos\u007fiYqEfw1`+EuZ-?0'\''!>9fh&NNh+uzi;LSU" 00:08:09.719 }' 00:08:09.719 03:19:34 -- target/invalid.sh@59 -- # [[ request: 00:08:09.719 { 00:08:09.719 "nqn": "nqn.2016-06.io.spdk:cnode30444", 00:08:09.719 "model_number": "OKB#Jos\u007fiYqEfw1`+EuZ-?0'!>9fh&NNh+uzi;LSU", 00:08:09.719 "method": "nvmf_create_subsystem", 00:08:09.719 "req_id": 1 00:08:09.719 } 00:08:09.719 Got JSON-RPC error response 00:08:09.719 response: 00:08:09.719 { 00:08:09.719 "code": -32602, 00:08:09.719 "message": "Invalid MN OKB#Jos\u007fiYqEfw1`+EuZ-?0'!>9fh&NNh+uzi;LSU" 00:08:09.719 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:08:09.719 03:19:34 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:08:09.976 [2024-04-27 03:19:34.920932] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:09.976 03:19:34 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:08:10.235 03:19:35 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:08:10.235 03:19:35 -- target/invalid.sh@67 -- # echo '' 00:08:10.235 03:19:35 -- target/invalid.sh@67 -- # head -n 1 00:08:10.235 03:19:35 -- target/invalid.sh@67 -- # IP= 00:08:10.235 03:19:35 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:08:10.493 [2024-04-27 03:19:35.422601] nvmf_rpc.c: 792:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:08:10.493 03:19:35 -- target/invalid.sh@69 -- # out='request: 00:08:10.493 { 00:08:10.493 "nqn": "nqn.2016-06.io.spdk:cnode", 00:08:10.493 "listen_address": { 00:08:10.493 "trtype": "tcp", 00:08:10.493 "traddr": "", 00:08:10.493 "trsvcid": "4421" 00:08:10.493 }, 00:08:10.493 "method": "nvmf_subsystem_remove_listener", 00:08:10.493 "req_id": 1 00:08:10.493 } 00:08:10.493 Got JSON-RPC error response 00:08:10.493 response: 00:08:10.493 { 00:08:10.493 "code": -32602, 00:08:10.493 "message": "Invalid parameters" 00:08:10.493 }' 00:08:10.493 03:19:35 -- target/invalid.sh@70 -- # [[ request: 00:08:10.493 { 00:08:10.493 "nqn": "nqn.2016-06.io.spdk:cnode", 00:08:10.493 "listen_address": { 00:08:10.493 "trtype": "tcp", 00:08:10.493 "traddr": "", 00:08:10.493 "trsvcid": "4421" 00:08:10.493 }, 00:08:10.493 "method": "nvmf_subsystem_remove_listener", 00:08:10.493 "req_id": 1 00:08:10.493 } 00:08:10.493 Got JSON-RPC error response 00:08:10.493 response: 00:08:10.493 { 00:08:10.493 "code": -32602, 00:08:10.493 "message": "Invalid parameters" 00:08:10.493 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:08:10.493 03:19:35 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode29970 -i 0 00:08:10.750 [2024-04-27 03:19:35.659319] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29970: invalid cntlid range [0-65519] 00:08:10.750 03:19:35 -- target/invalid.sh@73 -- # out='request: 00:08:10.750 { 00:08:10.750 "nqn": "nqn.2016-06.io.spdk:cnode29970", 00:08:10.750 "min_cntlid": 0, 00:08:10.750 "method": "nvmf_create_subsystem", 00:08:10.750 "req_id": 1 00:08:10.750 } 00:08:10.750 Got JSON-RPC error response 00:08:10.750 response: 00:08:10.750 { 00:08:10.750 "code": -32602, 00:08:10.750 "message": "Invalid cntlid range [0-65519]" 00:08:10.750 }' 00:08:10.750 03:19:35 -- target/invalid.sh@74 -- # [[ request: 00:08:10.750 { 00:08:10.750 "nqn": "nqn.2016-06.io.spdk:cnode29970", 00:08:10.750 "min_cntlid": 0, 00:08:10.750 "method": "nvmf_create_subsystem", 00:08:10.750 "req_id": 1 00:08:10.750 } 00:08:10.750 Got JSON-RPC error response 00:08:10.750 response: 00:08:10.750 { 00:08:10.750 "code": -32602, 00:08:10.750 "message": "Invalid cntlid range [0-65519]" 00:08:10.750 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:08:10.750 03:19:35 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6943 -i 65520 00:08:11.008 [2024-04-27 03:19:35.916163] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6943: invalid cntlid range [65520-65519] 00:08:11.008 03:19:35 -- target/invalid.sh@75 -- # out='request: 00:08:11.008 { 00:08:11.008 "nqn": "nqn.2016-06.io.spdk:cnode6943", 00:08:11.008 "min_cntlid": 65520, 00:08:11.008 "method": "nvmf_create_subsystem", 00:08:11.008 "req_id": 1 00:08:11.008 } 00:08:11.008 Got JSON-RPC error response 00:08:11.008 response: 00:08:11.008 { 00:08:11.008 "code": -32602, 00:08:11.008 "message": "Invalid cntlid range [65520-65519]" 00:08:11.008 }' 00:08:11.008 03:19:35 -- target/invalid.sh@76 -- # [[ request: 00:08:11.008 { 00:08:11.008 "nqn": "nqn.2016-06.io.spdk:cnode6943", 00:08:11.008 "min_cntlid": 65520, 00:08:11.008 "method": "nvmf_create_subsystem", 00:08:11.008 "req_id": 1 00:08:11.008 } 00:08:11.008 Got JSON-RPC error response 00:08:11.008 response: 00:08:11.008 { 00:08:11.008 "code": -32602, 00:08:11.008 "message": "Invalid cntlid range [65520-65519]" 00:08:11.008 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:08:11.008 03:19:35 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2482 -I 0 00:08:11.266 [2024-04-27 03:19:36.164979] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2482: invalid cntlid range [1-0] 00:08:11.266 03:19:36 -- target/invalid.sh@77 -- # out='request: 00:08:11.266 { 00:08:11.266 "nqn": "nqn.2016-06.io.spdk:cnode2482", 00:08:11.266 "max_cntlid": 0, 00:08:11.266 "method": "nvmf_create_subsystem", 00:08:11.266 "req_id": 1 00:08:11.266 } 00:08:11.266 Got JSON-RPC error response 00:08:11.266 response: 00:08:11.266 { 00:08:11.266 "code": -32602, 00:08:11.266 "message": "Invalid cntlid range [1-0]" 00:08:11.266 }' 00:08:11.266 03:19:36 -- target/invalid.sh@78 -- # [[ request: 00:08:11.266 { 00:08:11.266 "nqn": "nqn.2016-06.io.spdk:cnode2482", 00:08:11.266 "max_cntlid": 0, 00:08:11.266 "method": "nvmf_create_subsystem", 00:08:11.266 "req_id": 1 00:08:11.266 } 00:08:11.266 Got JSON-RPC error response 00:08:11.266 response: 00:08:11.266 { 00:08:11.266 "code": -32602, 00:08:11.266 "message": "Invalid cntlid range [1-0]" 00:08:11.266 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:08:11.266 03:19:36 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode27333 -I 65520 00:08:11.524 [2024-04-27 03:19:36.409793] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27333: invalid cntlid range [1-65520] 00:08:11.524 03:19:36 -- target/invalid.sh@79 -- # out='request: 00:08:11.524 { 00:08:11.524 "nqn": "nqn.2016-06.io.spdk:cnode27333", 00:08:11.524 "max_cntlid": 65520, 00:08:11.524 "method": "nvmf_create_subsystem", 00:08:11.524 "req_id": 1 00:08:11.524 } 00:08:11.524 Got JSON-RPC error response 00:08:11.524 response: 00:08:11.524 { 00:08:11.524 "code": -32602, 00:08:11.524 "message": "Invalid cntlid range [1-65520]" 00:08:11.524 }' 00:08:11.524 03:19:36 -- target/invalid.sh@80 -- # [[ request: 00:08:11.524 { 00:08:11.524 "nqn": "nqn.2016-06.io.spdk:cnode27333", 00:08:11.524 "max_cntlid": 65520, 00:08:11.524 "method": "nvmf_create_subsystem", 00:08:11.524 "req_id": 1 00:08:11.524 } 00:08:11.524 Got JSON-RPC error response 00:08:11.524 response: 00:08:11.524 { 00:08:11.524 "code": -32602, 00:08:11.524 "message": "Invalid cntlid range [1-65520]" 00:08:11.524 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:08:11.524 03:19:36 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24929 -i 6 -I 5 00:08:11.781 [2024-04-27 03:19:36.654618] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24929: invalid cntlid range [6-5] 00:08:11.781 03:19:36 -- target/invalid.sh@83 -- # out='request: 00:08:11.781 { 00:08:11.781 "nqn": "nqn.2016-06.io.spdk:cnode24929", 00:08:11.781 "min_cntlid": 6, 00:08:11.781 "max_cntlid": 5, 00:08:11.781 "method": "nvmf_create_subsystem", 00:08:11.781 "req_id": 1 00:08:11.781 } 00:08:11.781 Got JSON-RPC error response 00:08:11.781 response: 00:08:11.782 { 00:08:11.782 "code": -32602, 00:08:11.782 "message": "Invalid cntlid range [6-5]" 00:08:11.782 }' 00:08:11.782 03:19:36 -- target/invalid.sh@84 -- # [[ request: 00:08:11.782 { 00:08:11.782 "nqn": "nqn.2016-06.io.spdk:cnode24929", 00:08:11.782 "min_cntlid": 6, 00:08:11.782 "max_cntlid": 5, 00:08:11.782 "method": "nvmf_create_subsystem", 00:08:11.782 "req_id": 1 00:08:11.782 } 00:08:11.782 Got JSON-RPC error response 00:08:11.782 response: 00:08:11.782 { 00:08:11.782 "code": -32602, 00:08:11.782 "message": "Invalid cntlid range [6-5]" 00:08:11.782 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:08:11.782 03:19:36 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:08:12.040 03:19:36 -- target/invalid.sh@87 -- # out='request: 00:08:12.040 { 00:08:12.040 "name": "foobar", 00:08:12.040 "method": "nvmf_delete_target", 00:08:12.040 "req_id": 1 00:08:12.040 } 00:08:12.040 Got JSON-RPC error response 00:08:12.040 response: 00:08:12.040 { 00:08:12.040 "code": -32602, 00:08:12.040 "message": "The specified target doesn'\''t exist, cannot delete it." 00:08:12.040 }' 00:08:12.040 03:19:36 -- target/invalid.sh@88 -- # [[ request: 00:08:12.040 { 00:08:12.040 "name": "foobar", 00:08:12.040 "method": "nvmf_delete_target", 00:08:12.040 "req_id": 1 00:08:12.040 } 00:08:12.040 Got JSON-RPC error response 00:08:12.040 response: 00:08:12.040 { 00:08:12.040 "code": -32602, 00:08:12.040 "message": "The specified target doesn't exist, cannot delete it." 00:08:12.040 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:08:12.040 03:19:36 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:08:12.040 03:19:36 -- target/invalid.sh@91 -- # nvmftestfini 00:08:12.040 03:19:36 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:12.040 03:19:36 -- nvmf/common.sh@117 -- # sync 00:08:12.040 03:19:36 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:08:12.040 03:19:36 -- nvmf/common.sh@120 -- # set +e 00:08:12.040 03:19:36 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:12.040 03:19:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:08:12.040 rmmod nvme_tcp 00:08:12.040 rmmod nvme_fabrics 00:08:12.040 rmmod nvme_keyring 00:08:12.040 03:19:36 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:12.040 03:19:36 -- nvmf/common.sh@124 -- # set -e 00:08:12.040 03:19:36 -- nvmf/common.sh@125 -- # return 0 00:08:12.040 03:19:36 -- nvmf/common.sh@478 -- # '[' -n 1375158 ']' 00:08:12.040 03:19:36 -- nvmf/common.sh@479 -- # killprocess 1375158 00:08:12.040 03:19:36 -- common/autotest_common.sh@936 -- # '[' -z 1375158 ']' 00:08:12.040 03:19:36 -- common/autotest_common.sh@940 -- # kill -0 1375158 00:08:12.040 03:19:36 -- common/autotest_common.sh@941 -- # uname 00:08:12.040 03:19:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:12.040 03:19:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1375158 00:08:12.040 03:19:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:12.040 03:19:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:12.040 03:19:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1375158' 00:08:12.040 killing process with pid 1375158 00:08:12.040 03:19:36 -- common/autotest_common.sh@955 -- # kill 1375158 00:08:12.040 03:19:36 -- common/autotest_common.sh@960 -- # wait 1375158 00:08:12.299 03:19:37 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:12.299 03:19:37 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:08:12.299 03:19:37 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:08:12.299 03:19:37 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:12.299 03:19:37 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:08:12.299 03:19:37 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:12.299 03:19:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:12.299 03:19:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:14.204 03:19:39 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:08:14.204 00:08:14.204 real 0m9.289s 00:08:14.204 user 0m22.612s 00:08:14.204 sys 0m2.479s 00:08:14.462 03:19:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:14.462 03:19:39 -- common/autotest_common.sh@10 -- # set +x 00:08:14.462 ************************************ 00:08:14.463 END TEST nvmf_invalid 00:08:14.463 ************************************ 00:08:14.463 03:19:39 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:08:14.463 03:19:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:14.463 03:19:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:14.463 03:19:39 -- common/autotest_common.sh@10 -- # set +x 00:08:14.463 ************************************ 00:08:14.463 START TEST nvmf_abort 00:08:14.463 ************************************ 00:08:14.463 03:19:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:08:14.463 * Looking for test storage... 00:08:14.463 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:14.463 03:19:39 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:14.463 03:19:39 -- nvmf/common.sh@7 -- # uname -s 00:08:14.463 03:19:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:14.463 03:19:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:14.463 03:19:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:14.463 03:19:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:14.463 03:19:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:14.463 03:19:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:14.463 03:19:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:14.463 03:19:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:14.463 03:19:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:14.463 03:19:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:14.463 03:19:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:08:14.463 03:19:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:08:14.463 03:19:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:14.463 03:19:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:14.463 03:19:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:14.463 03:19:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:14.463 03:19:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:14.463 03:19:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:14.463 03:19:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:14.463 03:19:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:14.463 03:19:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:14.463 03:19:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:14.463 03:19:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:14.463 03:19:39 -- paths/export.sh@5 -- # export PATH 00:08:14.463 03:19:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:14.463 03:19:39 -- nvmf/common.sh@47 -- # : 0 00:08:14.463 03:19:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:14.463 03:19:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:14.463 03:19:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:14.463 03:19:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:14.463 03:19:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:14.463 03:19:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:14.463 03:19:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:14.463 03:19:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:14.463 03:19:39 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:14.463 03:19:39 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:08:14.463 03:19:39 -- target/abort.sh@14 -- # nvmftestinit 00:08:14.463 03:19:39 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:08:14.463 03:19:39 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:14.463 03:19:39 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:14.463 03:19:39 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:14.463 03:19:39 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:14.463 03:19:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:14.463 03:19:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:14.463 03:19:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:14.463 03:19:39 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:14.463 03:19:39 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:14.463 03:19:39 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:14.463 03:19:39 -- common/autotest_common.sh@10 -- # set +x 00:08:16.998 03:19:41 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:16.998 03:19:41 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:16.998 03:19:41 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:16.998 03:19:41 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:16.998 03:19:41 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:16.998 03:19:41 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:16.998 03:19:41 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:16.998 03:19:41 -- nvmf/common.sh@295 -- # net_devs=() 00:08:16.998 03:19:41 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:16.998 03:19:41 -- nvmf/common.sh@296 -- # e810=() 00:08:16.998 03:19:41 -- nvmf/common.sh@296 -- # local -ga e810 00:08:16.998 03:19:41 -- nvmf/common.sh@297 -- # x722=() 00:08:16.998 03:19:41 -- nvmf/common.sh@297 -- # local -ga x722 00:08:16.998 03:19:41 -- nvmf/common.sh@298 -- # mlx=() 00:08:16.998 03:19:41 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:16.998 03:19:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:16.998 03:19:41 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:16.998 03:19:41 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:08:16.998 03:19:41 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:16.998 03:19:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:16.998 03:19:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:08:16.998 Found 0000:09:00.0 (0x8086 - 0x159b) 00:08:16.998 03:19:41 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:16.998 03:19:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:08:16.998 Found 0000:09:00.1 (0x8086 - 0x159b) 00:08:16.998 03:19:41 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:16.998 03:19:41 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:16.998 03:19:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:16.998 03:19:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:16.998 03:19:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:16.998 03:19:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:08:16.998 Found net devices under 0000:09:00.0: cvl_0_0 00:08:16.998 03:19:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:16.998 03:19:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:16.998 03:19:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:16.998 03:19:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:16.998 03:19:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:16.998 03:19:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:08:16.998 Found net devices under 0000:09:00.1: cvl_0_1 00:08:16.998 03:19:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:16.998 03:19:41 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:16.998 03:19:41 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:16.998 03:19:41 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:08:16.998 03:19:41 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:16.998 03:19:41 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:16.998 03:19:41 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:16.998 03:19:41 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:08:16.998 03:19:41 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:16.998 03:19:41 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:16.998 03:19:41 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:08:16.998 03:19:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:16.998 03:19:41 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:16.998 03:19:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:08:16.998 03:19:41 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:08:16.998 03:19:41 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:08:16.998 03:19:41 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:16.998 03:19:41 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:16.998 03:19:41 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:16.998 03:19:41 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:08:16.998 03:19:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:16.998 03:19:41 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:16.998 03:19:41 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:16.998 03:19:41 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:08:16.998 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:16.998 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.156 ms 00:08:16.998 00:08:16.998 --- 10.0.0.2 ping statistics --- 00:08:16.998 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:16.998 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:08:16.998 03:19:41 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:16.998 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:16.998 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.185 ms 00:08:16.998 00:08:16.998 --- 10.0.0.1 ping statistics --- 00:08:16.998 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:16.998 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:08:16.998 03:19:41 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:16.998 03:19:41 -- nvmf/common.sh@411 -- # return 0 00:08:16.998 03:19:41 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:16.998 03:19:41 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:16.998 03:19:41 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:08:16.998 03:19:41 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:16.998 03:19:41 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:08:16.998 03:19:41 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:08:16.998 03:19:41 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:08:16.998 03:19:41 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:16.998 03:19:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:16.998 03:19:41 -- common/autotest_common.sh@10 -- # set +x 00:08:16.998 03:19:41 -- nvmf/common.sh@470 -- # nvmfpid=1377923 00:08:16.998 03:19:41 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:08:16.998 03:19:41 -- nvmf/common.sh@471 -- # waitforlisten 1377923 00:08:16.998 03:19:41 -- common/autotest_common.sh@817 -- # '[' -z 1377923 ']' 00:08:16.998 03:19:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:16.998 03:19:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:16.999 03:19:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:16.999 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:16.999 03:19:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:16.999 03:19:41 -- common/autotest_common.sh@10 -- # set +x 00:08:16.999 [2024-04-27 03:19:41.667323] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:08:16.999 [2024-04-27 03:19:41.667403] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:16.999 EAL: No free 2048 kB hugepages reported on node 1 00:08:16.999 [2024-04-27 03:19:41.731467] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:16.999 [2024-04-27 03:19:41.846216] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:16.999 [2024-04-27 03:19:41.846293] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:16.999 [2024-04-27 03:19:41.846310] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:16.999 [2024-04-27 03:19:41.846324] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:16.999 [2024-04-27 03:19:41.846336] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:16.999 [2024-04-27 03:19:41.846423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:16.999 [2024-04-27 03:19:41.846475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:16.999 [2024-04-27 03:19:41.846478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:17.932 03:19:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:17.932 03:19:42 -- common/autotest_common.sh@850 -- # return 0 00:08:17.932 03:19:42 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:17.932 03:19:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:17.932 03:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:17.932 03:19:42 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:17.932 03:19:42 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:08:17.932 03:19:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.932 03:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:17.932 [2024-04-27 03:19:42.664363] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:17.932 03:19:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.932 03:19:42 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:08:17.932 03:19:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.932 03:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:17.932 Malloc0 00:08:17.932 03:19:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.932 03:19:42 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:08:17.932 03:19:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.932 03:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:17.932 Delay0 00:08:17.932 03:19:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.932 03:19:42 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:08:17.932 03:19:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.932 03:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:17.932 03:19:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.932 03:19:42 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:08:17.932 03:19:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.932 03:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:17.932 03:19:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.932 03:19:42 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:08:17.932 03:19:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.932 03:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:17.932 [2024-04-27 03:19:42.735406] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:17.932 03:19:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.932 03:19:42 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:17.932 03:19:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.932 03:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:17.932 03:19:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.932 03:19:42 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:08:17.932 EAL: No free 2048 kB hugepages reported on node 1 00:08:17.932 [2024-04-27 03:19:42.799926] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:08:20.458 Initializing NVMe Controllers 00:08:20.458 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:08:20.458 controller IO queue size 128 less than required 00:08:20.458 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:08:20.458 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:08:20.458 Initialization complete. Launching workers. 00:08:20.458 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 34583 00:08:20.458 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34648, failed to submit 62 00:08:20.458 success 34587, unsuccess 61, failed 0 00:08:20.458 03:19:44 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:08:20.458 03:19:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:20.458 03:19:44 -- common/autotest_common.sh@10 -- # set +x 00:08:20.458 03:19:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:20.458 03:19:44 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:08:20.458 03:19:44 -- target/abort.sh@38 -- # nvmftestfini 00:08:20.458 03:19:44 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:20.458 03:19:44 -- nvmf/common.sh@117 -- # sync 00:08:20.458 03:19:44 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:08:20.458 03:19:44 -- nvmf/common.sh@120 -- # set +e 00:08:20.458 03:19:44 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:20.458 03:19:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:08:20.458 rmmod nvme_tcp 00:08:20.458 rmmod nvme_fabrics 00:08:20.458 rmmod nvme_keyring 00:08:20.458 03:19:44 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:20.458 03:19:44 -- nvmf/common.sh@124 -- # set -e 00:08:20.458 03:19:44 -- nvmf/common.sh@125 -- # return 0 00:08:20.458 03:19:44 -- nvmf/common.sh@478 -- # '[' -n 1377923 ']' 00:08:20.458 03:19:44 -- nvmf/common.sh@479 -- # killprocess 1377923 00:08:20.458 03:19:44 -- common/autotest_common.sh@936 -- # '[' -z 1377923 ']' 00:08:20.458 03:19:44 -- common/autotest_common.sh@940 -- # kill -0 1377923 00:08:20.458 03:19:44 -- common/autotest_common.sh@941 -- # uname 00:08:20.458 03:19:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:20.458 03:19:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1377923 00:08:20.458 03:19:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:08:20.458 03:19:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:08:20.458 03:19:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1377923' 00:08:20.458 killing process with pid 1377923 00:08:20.458 03:19:44 -- common/autotest_common.sh@955 -- # kill 1377923 00:08:20.458 03:19:44 -- common/autotest_common.sh@960 -- # wait 1377923 00:08:20.458 03:19:45 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:20.458 03:19:45 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:08:20.458 03:19:45 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:08:20.458 03:19:45 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:20.458 03:19:45 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:08:20.458 03:19:45 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:20.458 03:19:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:20.458 03:19:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:22.362 03:19:47 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:08:22.362 00:08:22.362 real 0m7.976s 00:08:22.362 user 0m12.535s 00:08:22.362 sys 0m2.558s 00:08:22.362 03:19:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:22.362 03:19:47 -- common/autotest_common.sh@10 -- # set +x 00:08:22.362 ************************************ 00:08:22.362 END TEST nvmf_abort 00:08:22.362 ************************************ 00:08:22.362 03:19:47 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:08:22.362 03:19:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:22.362 03:19:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:22.362 03:19:47 -- common/autotest_common.sh@10 -- # set +x 00:08:22.621 ************************************ 00:08:22.621 START TEST nvmf_ns_hotplug_stress 00:08:22.621 ************************************ 00:08:22.621 03:19:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:08:22.621 * Looking for test storage... 00:08:22.621 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:22.621 03:19:47 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:22.621 03:19:47 -- nvmf/common.sh@7 -- # uname -s 00:08:22.621 03:19:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:22.621 03:19:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:22.621 03:19:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:22.621 03:19:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:22.621 03:19:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:22.621 03:19:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:22.621 03:19:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:22.621 03:19:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:22.621 03:19:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:22.621 03:19:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:22.621 03:19:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:08:22.621 03:19:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:08:22.621 03:19:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:22.621 03:19:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:22.621 03:19:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:22.621 03:19:47 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:22.621 03:19:47 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:22.621 03:19:47 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:22.621 03:19:47 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:22.621 03:19:47 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:22.621 03:19:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.621 03:19:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.621 03:19:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.621 03:19:47 -- paths/export.sh@5 -- # export PATH 00:08:22.621 03:19:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.621 03:19:47 -- nvmf/common.sh@47 -- # : 0 00:08:22.621 03:19:47 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:22.621 03:19:47 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:22.621 03:19:47 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:22.621 03:19:47 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:22.621 03:19:47 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:22.621 03:19:47 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:22.621 03:19:47 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:22.621 03:19:47 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:22.621 03:19:47 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:22.621 03:19:47 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:08:22.621 03:19:47 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:08:22.621 03:19:47 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:22.621 03:19:47 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:22.621 03:19:47 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:22.621 03:19:47 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:22.621 03:19:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:22.621 03:19:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:22.621 03:19:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:22.621 03:19:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:22.621 03:19:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:22.621 03:19:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:22.621 03:19:47 -- common/autotest_common.sh@10 -- # set +x 00:08:24.551 03:19:49 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:24.551 03:19:49 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:24.551 03:19:49 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:24.551 03:19:49 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:24.551 03:19:49 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:24.551 03:19:49 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:24.551 03:19:49 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:24.551 03:19:49 -- nvmf/common.sh@295 -- # net_devs=() 00:08:24.551 03:19:49 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:24.551 03:19:49 -- nvmf/common.sh@296 -- # e810=() 00:08:24.551 03:19:49 -- nvmf/common.sh@296 -- # local -ga e810 00:08:24.551 03:19:49 -- nvmf/common.sh@297 -- # x722=() 00:08:24.551 03:19:49 -- nvmf/common.sh@297 -- # local -ga x722 00:08:24.551 03:19:49 -- nvmf/common.sh@298 -- # mlx=() 00:08:24.551 03:19:49 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:24.551 03:19:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:24.551 03:19:49 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:24.551 03:19:49 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:08:24.551 03:19:49 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:24.551 03:19:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:24.551 03:19:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:08:24.551 Found 0000:09:00.0 (0x8086 - 0x159b) 00:08:24.551 03:19:49 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:24.551 03:19:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:08:24.551 Found 0000:09:00.1 (0x8086 - 0x159b) 00:08:24.551 03:19:49 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:24.551 03:19:49 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:08:24.551 03:19:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:24.551 03:19:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:24.551 03:19:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:24.551 03:19:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:24.551 03:19:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:08:24.551 Found net devices under 0000:09:00.0: cvl_0_0 00:08:24.552 03:19:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:24.552 03:19:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:24.552 03:19:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:24.552 03:19:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:24.552 03:19:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:24.552 03:19:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:08:24.552 Found net devices under 0000:09:00.1: cvl_0_1 00:08:24.552 03:19:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:24.552 03:19:49 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:24.552 03:19:49 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:24.552 03:19:49 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:24.552 03:19:49 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:08:24.552 03:19:49 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:08:24.552 03:19:49 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:24.552 03:19:49 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:24.552 03:19:49 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:24.552 03:19:49 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:08:24.552 03:19:49 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:24.552 03:19:49 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:24.552 03:19:49 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:08:24.552 03:19:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:24.552 03:19:49 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:24.552 03:19:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:08:24.552 03:19:49 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:08:24.552 03:19:49 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:08:24.552 03:19:49 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:24.810 03:19:49 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:24.810 03:19:49 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:24.810 03:19:49 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:08:24.810 03:19:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:24.810 03:19:49 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:24.810 03:19:49 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:24.810 03:19:49 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:08:24.810 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:24.810 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:08:24.810 00:08:24.810 --- 10.0.0.2 ping statistics --- 00:08:24.810 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:24.810 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:08:24.810 03:19:49 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:24.810 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:24.810 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:08:24.810 00:08:24.810 --- 10.0.0.1 ping statistics --- 00:08:24.810 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:24.810 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:08:24.810 03:19:49 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:24.810 03:19:49 -- nvmf/common.sh@411 -- # return 0 00:08:24.810 03:19:49 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:24.810 03:19:49 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:24.810 03:19:49 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:08:24.810 03:19:49 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:08:24.810 03:19:49 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:24.810 03:19:49 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:08:24.810 03:19:49 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:08:24.810 03:19:49 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:08:24.810 03:19:49 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:24.810 03:19:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:24.810 03:19:49 -- common/autotest_common.sh@10 -- # set +x 00:08:24.810 03:19:49 -- nvmf/common.sh@470 -- # nvmfpid=1380290 00:08:24.810 03:19:49 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:08:24.810 03:19:49 -- nvmf/common.sh@471 -- # waitforlisten 1380290 00:08:24.810 03:19:49 -- common/autotest_common.sh@817 -- # '[' -z 1380290 ']' 00:08:24.810 03:19:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:24.810 03:19:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:24.810 03:19:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:24.810 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:24.810 03:19:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:24.810 03:19:49 -- common/autotest_common.sh@10 -- # set +x 00:08:24.810 [2024-04-27 03:19:49.726421] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:08:24.810 [2024-04-27 03:19:49.726509] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:24.810 EAL: No free 2048 kB hugepages reported on node 1 00:08:25.068 [2024-04-27 03:19:49.801150] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:25.068 [2024-04-27 03:19:49.905145] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:25.068 [2024-04-27 03:19:49.905215] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:25.068 [2024-04-27 03:19:49.905229] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:25.068 [2024-04-27 03:19:49.905240] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:25.068 [2024-04-27 03:19:49.905272] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:25.068 [2024-04-27 03:19:49.908272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:25.068 [2024-04-27 03:19:49.908346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:25.068 [2024-04-27 03:19:49.908350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:25.068 03:19:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:25.068 03:19:50 -- common/autotest_common.sh@850 -- # return 0 00:08:25.068 03:19:50 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:25.068 03:19:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:25.068 03:19:50 -- common/autotest_common.sh@10 -- # set +x 00:08:25.326 03:19:50 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:25.326 03:19:50 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:08:25.326 03:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:08:25.584 [2024-04-27 03:19:50.328131] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:25.584 03:19:50 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:08:25.843 03:19:50 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:26.100 [2024-04-27 03:19:50.830853] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:26.100 03:19:50 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:26.357 03:19:51 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:08:26.615 Malloc0 00:08:26.615 03:19:51 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:08:26.615 Delay0 00:08:26.873 03:19:51 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:27.131 03:19:51 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:08:27.131 NULL1 00:08:27.389 03:19:52 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:08:27.389 03:19:52 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=1380594 00:08:27.389 03:19:52 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:08:27.389 03:19:52 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:27.389 03:19:52 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:27.646 EAL: No free 2048 kB hugepages reported on node 1 00:08:28.578 Read completed with error (sct=0, sc=11) 00:08:28.578 03:19:53 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:28.578 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:28.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:28.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:28.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:28.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:28.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:28.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:29.094 03:19:53 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:08:29.094 03:19:53 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:08:29.350 true 00:08:29.350 03:19:54 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:29.351 03:19:54 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:29.915 03:19:54 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:30.171 03:19:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:08:30.171 03:19:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:08:30.738 true 00:08:30.738 03:19:55 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:30.738 03:19:55 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:30.738 03:19:55 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:30.996 03:19:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:08:30.996 03:19:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:08:31.253 true 00:08:31.253 03:19:56 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:31.253 03:19:56 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:31.511 03:19:56 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:31.769 03:19:56 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:08:31.769 03:19:56 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:08:32.027 true 00:08:32.027 03:19:56 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:32.027 03:19:56 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:32.961 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:32.961 03:19:57 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:32.961 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:33.218 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:33.218 03:19:58 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:08:33.218 03:19:58 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:08:33.475 true 00:08:33.475 03:19:58 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:33.475 03:19:58 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:33.733 03:19:58 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:33.991 03:19:58 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:08:33.991 03:19:58 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:08:34.248 true 00:08:34.248 03:19:59 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:34.248 03:19:59 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:35.181 03:20:00 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:35.181 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:35.439 03:20:00 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:08:35.439 03:20:00 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:08:35.696 true 00:08:35.696 03:20:00 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:35.696 03:20:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:35.953 03:20:00 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:36.210 03:20:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:08:36.210 03:20:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:08:36.467 true 00:08:36.467 03:20:01 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:36.467 03:20:01 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:37.400 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:37.400 03:20:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:37.657 03:20:02 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:08:37.657 03:20:02 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:08:37.915 true 00:08:37.915 03:20:02 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:37.915 03:20:02 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:38.180 03:20:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:38.443 03:20:03 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:08:38.444 03:20:03 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:08:38.701 true 00:08:38.701 03:20:03 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:38.701 03:20:03 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:39.672 03:20:04 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:39.672 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:39.672 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:39.672 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:39.672 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:39.672 03:20:04 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:08:39.672 03:20:04 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:08:39.930 true 00:08:39.930 03:20:04 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:39.930 03:20:04 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:40.187 03:20:05 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:40.445 03:20:05 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:08:40.445 03:20:05 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:08:40.703 true 00:08:40.703 03:20:05 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:40.703 03:20:05 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:41.635 03:20:06 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:41.635 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:41.892 03:20:06 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:08:41.892 03:20:06 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:08:42.150 true 00:08:42.150 03:20:07 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:42.150 03:20:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:42.407 03:20:07 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:42.664 03:20:07 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:08:42.664 03:20:07 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:08:42.920 true 00:08:42.920 03:20:07 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:42.921 03:20:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:43.853 03:20:08 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:43.853 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:43.853 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:44.111 03:20:08 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:08:44.111 03:20:08 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:08:44.369 true 00:08:44.369 03:20:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:44.369 03:20:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:44.627 03:20:09 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:44.884 03:20:09 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:08:44.884 03:20:09 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:08:45.142 true 00:08:45.142 03:20:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:45.142 03:20:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:46.074 03:20:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:46.331 03:20:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:08:46.331 03:20:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:08:46.587 true 00:08:46.843 03:20:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:46.843 03:20:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:46.843 03:20:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:47.100 03:20:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:08:47.100 03:20:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:08:47.356 true 00:08:47.356 03:20:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:47.356 03:20:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:47.613 03:20:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:47.869 03:20:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:08:47.869 03:20:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:08:48.125 true 00:08:48.125 03:20:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:48.125 03:20:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:49.055 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:49.055 03:20:14 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:49.619 03:20:14 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:08:49.619 03:20:14 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:08:49.619 true 00:08:49.619 03:20:14 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:49.619 03:20:14 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:49.876 03:20:14 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:50.132 03:20:15 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:08:50.132 03:20:15 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:08:50.390 true 00:08:50.390 03:20:15 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:50.390 03:20:15 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:51.322 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:51.322 03:20:16 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:51.322 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:51.579 03:20:16 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:08:51.579 03:20:16 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:08:51.579 true 00:08:51.836 03:20:16 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:51.836 03:20:16 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:51.836 03:20:16 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:52.094 03:20:17 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:08:52.094 03:20:17 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:08:52.351 true 00:08:52.351 03:20:17 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:52.351 03:20:17 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:53.721 03:20:18 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:53.721 03:20:18 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:08:53.721 03:20:18 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:08:53.979 true 00:08:53.979 03:20:18 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:53.979 03:20:18 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:54.236 03:20:19 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:54.494 03:20:19 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:08:54.494 03:20:19 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:08:54.751 true 00:08:54.751 03:20:19 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:54.751 03:20:19 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:55.696 03:20:20 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:55.696 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:55.696 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:55.696 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:55.696 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:55.696 03:20:20 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:08:55.696 03:20:20 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:08:55.958 true 00:08:55.958 03:20:20 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:55.958 03:20:20 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:56.213 03:20:21 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:56.470 03:20:21 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:08:56.470 03:20:21 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:08:56.728 true 00:08:56.728 03:20:21 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:56.728 03:20:21 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:57.660 Initializing NVMe Controllers 00:08:57.660 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:57.660 Controller IO queue size 128, less than required. 00:08:57.660 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:08:57.660 Controller IO queue size 128, less than required. 00:08:57.660 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:08:57.660 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:57.660 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:08:57.660 Initialization complete. Launching workers. 00:08:57.660 ======================================================== 00:08:57.660 Latency(us) 00:08:57.660 Device Information : IOPS MiB/s Average min max 00:08:57.660 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 929.13 0.45 72673.59 2862.10 1012562.64 00:08:57.660 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10682.23 5.22 11982.78 3713.47 456480.32 00:08:57.660 ======================================================== 00:08:57.660 Total : 11611.37 5.67 16839.22 2862.10 1012562.64 00:08:57.660 00:08:57.918 03:20:22 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:58.186 03:20:22 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:08:58.186 03:20:22 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:08:58.186 true 00:08:58.186 03:20:23 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1380594 00:08:58.186 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (1380594) - No such process 00:08:58.186 03:20:23 -- target/ns_hotplug_stress.sh@44 -- # wait 1380594 00:08:58.186 03:20:23 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:08:58.186 03:20:23 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:08:58.186 03:20:23 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:58.186 03:20:23 -- nvmf/common.sh@117 -- # sync 00:08:58.443 03:20:23 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:08:58.443 03:20:23 -- nvmf/common.sh@120 -- # set +e 00:08:58.443 03:20:23 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:58.444 03:20:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:08:58.444 rmmod nvme_tcp 00:08:58.444 rmmod nvme_fabrics 00:08:58.444 rmmod nvme_keyring 00:08:58.444 03:20:23 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:58.444 03:20:23 -- nvmf/common.sh@124 -- # set -e 00:08:58.444 03:20:23 -- nvmf/common.sh@125 -- # return 0 00:08:58.444 03:20:23 -- nvmf/common.sh@478 -- # '[' -n 1380290 ']' 00:08:58.444 03:20:23 -- nvmf/common.sh@479 -- # killprocess 1380290 00:08:58.444 03:20:23 -- common/autotest_common.sh@936 -- # '[' -z 1380290 ']' 00:08:58.444 03:20:23 -- common/autotest_common.sh@940 -- # kill -0 1380290 00:08:58.444 03:20:23 -- common/autotest_common.sh@941 -- # uname 00:08:58.444 03:20:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:58.444 03:20:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1380290 00:08:58.444 03:20:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:08:58.444 03:20:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:08:58.444 03:20:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1380290' 00:08:58.444 killing process with pid 1380290 00:08:58.444 03:20:23 -- common/autotest_common.sh@955 -- # kill 1380290 00:08:58.444 03:20:23 -- common/autotest_common.sh@960 -- # wait 1380290 00:08:58.703 03:20:23 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:58.703 03:20:23 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:08:58.703 03:20:23 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:08:58.703 03:20:23 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:58.703 03:20:23 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:08:58.703 03:20:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:58.703 03:20:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:58.703 03:20:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:00.607 03:20:25 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:09:00.607 00:09:00.607 real 0m38.153s 00:09:00.607 user 2m27.259s 00:09:00.607 sys 0m10.305s 00:09:00.607 03:20:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:00.607 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:09:00.607 ************************************ 00:09:00.607 END TEST nvmf_ns_hotplug_stress 00:09:00.607 ************************************ 00:09:00.607 03:20:25 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:09:00.607 03:20:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:00.607 03:20:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:00.607 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:09:00.866 ************************************ 00:09:00.866 START TEST nvmf_connect_stress 00:09:00.866 ************************************ 00:09:00.866 03:20:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:09:00.866 * Looking for test storage... 00:09:00.866 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:00.866 03:20:25 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:00.866 03:20:25 -- nvmf/common.sh@7 -- # uname -s 00:09:00.866 03:20:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:00.866 03:20:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:00.866 03:20:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:00.866 03:20:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:00.866 03:20:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:00.866 03:20:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:00.866 03:20:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:00.866 03:20:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:00.866 03:20:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:00.866 03:20:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:00.866 03:20:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:09:00.866 03:20:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:09:00.866 03:20:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:00.866 03:20:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:00.866 03:20:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:00.866 03:20:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:00.866 03:20:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:00.866 03:20:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:00.866 03:20:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:00.866 03:20:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:00.866 03:20:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:00.867 03:20:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:00.867 03:20:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:00.867 03:20:25 -- paths/export.sh@5 -- # export PATH 00:09:00.867 03:20:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:00.867 03:20:25 -- nvmf/common.sh@47 -- # : 0 00:09:00.867 03:20:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:00.867 03:20:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:00.867 03:20:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:00.867 03:20:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:00.867 03:20:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:00.867 03:20:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:00.867 03:20:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:00.867 03:20:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:00.867 03:20:25 -- target/connect_stress.sh@12 -- # nvmftestinit 00:09:00.867 03:20:25 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:09:00.867 03:20:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:00.867 03:20:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:00.867 03:20:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:00.867 03:20:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:00.867 03:20:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:00.867 03:20:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:00.867 03:20:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:00.867 03:20:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:00.867 03:20:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:00.867 03:20:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:00.867 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.768 03:20:27 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:02.768 03:20:27 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:02.768 03:20:27 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:02.768 03:20:27 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:02.768 03:20:27 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:02.768 03:20:27 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:02.768 03:20:27 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:02.768 03:20:27 -- nvmf/common.sh@295 -- # net_devs=() 00:09:02.768 03:20:27 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:02.768 03:20:27 -- nvmf/common.sh@296 -- # e810=() 00:09:02.768 03:20:27 -- nvmf/common.sh@296 -- # local -ga e810 00:09:02.768 03:20:27 -- nvmf/common.sh@297 -- # x722=() 00:09:02.768 03:20:27 -- nvmf/common.sh@297 -- # local -ga x722 00:09:02.768 03:20:27 -- nvmf/common.sh@298 -- # mlx=() 00:09:02.768 03:20:27 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:02.768 03:20:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:02.768 03:20:27 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:02.768 03:20:27 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:09:02.768 03:20:27 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:09:02.768 03:20:27 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:09:02.768 03:20:27 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:09:02.768 03:20:27 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:02.768 03:20:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:02.768 03:20:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:09:02.768 Found 0000:09:00.0 (0x8086 - 0x159b) 00:09:02.768 03:20:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:02.769 03:20:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:09:02.769 Found 0000:09:00.1 (0x8086 - 0x159b) 00:09:02.769 03:20:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:02.769 03:20:27 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:09:02.769 03:20:27 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:09:03.027 03:20:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:03.027 03:20:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:03.027 03:20:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:03.027 03:20:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:03.027 03:20:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:09:03.027 Found net devices under 0000:09:00.0: cvl_0_0 00:09:03.027 03:20:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:03.027 03:20:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:03.027 03:20:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:03.027 03:20:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:03.027 03:20:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:03.027 03:20:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:09:03.027 Found net devices under 0000:09:00.1: cvl_0_1 00:09:03.028 03:20:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:03.028 03:20:27 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:03.028 03:20:27 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:03.028 03:20:27 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:03.028 03:20:27 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:09:03.028 03:20:27 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:09:03.028 03:20:27 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:03.028 03:20:27 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:03.028 03:20:27 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:03.028 03:20:27 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:09:03.028 03:20:27 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:03.028 03:20:27 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:03.028 03:20:27 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:09:03.028 03:20:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:03.028 03:20:27 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:03.028 03:20:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:09:03.028 03:20:27 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:09:03.028 03:20:27 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:09:03.028 03:20:27 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:03.028 03:20:27 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:03.028 03:20:27 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:03.028 03:20:27 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:09:03.028 03:20:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:03.028 03:20:27 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:03.028 03:20:27 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:03.028 03:20:27 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:09:03.028 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:03.028 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:09:03.028 00:09:03.028 --- 10.0.0.2 ping statistics --- 00:09:03.028 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:03.028 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:09:03.028 03:20:27 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:03.028 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:03.028 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:09:03.028 00:09:03.028 --- 10.0.0.1 ping statistics --- 00:09:03.028 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:03.028 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:09:03.028 03:20:27 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:03.028 03:20:27 -- nvmf/common.sh@411 -- # return 0 00:09:03.028 03:20:27 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:03.028 03:20:27 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:03.028 03:20:27 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:09:03.028 03:20:27 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:09:03.028 03:20:27 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:03.028 03:20:27 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:09:03.028 03:20:27 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:09:03.028 03:20:27 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:09:03.028 03:20:27 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:03.028 03:20:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:03.028 03:20:27 -- common/autotest_common.sh@10 -- # set +x 00:09:03.028 03:20:27 -- nvmf/common.sh@470 -- # nvmfpid=1386311 00:09:03.028 03:20:27 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:09:03.028 03:20:27 -- nvmf/common.sh@471 -- # waitforlisten 1386311 00:09:03.028 03:20:27 -- common/autotest_common.sh@817 -- # '[' -z 1386311 ']' 00:09:03.028 03:20:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:03.028 03:20:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:03.028 03:20:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:03.028 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:03.028 03:20:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:03.028 03:20:27 -- common/autotest_common.sh@10 -- # set +x 00:09:03.028 [2024-04-27 03:20:27.953516] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:09:03.028 [2024-04-27 03:20:27.953614] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:03.028 EAL: No free 2048 kB hugepages reported on node 1 00:09:03.286 [2024-04-27 03:20:28.042815] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:03.286 [2024-04-27 03:20:28.174022] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:03.286 [2024-04-27 03:20:28.174113] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:03.286 [2024-04-27 03:20:28.174141] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:03.286 [2024-04-27 03:20:28.174175] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:03.286 [2024-04-27 03:20:28.174196] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:03.286 [2024-04-27 03:20:28.174305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:03.286 [2024-04-27 03:20:28.174379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:03.286 [2024-04-27 03:20:28.174369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:03.544 03:20:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:03.544 03:20:28 -- common/autotest_common.sh@850 -- # return 0 00:09:03.544 03:20:28 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:03.544 03:20:28 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:03.544 03:20:28 -- common/autotest_common.sh@10 -- # set +x 00:09:03.544 03:20:28 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:03.544 03:20:28 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:03.544 03:20:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:03.544 03:20:28 -- common/autotest_common.sh@10 -- # set +x 00:09:03.544 [2024-04-27 03:20:28.320793] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:03.544 03:20:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:03.544 03:20:28 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:09:03.544 03:20:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:03.544 03:20:28 -- common/autotest_common.sh@10 -- # set +x 00:09:03.544 03:20:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:03.544 03:20:28 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:03.544 03:20:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:03.544 03:20:28 -- common/autotest_common.sh@10 -- # set +x 00:09:03.544 [2024-04-27 03:20:28.346395] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:03.544 03:20:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:03.544 03:20:28 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:09:03.544 03:20:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:03.544 03:20:28 -- common/autotest_common.sh@10 -- # set +x 00:09:03.544 NULL1 00:09:03.544 03:20:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:03.544 03:20:28 -- target/connect_stress.sh@21 -- # PERF_PID=1386337 00:09:03.544 03:20:28 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:09:03.544 03:20:28 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:09:03.544 03:20:28 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:09:03.544 03:20:28 -- target/connect_stress.sh@27 -- # seq 1 20 00:09:03.544 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.544 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.544 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.544 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.544 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 EAL: No free 2048 kB hugepages reported on node 1 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:03.545 03:20:28 -- target/connect_stress.sh@28 -- # cat 00:09:03.545 03:20:28 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:03.545 03:20:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:03.545 03:20:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:03.545 03:20:28 -- common/autotest_common.sh@10 -- # set +x 00:09:03.802 03:20:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:03.803 03:20:28 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:03.803 03:20:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:03.803 03:20:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:03.803 03:20:28 -- common/autotest_common.sh@10 -- # set +x 00:09:04.368 03:20:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:04.368 03:20:29 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:04.368 03:20:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:04.368 03:20:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:04.369 03:20:29 -- common/autotest_common.sh@10 -- # set +x 00:09:04.627 03:20:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:04.627 03:20:29 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:04.627 03:20:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:04.627 03:20:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:04.627 03:20:29 -- common/autotest_common.sh@10 -- # set +x 00:09:04.885 03:20:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:04.885 03:20:29 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:04.885 03:20:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:04.885 03:20:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:04.885 03:20:29 -- common/autotest_common.sh@10 -- # set +x 00:09:05.143 03:20:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:05.143 03:20:30 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:05.143 03:20:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:05.143 03:20:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:05.143 03:20:30 -- common/autotest_common.sh@10 -- # set +x 00:09:05.400 03:20:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:05.400 03:20:30 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:05.400 03:20:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:05.400 03:20:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:05.401 03:20:30 -- common/autotest_common.sh@10 -- # set +x 00:09:05.966 03:20:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:05.966 03:20:30 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:05.966 03:20:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:05.966 03:20:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:05.966 03:20:30 -- common/autotest_common.sh@10 -- # set +x 00:09:06.223 03:20:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.223 03:20:30 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:06.223 03:20:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:06.223 03:20:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.223 03:20:30 -- common/autotest_common.sh@10 -- # set +x 00:09:06.481 03:20:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.481 03:20:31 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:06.481 03:20:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:06.481 03:20:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.481 03:20:31 -- common/autotest_common.sh@10 -- # set +x 00:09:06.740 03:20:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.740 03:20:31 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:06.740 03:20:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:06.740 03:20:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.740 03:20:31 -- common/autotest_common.sh@10 -- # set +x 00:09:06.998 03:20:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.998 03:20:31 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:06.998 03:20:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:06.998 03:20:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.998 03:20:31 -- common/autotest_common.sh@10 -- # set +x 00:09:07.568 03:20:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:07.568 03:20:32 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:07.568 03:20:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:07.568 03:20:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:07.568 03:20:32 -- common/autotest_common.sh@10 -- # set +x 00:09:07.825 03:20:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:07.825 03:20:32 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:07.825 03:20:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:07.825 03:20:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:07.825 03:20:32 -- common/autotest_common.sh@10 -- # set +x 00:09:08.083 03:20:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:08.083 03:20:32 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:08.083 03:20:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:08.083 03:20:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:08.083 03:20:32 -- common/autotest_common.sh@10 -- # set +x 00:09:08.340 03:20:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:08.340 03:20:33 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:08.340 03:20:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:08.340 03:20:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:08.340 03:20:33 -- common/autotest_common.sh@10 -- # set +x 00:09:08.597 03:20:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:08.597 03:20:33 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:08.597 03:20:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:08.597 03:20:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:08.597 03:20:33 -- common/autotest_common.sh@10 -- # set +x 00:09:09.162 03:20:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:09.162 03:20:33 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:09.162 03:20:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:09.162 03:20:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:09.162 03:20:33 -- common/autotest_common.sh@10 -- # set +x 00:09:09.419 03:20:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:09.419 03:20:34 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:09.419 03:20:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:09.419 03:20:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:09.419 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:09:09.677 03:20:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:09.677 03:20:34 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:09.678 03:20:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:09.678 03:20:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:09.678 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:09:09.936 03:20:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:09.936 03:20:34 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:09.936 03:20:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:09.936 03:20:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:09.936 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:09:10.193 03:20:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:10.193 03:20:35 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:10.193 03:20:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:10.193 03:20:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:10.193 03:20:35 -- common/autotest_common.sh@10 -- # set +x 00:09:10.759 03:20:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:10.759 03:20:35 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:10.759 03:20:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:10.759 03:20:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:10.759 03:20:35 -- common/autotest_common.sh@10 -- # set +x 00:09:11.017 03:20:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:11.017 03:20:35 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:11.017 03:20:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:11.017 03:20:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:11.017 03:20:35 -- common/autotest_common.sh@10 -- # set +x 00:09:11.275 03:20:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:11.275 03:20:36 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:11.275 03:20:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:11.275 03:20:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:11.275 03:20:36 -- common/autotest_common.sh@10 -- # set +x 00:09:11.532 03:20:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:11.532 03:20:36 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:11.532 03:20:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:11.532 03:20:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:11.532 03:20:36 -- common/autotest_common.sh@10 -- # set +x 00:09:11.817 03:20:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:11.817 03:20:36 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:11.817 03:20:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:11.817 03:20:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:11.817 03:20:36 -- common/autotest_common.sh@10 -- # set +x 00:09:12.386 03:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:12.386 03:20:37 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:12.386 03:20:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:12.386 03:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:12.386 03:20:37 -- common/autotest_common.sh@10 -- # set +x 00:09:12.644 03:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:12.644 03:20:37 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:12.644 03:20:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:12.644 03:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:12.644 03:20:37 -- common/autotest_common.sh@10 -- # set +x 00:09:12.902 03:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:12.902 03:20:37 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:12.902 03:20:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:12.902 03:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:12.902 03:20:37 -- common/autotest_common.sh@10 -- # set +x 00:09:13.159 03:20:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:13.159 03:20:38 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:13.159 03:20:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:13.159 03:20:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:13.159 03:20:38 -- common/autotest_common.sh@10 -- # set +x 00:09:13.417 03:20:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:13.417 03:20:38 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:13.417 03:20:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:13.417 03:20:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:13.417 03:20:38 -- common/autotest_common.sh@10 -- # set +x 00:09:13.675 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:09:13.933 03:20:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:13.933 03:20:38 -- target/connect_stress.sh@34 -- # kill -0 1386337 00:09:13.933 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1386337) - No such process 00:09:13.933 03:20:38 -- target/connect_stress.sh@38 -- # wait 1386337 00:09:13.933 03:20:38 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:09:13.933 03:20:38 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:09:13.933 03:20:38 -- target/connect_stress.sh@43 -- # nvmftestfini 00:09:13.933 03:20:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:13.933 03:20:38 -- nvmf/common.sh@117 -- # sync 00:09:13.933 03:20:38 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:09:13.933 03:20:38 -- nvmf/common.sh@120 -- # set +e 00:09:13.933 03:20:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:13.933 03:20:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:09:13.933 rmmod nvme_tcp 00:09:13.933 rmmod nvme_fabrics 00:09:13.933 rmmod nvme_keyring 00:09:13.933 03:20:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:13.933 03:20:38 -- nvmf/common.sh@124 -- # set -e 00:09:13.933 03:20:38 -- nvmf/common.sh@125 -- # return 0 00:09:13.933 03:20:38 -- nvmf/common.sh@478 -- # '[' -n 1386311 ']' 00:09:13.933 03:20:38 -- nvmf/common.sh@479 -- # killprocess 1386311 00:09:13.933 03:20:38 -- common/autotest_common.sh@936 -- # '[' -z 1386311 ']' 00:09:13.933 03:20:38 -- common/autotest_common.sh@940 -- # kill -0 1386311 00:09:13.933 03:20:38 -- common/autotest_common.sh@941 -- # uname 00:09:13.933 03:20:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:13.933 03:20:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1386311 00:09:13.933 03:20:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:09:13.933 03:20:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:09:13.933 03:20:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1386311' 00:09:13.933 killing process with pid 1386311 00:09:13.933 03:20:38 -- common/autotest_common.sh@955 -- # kill 1386311 00:09:13.933 03:20:38 -- common/autotest_common.sh@960 -- # wait 1386311 00:09:14.191 03:20:39 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:14.191 03:20:39 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:09:14.191 03:20:39 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:09:14.191 03:20:39 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:14.191 03:20:39 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:09:14.191 03:20:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:14.191 03:20:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:14.191 03:20:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:16.095 03:20:41 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:09:16.353 00:09:16.353 real 0m15.393s 00:09:16.353 user 0m38.514s 00:09:16.353 sys 0m5.945s 00:09:16.353 03:20:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:16.353 03:20:41 -- common/autotest_common.sh@10 -- # set +x 00:09:16.353 ************************************ 00:09:16.353 END TEST nvmf_connect_stress 00:09:16.353 ************************************ 00:09:16.353 03:20:41 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:09:16.353 03:20:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:16.353 03:20:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:16.353 03:20:41 -- common/autotest_common.sh@10 -- # set +x 00:09:16.353 ************************************ 00:09:16.353 START TEST nvmf_fused_ordering 00:09:16.353 ************************************ 00:09:16.353 03:20:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:09:16.353 * Looking for test storage... 00:09:16.353 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:16.353 03:20:41 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:16.353 03:20:41 -- nvmf/common.sh@7 -- # uname -s 00:09:16.353 03:20:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:16.353 03:20:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:16.353 03:20:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:16.353 03:20:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:16.353 03:20:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:16.353 03:20:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:16.353 03:20:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:16.353 03:20:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:16.353 03:20:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:16.353 03:20:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:16.353 03:20:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:09:16.353 03:20:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:09:16.353 03:20:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:16.353 03:20:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:16.353 03:20:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:16.353 03:20:41 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:16.353 03:20:41 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:16.353 03:20:41 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:16.353 03:20:41 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:16.353 03:20:41 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:16.353 03:20:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.353 03:20:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.353 03:20:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.354 03:20:41 -- paths/export.sh@5 -- # export PATH 00:09:16.354 03:20:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.354 03:20:41 -- nvmf/common.sh@47 -- # : 0 00:09:16.354 03:20:41 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:16.354 03:20:41 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:16.354 03:20:41 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:16.354 03:20:41 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:16.354 03:20:41 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:16.354 03:20:41 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:16.354 03:20:41 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:16.354 03:20:41 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:16.354 03:20:41 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:09:16.354 03:20:41 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:09:16.354 03:20:41 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:16.354 03:20:41 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:16.354 03:20:41 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:16.354 03:20:41 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:16.354 03:20:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:16.354 03:20:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:16.354 03:20:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:16.354 03:20:41 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:16.354 03:20:41 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:16.354 03:20:41 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:16.354 03:20:41 -- common/autotest_common.sh@10 -- # set +x 00:09:18.255 03:20:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:18.255 03:20:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:18.255 03:20:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:18.255 03:20:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:18.255 03:20:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:18.255 03:20:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:18.255 03:20:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:18.255 03:20:43 -- nvmf/common.sh@295 -- # net_devs=() 00:09:18.255 03:20:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:18.255 03:20:43 -- nvmf/common.sh@296 -- # e810=() 00:09:18.255 03:20:43 -- nvmf/common.sh@296 -- # local -ga e810 00:09:18.255 03:20:43 -- nvmf/common.sh@297 -- # x722=() 00:09:18.255 03:20:43 -- nvmf/common.sh@297 -- # local -ga x722 00:09:18.255 03:20:43 -- nvmf/common.sh@298 -- # mlx=() 00:09:18.255 03:20:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:18.255 03:20:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:18.255 03:20:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:18.255 03:20:43 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:09:18.255 03:20:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:18.255 03:20:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:18.255 03:20:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:09:18.255 Found 0000:09:00.0 (0x8086 - 0x159b) 00:09:18.255 03:20:43 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:18.255 03:20:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:09:18.255 Found 0000:09:00.1 (0x8086 - 0x159b) 00:09:18.255 03:20:43 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:18.255 03:20:43 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:18.255 03:20:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:18.255 03:20:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:18.255 03:20:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:18.255 03:20:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:09:18.255 Found net devices under 0000:09:00.0: cvl_0_0 00:09:18.255 03:20:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:18.255 03:20:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:18.255 03:20:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:18.255 03:20:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:18.255 03:20:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:18.255 03:20:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:09:18.255 Found net devices under 0000:09:00.1: cvl_0_1 00:09:18.255 03:20:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:18.255 03:20:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:18.255 03:20:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:18.255 03:20:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:09:18.255 03:20:43 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:09:18.255 03:20:43 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:18.255 03:20:43 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:18.255 03:20:43 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:18.255 03:20:43 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:09:18.255 03:20:43 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:18.255 03:20:43 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:18.255 03:20:43 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:09:18.255 03:20:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:18.255 03:20:43 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:18.255 03:20:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:09:18.255 03:20:43 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:09:18.255 03:20:43 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:09:18.255 03:20:43 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:18.513 03:20:43 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:18.513 03:20:43 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:18.513 03:20:43 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:09:18.513 03:20:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:18.513 03:20:43 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:18.513 03:20:43 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:18.513 03:20:43 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:09:18.513 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:18.513 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:09:18.513 00:09:18.513 --- 10.0.0.2 ping statistics --- 00:09:18.513 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:18.513 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:09:18.513 03:20:43 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:18.513 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:18.513 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:09:18.513 00:09:18.513 --- 10.0.0.1 ping statistics --- 00:09:18.513 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:18.513 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:09:18.513 03:20:43 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:18.513 03:20:43 -- nvmf/common.sh@411 -- # return 0 00:09:18.513 03:20:43 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:18.513 03:20:43 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:18.513 03:20:43 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:09:18.513 03:20:43 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:09:18.513 03:20:43 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:18.513 03:20:43 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:09:18.513 03:20:43 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:09:18.513 03:20:43 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:09:18.513 03:20:43 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:18.513 03:20:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:18.513 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:09:18.513 03:20:43 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:09:18.513 03:20:43 -- nvmf/common.sh@470 -- # nvmfpid=1389562 00:09:18.513 03:20:43 -- nvmf/common.sh@471 -- # waitforlisten 1389562 00:09:18.513 03:20:43 -- common/autotest_common.sh@817 -- # '[' -z 1389562 ']' 00:09:18.513 03:20:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:18.513 03:20:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:18.513 03:20:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:18.513 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:18.513 03:20:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:18.513 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:09:18.513 [2024-04-27 03:20:43.395875] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:09:18.513 [2024-04-27 03:20:43.395948] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:18.513 EAL: No free 2048 kB hugepages reported on node 1 00:09:18.513 [2024-04-27 03:20:43.463199] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:18.772 [2024-04-27 03:20:43.581517] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:18.772 [2024-04-27 03:20:43.581595] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:18.772 [2024-04-27 03:20:43.581620] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:18.772 [2024-04-27 03:20:43.581633] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:18.772 [2024-04-27 03:20:43.581646] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:18.772 [2024-04-27 03:20:43.581678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:18.772 03:20:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:18.772 03:20:43 -- common/autotest_common.sh@850 -- # return 0 00:09:18.772 03:20:43 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:18.772 03:20:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:18.772 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:09:18.772 03:20:43 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:18.772 03:20:43 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:18.772 03:20:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:18.772 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:09:18.772 [2024-04-27 03:20:43.730585] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:18.772 03:20:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:18.773 03:20:43 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:09:18.773 03:20:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:18.773 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:09:18.773 03:20:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:18.773 03:20:43 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:18.773 03:20:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:18.773 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:09:18.773 [2024-04-27 03:20:43.746774] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:19.031 03:20:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:19.031 03:20:43 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:09:19.031 03:20:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:19.031 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:09:19.031 NULL1 00:09:19.031 03:20:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:19.031 03:20:43 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:09:19.031 03:20:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:19.031 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:09:19.031 03:20:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:19.031 03:20:43 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:09:19.031 03:20:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:19.031 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:09:19.031 03:20:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:19.031 03:20:43 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:09:19.031 [2024-04-27 03:20:43.793726] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:09:19.031 [2024-04-27 03:20:43.793769] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1389642 ] 00:09:19.031 EAL: No free 2048 kB hugepages reported on node 1 00:09:19.645 Attached to nqn.2016-06.io.spdk:cnode1 00:09:19.645 Namespace ID: 1 size: 1GB 00:09:19.645 fused_ordering(0) 00:09:19.645 fused_ordering(1) 00:09:19.645 fused_ordering(2) 00:09:19.645 fused_ordering(3) 00:09:19.645 fused_ordering(4) 00:09:19.645 fused_ordering(5) 00:09:19.645 fused_ordering(6) 00:09:19.645 fused_ordering(7) 00:09:19.645 fused_ordering(8) 00:09:19.645 fused_ordering(9) 00:09:19.645 fused_ordering(10) 00:09:19.645 fused_ordering(11) 00:09:19.645 fused_ordering(12) 00:09:19.645 fused_ordering(13) 00:09:19.645 fused_ordering(14) 00:09:19.645 fused_ordering(15) 00:09:19.645 fused_ordering(16) 00:09:19.645 fused_ordering(17) 00:09:19.645 fused_ordering(18) 00:09:19.645 fused_ordering(19) 00:09:19.645 fused_ordering(20) 00:09:19.645 fused_ordering(21) 00:09:19.645 fused_ordering(22) 00:09:19.645 fused_ordering(23) 00:09:19.645 fused_ordering(24) 00:09:19.645 fused_ordering(25) 00:09:19.645 fused_ordering(26) 00:09:19.645 fused_ordering(27) 00:09:19.645 fused_ordering(28) 00:09:19.645 fused_ordering(29) 00:09:19.645 fused_ordering(30) 00:09:19.645 fused_ordering(31) 00:09:19.645 fused_ordering(32) 00:09:19.645 fused_ordering(33) 00:09:19.645 fused_ordering(34) 00:09:19.645 fused_ordering(35) 00:09:19.645 fused_ordering(36) 00:09:19.645 fused_ordering(37) 00:09:19.645 fused_ordering(38) 00:09:19.645 fused_ordering(39) 00:09:19.645 fused_ordering(40) 00:09:19.645 fused_ordering(41) 00:09:19.645 fused_ordering(42) 00:09:19.645 fused_ordering(43) 00:09:19.645 fused_ordering(44) 00:09:19.645 fused_ordering(45) 00:09:19.645 fused_ordering(46) 00:09:19.645 fused_ordering(47) 00:09:19.645 fused_ordering(48) 00:09:19.645 fused_ordering(49) 00:09:19.645 fused_ordering(50) 00:09:19.645 fused_ordering(51) 00:09:19.645 fused_ordering(52) 00:09:19.645 fused_ordering(53) 00:09:19.645 fused_ordering(54) 00:09:19.645 fused_ordering(55) 00:09:19.645 fused_ordering(56) 00:09:19.645 fused_ordering(57) 00:09:19.645 fused_ordering(58) 00:09:19.645 fused_ordering(59) 00:09:19.645 fused_ordering(60) 00:09:19.645 fused_ordering(61) 00:09:19.645 fused_ordering(62) 00:09:19.645 fused_ordering(63) 00:09:19.645 fused_ordering(64) 00:09:19.645 fused_ordering(65) 00:09:19.645 fused_ordering(66) 00:09:19.645 fused_ordering(67) 00:09:19.645 fused_ordering(68) 00:09:19.645 fused_ordering(69) 00:09:19.645 fused_ordering(70) 00:09:19.645 fused_ordering(71) 00:09:19.645 fused_ordering(72) 00:09:19.645 fused_ordering(73) 00:09:19.645 fused_ordering(74) 00:09:19.645 fused_ordering(75) 00:09:19.645 fused_ordering(76) 00:09:19.645 fused_ordering(77) 00:09:19.645 fused_ordering(78) 00:09:19.645 fused_ordering(79) 00:09:19.645 fused_ordering(80) 00:09:19.645 fused_ordering(81) 00:09:19.645 fused_ordering(82) 00:09:19.645 fused_ordering(83) 00:09:19.645 fused_ordering(84) 00:09:19.645 fused_ordering(85) 00:09:19.645 fused_ordering(86) 00:09:19.645 fused_ordering(87) 00:09:19.645 fused_ordering(88) 00:09:19.645 fused_ordering(89) 00:09:19.645 fused_ordering(90) 00:09:19.645 fused_ordering(91) 00:09:19.645 fused_ordering(92) 00:09:19.645 fused_ordering(93) 00:09:19.645 fused_ordering(94) 00:09:19.645 fused_ordering(95) 00:09:19.645 fused_ordering(96) 00:09:19.645 fused_ordering(97) 00:09:19.645 fused_ordering(98) 00:09:19.645 fused_ordering(99) 00:09:19.645 fused_ordering(100) 00:09:19.645 fused_ordering(101) 00:09:19.645 fused_ordering(102) 00:09:19.645 fused_ordering(103) 00:09:19.645 fused_ordering(104) 00:09:19.645 fused_ordering(105) 00:09:19.645 fused_ordering(106) 00:09:19.645 fused_ordering(107) 00:09:19.645 fused_ordering(108) 00:09:19.645 fused_ordering(109) 00:09:19.645 fused_ordering(110) 00:09:19.645 fused_ordering(111) 00:09:19.645 fused_ordering(112) 00:09:19.645 fused_ordering(113) 00:09:19.645 fused_ordering(114) 00:09:19.645 fused_ordering(115) 00:09:19.645 fused_ordering(116) 00:09:19.645 fused_ordering(117) 00:09:19.645 fused_ordering(118) 00:09:19.645 fused_ordering(119) 00:09:19.645 fused_ordering(120) 00:09:19.645 fused_ordering(121) 00:09:19.645 fused_ordering(122) 00:09:19.645 fused_ordering(123) 00:09:19.645 fused_ordering(124) 00:09:19.645 fused_ordering(125) 00:09:19.645 fused_ordering(126) 00:09:19.645 fused_ordering(127) 00:09:19.645 fused_ordering(128) 00:09:19.645 fused_ordering(129) 00:09:19.645 fused_ordering(130) 00:09:19.645 fused_ordering(131) 00:09:19.645 fused_ordering(132) 00:09:19.645 fused_ordering(133) 00:09:19.645 fused_ordering(134) 00:09:19.645 fused_ordering(135) 00:09:19.645 fused_ordering(136) 00:09:19.645 fused_ordering(137) 00:09:19.645 fused_ordering(138) 00:09:19.645 fused_ordering(139) 00:09:19.645 fused_ordering(140) 00:09:19.645 fused_ordering(141) 00:09:19.645 fused_ordering(142) 00:09:19.645 fused_ordering(143) 00:09:19.645 fused_ordering(144) 00:09:19.645 fused_ordering(145) 00:09:19.645 fused_ordering(146) 00:09:19.645 fused_ordering(147) 00:09:19.645 fused_ordering(148) 00:09:19.645 fused_ordering(149) 00:09:19.645 fused_ordering(150) 00:09:19.645 fused_ordering(151) 00:09:19.645 fused_ordering(152) 00:09:19.645 fused_ordering(153) 00:09:19.645 fused_ordering(154) 00:09:19.645 fused_ordering(155) 00:09:19.645 fused_ordering(156) 00:09:19.645 fused_ordering(157) 00:09:19.645 fused_ordering(158) 00:09:19.645 fused_ordering(159) 00:09:19.645 fused_ordering(160) 00:09:19.645 fused_ordering(161) 00:09:19.645 fused_ordering(162) 00:09:19.645 fused_ordering(163) 00:09:19.645 fused_ordering(164) 00:09:19.645 fused_ordering(165) 00:09:19.645 fused_ordering(166) 00:09:19.645 fused_ordering(167) 00:09:19.645 fused_ordering(168) 00:09:19.645 fused_ordering(169) 00:09:19.645 fused_ordering(170) 00:09:19.645 fused_ordering(171) 00:09:19.645 fused_ordering(172) 00:09:19.645 fused_ordering(173) 00:09:19.645 fused_ordering(174) 00:09:19.645 fused_ordering(175) 00:09:19.645 fused_ordering(176) 00:09:19.645 fused_ordering(177) 00:09:19.645 fused_ordering(178) 00:09:19.645 fused_ordering(179) 00:09:19.645 fused_ordering(180) 00:09:19.645 fused_ordering(181) 00:09:19.645 fused_ordering(182) 00:09:19.645 fused_ordering(183) 00:09:19.645 fused_ordering(184) 00:09:19.645 fused_ordering(185) 00:09:19.645 fused_ordering(186) 00:09:19.645 fused_ordering(187) 00:09:19.645 fused_ordering(188) 00:09:19.645 fused_ordering(189) 00:09:19.645 fused_ordering(190) 00:09:19.645 fused_ordering(191) 00:09:19.645 fused_ordering(192) 00:09:19.646 fused_ordering(193) 00:09:19.646 fused_ordering(194) 00:09:19.646 fused_ordering(195) 00:09:19.646 fused_ordering(196) 00:09:19.646 fused_ordering(197) 00:09:19.646 fused_ordering(198) 00:09:19.646 fused_ordering(199) 00:09:19.646 fused_ordering(200) 00:09:19.646 fused_ordering(201) 00:09:19.646 fused_ordering(202) 00:09:19.646 fused_ordering(203) 00:09:19.646 fused_ordering(204) 00:09:19.646 fused_ordering(205) 00:09:19.917 fused_ordering(206) 00:09:19.917 fused_ordering(207) 00:09:19.917 fused_ordering(208) 00:09:19.917 fused_ordering(209) 00:09:19.917 fused_ordering(210) 00:09:19.917 fused_ordering(211) 00:09:19.917 fused_ordering(212) 00:09:19.917 fused_ordering(213) 00:09:19.917 fused_ordering(214) 00:09:19.917 fused_ordering(215) 00:09:19.917 fused_ordering(216) 00:09:19.917 fused_ordering(217) 00:09:19.917 fused_ordering(218) 00:09:19.917 fused_ordering(219) 00:09:19.917 fused_ordering(220) 00:09:19.917 fused_ordering(221) 00:09:19.917 fused_ordering(222) 00:09:19.917 fused_ordering(223) 00:09:19.917 fused_ordering(224) 00:09:19.917 fused_ordering(225) 00:09:19.917 fused_ordering(226) 00:09:19.917 fused_ordering(227) 00:09:19.917 fused_ordering(228) 00:09:19.917 fused_ordering(229) 00:09:19.917 fused_ordering(230) 00:09:19.917 fused_ordering(231) 00:09:19.917 fused_ordering(232) 00:09:19.917 fused_ordering(233) 00:09:19.917 fused_ordering(234) 00:09:19.917 fused_ordering(235) 00:09:19.917 fused_ordering(236) 00:09:19.917 fused_ordering(237) 00:09:19.917 fused_ordering(238) 00:09:19.917 fused_ordering(239) 00:09:19.917 fused_ordering(240) 00:09:19.917 fused_ordering(241) 00:09:19.917 fused_ordering(242) 00:09:19.917 fused_ordering(243) 00:09:19.917 fused_ordering(244) 00:09:19.917 fused_ordering(245) 00:09:19.917 fused_ordering(246) 00:09:19.917 fused_ordering(247) 00:09:19.917 fused_ordering(248) 00:09:19.917 fused_ordering(249) 00:09:19.917 fused_ordering(250) 00:09:19.917 fused_ordering(251) 00:09:19.917 fused_ordering(252) 00:09:19.917 fused_ordering(253) 00:09:19.917 fused_ordering(254) 00:09:19.917 fused_ordering(255) 00:09:19.917 fused_ordering(256) 00:09:19.917 fused_ordering(257) 00:09:19.917 fused_ordering(258) 00:09:19.917 fused_ordering(259) 00:09:19.917 fused_ordering(260) 00:09:19.917 fused_ordering(261) 00:09:19.917 fused_ordering(262) 00:09:19.917 fused_ordering(263) 00:09:19.917 fused_ordering(264) 00:09:19.917 fused_ordering(265) 00:09:19.917 fused_ordering(266) 00:09:19.917 fused_ordering(267) 00:09:19.917 fused_ordering(268) 00:09:19.917 fused_ordering(269) 00:09:19.917 fused_ordering(270) 00:09:19.917 fused_ordering(271) 00:09:19.917 fused_ordering(272) 00:09:19.917 fused_ordering(273) 00:09:19.917 fused_ordering(274) 00:09:19.917 fused_ordering(275) 00:09:19.917 fused_ordering(276) 00:09:19.917 fused_ordering(277) 00:09:19.917 fused_ordering(278) 00:09:19.917 fused_ordering(279) 00:09:19.917 fused_ordering(280) 00:09:19.917 fused_ordering(281) 00:09:19.917 fused_ordering(282) 00:09:19.917 fused_ordering(283) 00:09:19.917 fused_ordering(284) 00:09:19.917 fused_ordering(285) 00:09:19.917 fused_ordering(286) 00:09:19.917 fused_ordering(287) 00:09:19.917 fused_ordering(288) 00:09:19.917 fused_ordering(289) 00:09:19.917 fused_ordering(290) 00:09:19.917 fused_ordering(291) 00:09:19.917 fused_ordering(292) 00:09:19.917 fused_ordering(293) 00:09:19.917 fused_ordering(294) 00:09:19.917 fused_ordering(295) 00:09:19.917 fused_ordering(296) 00:09:19.917 fused_ordering(297) 00:09:19.917 fused_ordering(298) 00:09:19.917 fused_ordering(299) 00:09:19.917 fused_ordering(300) 00:09:19.917 fused_ordering(301) 00:09:19.917 fused_ordering(302) 00:09:19.917 fused_ordering(303) 00:09:19.917 fused_ordering(304) 00:09:19.917 fused_ordering(305) 00:09:19.917 fused_ordering(306) 00:09:19.917 fused_ordering(307) 00:09:19.917 fused_ordering(308) 00:09:19.917 fused_ordering(309) 00:09:19.917 fused_ordering(310) 00:09:19.917 fused_ordering(311) 00:09:19.917 fused_ordering(312) 00:09:19.917 fused_ordering(313) 00:09:19.917 fused_ordering(314) 00:09:19.917 fused_ordering(315) 00:09:19.917 fused_ordering(316) 00:09:19.917 fused_ordering(317) 00:09:19.917 fused_ordering(318) 00:09:19.917 fused_ordering(319) 00:09:19.917 fused_ordering(320) 00:09:19.917 fused_ordering(321) 00:09:19.917 fused_ordering(322) 00:09:19.917 fused_ordering(323) 00:09:19.917 fused_ordering(324) 00:09:19.917 fused_ordering(325) 00:09:19.917 fused_ordering(326) 00:09:19.917 fused_ordering(327) 00:09:19.917 fused_ordering(328) 00:09:19.917 fused_ordering(329) 00:09:19.917 fused_ordering(330) 00:09:19.917 fused_ordering(331) 00:09:19.917 fused_ordering(332) 00:09:19.917 fused_ordering(333) 00:09:19.917 fused_ordering(334) 00:09:19.917 fused_ordering(335) 00:09:19.917 fused_ordering(336) 00:09:19.917 fused_ordering(337) 00:09:19.917 fused_ordering(338) 00:09:19.917 fused_ordering(339) 00:09:19.917 fused_ordering(340) 00:09:19.917 fused_ordering(341) 00:09:19.917 fused_ordering(342) 00:09:19.917 fused_ordering(343) 00:09:19.917 fused_ordering(344) 00:09:19.917 fused_ordering(345) 00:09:19.917 fused_ordering(346) 00:09:19.917 fused_ordering(347) 00:09:19.917 fused_ordering(348) 00:09:19.917 fused_ordering(349) 00:09:19.917 fused_ordering(350) 00:09:19.917 fused_ordering(351) 00:09:19.917 fused_ordering(352) 00:09:19.917 fused_ordering(353) 00:09:19.917 fused_ordering(354) 00:09:19.917 fused_ordering(355) 00:09:19.917 fused_ordering(356) 00:09:19.917 fused_ordering(357) 00:09:19.917 fused_ordering(358) 00:09:19.917 fused_ordering(359) 00:09:19.917 fused_ordering(360) 00:09:19.917 fused_ordering(361) 00:09:19.917 fused_ordering(362) 00:09:19.917 fused_ordering(363) 00:09:19.917 fused_ordering(364) 00:09:19.917 fused_ordering(365) 00:09:19.917 fused_ordering(366) 00:09:19.917 fused_ordering(367) 00:09:19.917 fused_ordering(368) 00:09:19.917 fused_ordering(369) 00:09:19.917 fused_ordering(370) 00:09:19.917 fused_ordering(371) 00:09:19.917 fused_ordering(372) 00:09:19.917 fused_ordering(373) 00:09:19.917 fused_ordering(374) 00:09:19.917 fused_ordering(375) 00:09:19.917 fused_ordering(376) 00:09:19.917 fused_ordering(377) 00:09:19.917 fused_ordering(378) 00:09:19.917 fused_ordering(379) 00:09:19.917 fused_ordering(380) 00:09:19.917 fused_ordering(381) 00:09:19.917 fused_ordering(382) 00:09:19.917 fused_ordering(383) 00:09:19.917 fused_ordering(384) 00:09:19.917 fused_ordering(385) 00:09:19.917 fused_ordering(386) 00:09:19.917 fused_ordering(387) 00:09:19.917 fused_ordering(388) 00:09:19.917 fused_ordering(389) 00:09:19.917 fused_ordering(390) 00:09:19.917 fused_ordering(391) 00:09:19.917 fused_ordering(392) 00:09:19.917 fused_ordering(393) 00:09:19.917 fused_ordering(394) 00:09:19.917 fused_ordering(395) 00:09:19.917 fused_ordering(396) 00:09:19.917 fused_ordering(397) 00:09:19.917 fused_ordering(398) 00:09:19.917 fused_ordering(399) 00:09:19.917 fused_ordering(400) 00:09:19.917 fused_ordering(401) 00:09:19.917 fused_ordering(402) 00:09:19.917 fused_ordering(403) 00:09:19.917 fused_ordering(404) 00:09:19.917 fused_ordering(405) 00:09:19.917 fused_ordering(406) 00:09:19.917 fused_ordering(407) 00:09:19.917 fused_ordering(408) 00:09:19.917 fused_ordering(409) 00:09:19.917 fused_ordering(410) 00:09:20.483 fused_ordering(411) 00:09:20.483 fused_ordering(412) 00:09:20.483 fused_ordering(413) 00:09:20.483 fused_ordering(414) 00:09:20.483 fused_ordering(415) 00:09:20.483 fused_ordering(416) 00:09:20.483 fused_ordering(417) 00:09:20.483 fused_ordering(418) 00:09:20.483 fused_ordering(419) 00:09:20.483 fused_ordering(420) 00:09:20.483 fused_ordering(421) 00:09:20.483 fused_ordering(422) 00:09:20.483 fused_ordering(423) 00:09:20.483 fused_ordering(424) 00:09:20.483 fused_ordering(425) 00:09:20.483 fused_ordering(426) 00:09:20.483 fused_ordering(427) 00:09:20.483 fused_ordering(428) 00:09:20.483 fused_ordering(429) 00:09:20.483 fused_ordering(430) 00:09:20.483 fused_ordering(431) 00:09:20.483 fused_ordering(432) 00:09:20.483 fused_ordering(433) 00:09:20.483 fused_ordering(434) 00:09:20.483 fused_ordering(435) 00:09:20.483 fused_ordering(436) 00:09:20.483 fused_ordering(437) 00:09:20.483 fused_ordering(438) 00:09:20.483 fused_ordering(439) 00:09:20.483 fused_ordering(440) 00:09:20.483 fused_ordering(441) 00:09:20.483 fused_ordering(442) 00:09:20.483 fused_ordering(443) 00:09:20.483 fused_ordering(444) 00:09:20.483 fused_ordering(445) 00:09:20.483 fused_ordering(446) 00:09:20.483 fused_ordering(447) 00:09:20.483 fused_ordering(448) 00:09:20.483 fused_ordering(449) 00:09:20.483 fused_ordering(450) 00:09:20.483 fused_ordering(451) 00:09:20.483 fused_ordering(452) 00:09:20.483 fused_ordering(453) 00:09:20.483 fused_ordering(454) 00:09:20.483 fused_ordering(455) 00:09:20.483 fused_ordering(456) 00:09:20.483 fused_ordering(457) 00:09:20.483 fused_ordering(458) 00:09:20.483 fused_ordering(459) 00:09:20.483 fused_ordering(460) 00:09:20.483 fused_ordering(461) 00:09:20.483 fused_ordering(462) 00:09:20.483 fused_ordering(463) 00:09:20.483 fused_ordering(464) 00:09:20.483 fused_ordering(465) 00:09:20.483 fused_ordering(466) 00:09:20.483 fused_ordering(467) 00:09:20.483 fused_ordering(468) 00:09:20.483 fused_ordering(469) 00:09:20.483 fused_ordering(470) 00:09:20.483 fused_ordering(471) 00:09:20.483 fused_ordering(472) 00:09:20.483 fused_ordering(473) 00:09:20.483 fused_ordering(474) 00:09:20.483 fused_ordering(475) 00:09:20.483 fused_ordering(476) 00:09:20.483 fused_ordering(477) 00:09:20.483 fused_ordering(478) 00:09:20.483 fused_ordering(479) 00:09:20.483 fused_ordering(480) 00:09:20.483 fused_ordering(481) 00:09:20.483 fused_ordering(482) 00:09:20.483 fused_ordering(483) 00:09:20.483 fused_ordering(484) 00:09:20.483 fused_ordering(485) 00:09:20.483 fused_ordering(486) 00:09:20.483 fused_ordering(487) 00:09:20.483 fused_ordering(488) 00:09:20.483 fused_ordering(489) 00:09:20.483 fused_ordering(490) 00:09:20.483 fused_ordering(491) 00:09:20.483 fused_ordering(492) 00:09:20.483 fused_ordering(493) 00:09:20.483 fused_ordering(494) 00:09:20.483 fused_ordering(495) 00:09:20.483 fused_ordering(496) 00:09:20.483 fused_ordering(497) 00:09:20.483 fused_ordering(498) 00:09:20.483 fused_ordering(499) 00:09:20.483 fused_ordering(500) 00:09:20.483 fused_ordering(501) 00:09:20.483 fused_ordering(502) 00:09:20.483 fused_ordering(503) 00:09:20.483 fused_ordering(504) 00:09:20.483 fused_ordering(505) 00:09:20.483 fused_ordering(506) 00:09:20.483 fused_ordering(507) 00:09:20.483 fused_ordering(508) 00:09:20.483 fused_ordering(509) 00:09:20.483 fused_ordering(510) 00:09:20.483 fused_ordering(511) 00:09:20.484 fused_ordering(512) 00:09:20.484 fused_ordering(513) 00:09:20.484 fused_ordering(514) 00:09:20.484 fused_ordering(515) 00:09:20.484 fused_ordering(516) 00:09:20.484 fused_ordering(517) 00:09:20.484 fused_ordering(518) 00:09:20.484 fused_ordering(519) 00:09:20.484 fused_ordering(520) 00:09:20.484 fused_ordering(521) 00:09:20.484 fused_ordering(522) 00:09:20.484 fused_ordering(523) 00:09:20.484 fused_ordering(524) 00:09:20.484 fused_ordering(525) 00:09:20.484 fused_ordering(526) 00:09:20.484 fused_ordering(527) 00:09:20.484 fused_ordering(528) 00:09:20.484 fused_ordering(529) 00:09:20.484 fused_ordering(530) 00:09:20.484 fused_ordering(531) 00:09:20.484 fused_ordering(532) 00:09:20.484 fused_ordering(533) 00:09:20.484 fused_ordering(534) 00:09:20.484 fused_ordering(535) 00:09:20.484 fused_ordering(536) 00:09:20.484 fused_ordering(537) 00:09:20.484 fused_ordering(538) 00:09:20.484 fused_ordering(539) 00:09:20.484 fused_ordering(540) 00:09:20.484 fused_ordering(541) 00:09:20.484 fused_ordering(542) 00:09:20.484 fused_ordering(543) 00:09:20.484 fused_ordering(544) 00:09:20.484 fused_ordering(545) 00:09:20.484 fused_ordering(546) 00:09:20.484 fused_ordering(547) 00:09:20.484 fused_ordering(548) 00:09:20.484 fused_ordering(549) 00:09:20.484 fused_ordering(550) 00:09:20.484 fused_ordering(551) 00:09:20.484 fused_ordering(552) 00:09:20.484 fused_ordering(553) 00:09:20.484 fused_ordering(554) 00:09:20.484 fused_ordering(555) 00:09:20.484 fused_ordering(556) 00:09:20.484 fused_ordering(557) 00:09:20.484 fused_ordering(558) 00:09:20.484 fused_ordering(559) 00:09:20.484 fused_ordering(560) 00:09:20.484 fused_ordering(561) 00:09:20.484 fused_ordering(562) 00:09:20.484 fused_ordering(563) 00:09:20.484 fused_ordering(564) 00:09:20.484 fused_ordering(565) 00:09:20.484 fused_ordering(566) 00:09:20.484 fused_ordering(567) 00:09:20.484 fused_ordering(568) 00:09:20.484 fused_ordering(569) 00:09:20.484 fused_ordering(570) 00:09:20.484 fused_ordering(571) 00:09:20.484 fused_ordering(572) 00:09:20.484 fused_ordering(573) 00:09:20.484 fused_ordering(574) 00:09:20.484 fused_ordering(575) 00:09:20.484 fused_ordering(576) 00:09:20.484 fused_ordering(577) 00:09:20.484 fused_ordering(578) 00:09:20.484 fused_ordering(579) 00:09:20.484 fused_ordering(580) 00:09:20.484 fused_ordering(581) 00:09:20.484 fused_ordering(582) 00:09:20.484 fused_ordering(583) 00:09:20.484 fused_ordering(584) 00:09:20.484 fused_ordering(585) 00:09:20.484 fused_ordering(586) 00:09:20.484 fused_ordering(587) 00:09:20.484 fused_ordering(588) 00:09:20.484 fused_ordering(589) 00:09:20.484 fused_ordering(590) 00:09:20.484 fused_ordering(591) 00:09:20.484 fused_ordering(592) 00:09:20.484 fused_ordering(593) 00:09:20.484 fused_ordering(594) 00:09:20.484 fused_ordering(595) 00:09:20.484 fused_ordering(596) 00:09:20.484 fused_ordering(597) 00:09:20.484 fused_ordering(598) 00:09:20.484 fused_ordering(599) 00:09:20.484 fused_ordering(600) 00:09:20.484 fused_ordering(601) 00:09:20.484 fused_ordering(602) 00:09:20.484 fused_ordering(603) 00:09:20.484 fused_ordering(604) 00:09:20.484 fused_ordering(605) 00:09:20.484 fused_ordering(606) 00:09:20.484 fused_ordering(607) 00:09:20.484 fused_ordering(608) 00:09:20.484 fused_ordering(609) 00:09:20.484 fused_ordering(610) 00:09:20.484 fused_ordering(611) 00:09:20.484 fused_ordering(612) 00:09:20.484 fused_ordering(613) 00:09:20.484 fused_ordering(614) 00:09:20.484 fused_ordering(615) 00:09:21.047 fused_ordering(616) 00:09:21.047 fused_ordering(617) 00:09:21.047 fused_ordering(618) 00:09:21.047 fused_ordering(619) 00:09:21.047 fused_ordering(620) 00:09:21.047 fused_ordering(621) 00:09:21.047 fused_ordering(622) 00:09:21.047 fused_ordering(623) 00:09:21.047 fused_ordering(624) 00:09:21.047 fused_ordering(625) 00:09:21.047 fused_ordering(626) 00:09:21.047 fused_ordering(627) 00:09:21.047 fused_ordering(628) 00:09:21.047 fused_ordering(629) 00:09:21.047 fused_ordering(630) 00:09:21.047 fused_ordering(631) 00:09:21.047 fused_ordering(632) 00:09:21.047 fused_ordering(633) 00:09:21.047 fused_ordering(634) 00:09:21.047 fused_ordering(635) 00:09:21.047 fused_ordering(636) 00:09:21.047 fused_ordering(637) 00:09:21.047 fused_ordering(638) 00:09:21.047 fused_ordering(639) 00:09:21.047 fused_ordering(640) 00:09:21.047 fused_ordering(641) 00:09:21.047 fused_ordering(642) 00:09:21.047 fused_ordering(643) 00:09:21.047 fused_ordering(644) 00:09:21.047 fused_ordering(645) 00:09:21.047 fused_ordering(646) 00:09:21.047 fused_ordering(647) 00:09:21.047 fused_ordering(648) 00:09:21.047 fused_ordering(649) 00:09:21.047 fused_ordering(650) 00:09:21.047 fused_ordering(651) 00:09:21.047 fused_ordering(652) 00:09:21.047 fused_ordering(653) 00:09:21.047 fused_ordering(654) 00:09:21.047 fused_ordering(655) 00:09:21.047 fused_ordering(656) 00:09:21.047 fused_ordering(657) 00:09:21.047 fused_ordering(658) 00:09:21.047 fused_ordering(659) 00:09:21.047 fused_ordering(660) 00:09:21.047 fused_ordering(661) 00:09:21.047 fused_ordering(662) 00:09:21.047 fused_ordering(663) 00:09:21.047 fused_ordering(664) 00:09:21.047 fused_ordering(665) 00:09:21.047 fused_ordering(666) 00:09:21.047 fused_ordering(667) 00:09:21.047 fused_ordering(668) 00:09:21.047 fused_ordering(669) 00:09:21.048 fused_ordering(670) 00:09:21.048 fused_ordering(671) 00:09:21.048 fused_ordering(672) 00:09:21.048 fused_ordering(673) 00:09:21.048 fused_ordering(674) 00:09:21.048 fused_ordering(675) 00:09:21.048 fused_ordering(676) 00:09:21.048 fused_ordering(677) 00:09:21.048 fused_ordering(678) 00:09:21.048 fused_ordering(679) 00:09:21.048 fused_ordering(680) 00:09:21.048 fused_ordering(681) 00:09:21.048 fused_ordering(682) 00:09:21.048 fused_ordering(683) 00:09:21.048 fused_ordering(684) 00:09:21.048 fused_ordering(685) 00:09:21.048 fused_ordering(686) 00:09:21.048 fused_ordering(687) 00:09:21.048 fused_ordering(688) 00:09:21.048 fused_ordering(689) 00:09:21.048 fused_ordering(690) 00:09:21.048 fused_ordering(691) 00:09:21.048 fused_ordering(692) 00:09:21.048 fused_ordering(693) 00:09:21.048 fused_ordering(694) 00:09:21.048 fused_ordering(695) 00:09:21.048 fused_ordering(696) 00:09:21.048 fused_ordering(697) 00:09:21.048 fused_ordering(698) 00:09:21.048 fused_ordering(699) 00:09:21.048 fused_ordering(700) 00:09:21.048 fused_ordering(701) 00:09:21.048 fused_ordering(702) 00:09:21.048 fused_ordering(703) 00:09:21.048 fused_ordering(704) 00:09:21.048 fused_ordering(705) 00:09:21.048 fused_ordering(706) 00:09:21.048 fused_ordering(707) 00:09:21.048 fused_ordering(708) 00:09:21.048 fused_ordering(709) 00:09:21.048 fused_ordering(710) 00:09:21.048 fused_ordering(711) 00:09:21.048 fused_ordering(712) 00:09:21.048 fused_ordering(713) 00:09:21.048 fused_ordering(714) 00:09:21.048 fused_ordering(715) 00:09:21.048 fused_ordering(716) 00:09:21.048 fused_ordering(717) 00:09:21.048 fused_ordering(718) 00:09:21.048 fused_ordering(719) 00:09:21.048 fused_ordering(720) 00:09:21.048 fused_ordering(721) 00:09:21.048 fused_ordering(722) 00:09:21.048 fused_ordering(723) 00:09:21.048 fused_ordering(724) 00:09:21.048 fused_ordering(725) 00:09:21.048 fused_ordering(726) 00:09:21.048 fused_ordering(727) 00:09:21.048 fused_ordering(728) 00:09:21.048 fused_ordering(729) 00:09:21.048 fused_ordering(730) 00:09:21.048 fused_ordering(731) 00:09:21.048 fused_ordering(732) 00:09:21.048 fused_ordering(733) 00:09:21.048 fused_ordering(734) 00:09:21.048 fused_ordering(735) 00:09:21.048 fused_ordering(736) 00:09:21.048 fused_ordering(737) 00:09:21.048 fused_ordering(738) 00:09:21.048 fused_ordering(739) 00:09:21.048 fused_ordering(740) 00:09:21.048 fused_ordering(741) 00:09:21.048 fused_ordering(742) 00:09:21.048 fused_ordering(743) 00:09:21.048 fused_ordering(744) 00:09:21.048 fused_ordering(745) 00:09:21.048 fused_ordering(746) 00:09:21.048 fused_ordering(747) 00:09:21.048 fused_ordering(748) 00:09:21.048 fused_ordering(749) 00:09:21.048 fused_ordering(750) 00:09:21.048 fused_ordering(751) 00:09:21.048 fused_ordering(752) 00:09:21.048 fused_ordering(753) 00:09:21.048 fused_ordering(754) 00:09:21.048 fused_ordering(755) 00:09:21.048 fused_ordering(756) 00:09:21.048 fused_ordering(757) 00:09:21.048 fused_ordering(758) 00:09:21.048 fused_ordering(759) 00:09:21.048 fused_ordering(760) 00:09:21.048 fused_ordering(761) 00:09:21.048 fused_ordering(762) 00:09:21.048 fused_ordering(763) 00:09:21.048 fused_ordering(764) 00:09:21.048 fused_ordering(765) 00:09:21.048 fused_ordering(766) 00:09:21.048 fused_ordering(767) 00:09:21.048 fused_ordering(768) 00:09:21.048 fused_ordering(769) 00:09:21.048 fused_ordering(770) 00:09:21.048 fused_ordering(771) 00:09:21.048 fused_ordering(772) 00:09:21.048 fused_ordering(773) 00:09:21.048 fused_ordering(774) 00:09:21.048 fused_ordering(775) 00:09:21.048 fused_ordering(776) 00:09:21.048 fused_ordering(777) 00:09:21.048 fused_ordering(778) 00:09:21.048 fused_ordering(779) 00:09:21.048 fused_ordering(780) 00:09:21.048 fused_ordering(781) 00:09:21.048 fused_ordering(782) 00:09:21.048 fused_ordering(783) 00:09:21.048 fused_ordering(784) 00:09:21.048 fused_ordering(785) 00:09:21.048 fused_ordering(786) 00:09:21.048 fused_ordering(787) 00:09:21.048 fused_ordering(788) 00:09:21.048 fused_ordering(789) 00:09:21.048 fused_ordering(790) 00:09:21.048 fused_ordering(791) 00:09:21.048 fused_ordering(792) 00:09:21.048 fused_ordering(793) 00:09:21.048 fused_ordering(794) 00:09:21.048 fused_ordering(795) 00:09:21.048 fused_ordering(796) 00:09:21.048 fused_ordering(797) 00:09:21.048 fused_ordering(798) 00:09:21.048 fused_ordering(799) 00:09:21.048 fused_ordering(800) 00:09:21.048 fused_ordering(801) 00:09:21.048 fused_ordering(802) 00:09:21.048 fused_ordering(803) 00:09:21.048 fused_ordering(804) 00:09:21.048 fused_ordering(805) 00:09:21.048 fused_ordering(806) 00:09:21.048 fused_ordering(807) 00:09:21.048 fused_ordering(808) 00:09:21.048 fused_ordering(809) 00:09:21.048 fused_ordering(810) 00:09:21.048 fused_ordering(811) 00:09:21.048 fused_ordering(812) 00:09:21.048 fused_ordering(813) 00:09:21.048 fused_ordering(814) 00:09:21.048 fused_ordering(815) 00:09:21.048 fused_ordering(816) 00:09:21.048 fused_ordering(817) 00:09:21.048 fused_ordering(818) 00:09:21.048 fused_ordering(819) 00:09:21.048 fused_ordering(820) 00:09:21.611 fused_ordering(821) 00:09:21.611 fused_ordering(822) 00:09:21.611 fused_ordering(823) 00:09:21.611 fused_ordering(824) 00:09:21.611 fused_ordering(825) 00:09:21.611 fused_ordering(826) 00:09:21.611 fused_ordering(827) 00:09:21.611 fused_ordering(828) 00:09:21.611 fused_ordering(829) 00:09:21.611 fused_ordering(830) 00:09:21.611 fused_ordering(831) 00:09:21.611 fused_ordering(832) 00:09:21.611 fused_ordering(833) 00:09:21.611 fused_ordering(834) 00:09:21.611 fused_ordering(835) 00:09:21.611 fused_ordering(836) 00:09:21.611 fused_ordering(837) 00:09:21.611 fused_ordering(838) 00:09:21.611 fused_ordering(839) 00:09:21.611 fused_ordering(840) 00:09:21.611 fused_ordering(841) 00:09:21.611 fused_ordering(842) 00:09:21.611 fused_ordering(843) 00:09:21.611 fused_ordering(844) 00:09:21.611 fused_ordering(845) 00:09:21.611 fused_ordering(846) 00:09:21.611 fused_ordering(847) 00:09:21.611 fused_ordering(848) 00:09:21.611 fused_ordering(849) 00:09:21.611 fused_ordering(850) 00:09:21.611 fused_ordering(851) 00:09:21.611 fused_ordering(852) 00:09:21.611 fused_ordering(853) 00:09:21.611 fused_ordering(854) 00:09:21.611 fused_ordering(855) 00:09:21.611 fused_ordering(856) 00:09:21.611 fused_ordering(857) 00:09:21.611 fused_ordering(858) 00:09:21.611 fused_ordering(859) 00:09:21.611 fused_ordering(860) 00:09:21.611 fused_ordering(861) 00:09:21.611 fused_ordering(862) 00:09:21.611 fused_ordering(863) 00:09:21.611 fused_ordering(864) 00:09:21.611 fused_ordering(865) 00:09:21.611 fused_ordering(866) 00:09:21.611 fused_ordering(867) 00:09:21.611 fused_ordering(868) 00:09:21.611 fused_ordering(869) 00:09:21.611 fused_ordering(870) 00:09:21.611 fused_ordering(871) 00:09:21.611 fused_ordering(872) 00:09:21.611 fused_ordering(873) 00:09:21.611 fused_ordering(874) 00:09:21.611 fused_ordering(875) 00:09:21.611 fused_ordering(876) 00:09:21.611 fused_ordering(877) 00:09:21.611 fused_ordering(878) 00:09:21.611 fused_ordering(879) 00:09:21.611 fused_ordering(880) 00:09:21.611 fused_ordering(881) 00:09:21.611 fused_ordering(882) 00:09:21.611 fused_ordering(883) 00:09:21.611 fused_ordering(884) 00:09:21.611 fused_ordering(885) 00:09:21.611 fused_ordering(886) 00:09:21.611 fused_ordering(887) 00:09:21.611 fused_ordering(888) 00:09:21.611 fused_ordering(889) 00:09:21.611 fused_ordering(890) 00:09:21.611 fused_ordering(891) 00:09:21.611 fused_ordering(892) 00:09:21.611 fused_ordering(893) 00:09:21.611 fused_ordering(894) 00:09:21.611 fused_ordering(895) 00:09:21.611 fused_ordering(896) 00:09:21.611 fused_ordering(897) 00:09:21.611 fused_ordering(898) 00:09:21.611 fused_ordering(899) 00:09:21.611 fused_ordering(900) 00:09:21.611 fused_ordering(901) 00:09:21.611 fused_ordering(902) 00:09:21.611 fused_ordering(903) 00:09:21.611 fused_ordering(904) 00:09:21.611 fused_ordering(905) 00:09:21.611 fused_ordering(906) 00:09:21.611 fused_ordering(907) 00:09:21.611 fused_ordering(908) 00:09:21.611 fused_ordering(909) 00:09:21.611 fused_ordering(910) 00:09:21.611 fused_ordering(911) 00:09:21.611 fused_ordering(912) 00:09:21.611 fused_ordering(913) 00:09:21.611 fused_ordering(914) 00:09:21.611 fused_ordering(915) 00:09:21.611 fused_ordering(916) 00:09:21.611 fused_ordering(917) 00:09:21.611 fused_ordering(918) 00:09:21.611 fused_ordering(919) 00:09:21.611 fused_ordering(920) 00:09:21.611 fused_ordering(921) 00:09:21.611 fused_ordering(922) 00:09:21.611 fused_ordering(923) 00:09:21.611 fused_ordering(924) 00:09:21.611 fused_ordering(925) 00:09:21.611 fused_ordering(926) 00:09:21.611 fused_ordering(927) 00:09:21.611 fused_ordering(928) 00:09:21.611 fused_ordering(929) 00:09:21.611 fused_ordering(930) 00:09:21.611 fused_ordering(931) 00:09:21.611 fused_ordering(932) 00:09:21.611 fused_ordering(933) 00:09:21.611 fused_ordering(934) 00:09:21.611 fused_ordering(935) 00:09:21.611 fused_ordering(936) 00:09:21.611 fused_ordering(937) 00:09:21.611 fused_ordering(938) 00:09:21.611 fused_ordering(939) 00:09:21.611 fused_ordering(940) 00:09:21.611 fused_ordering(941) 00:09:21.611 fused_ordering(942) 00:09:21.611 fused_ordering(943) 00:09:21.611 fused_ordering(944) 00:09:21.611 fused_ordering(945) 00:09:21.611 fused_ordering(946) 00:09:21.611 fused_ordering(947) 00:09:21.611 fused_ordering(948) 00:09:21.611 fused_ordering(949) 00:09:21.611 fused_ordering(950) 00:09:21.611 fused_ordering(951) 00:09:21.611 fused_ordering(952) 00:09:21.611 fused_ordering(953) 00:09:21.611 fused_ordering(954) 00:09:21.611 fused_ordering(955) 00:09:21.611 fused_ordering(956) 00:09:21.611 fused_ordering(957) 00:09:21.611 fused_ordering(958) 00:09:21.611 fused_ordering(959) 00:09:21.611 fused_ordering(960) 00:09:21.611 fused_ordering(961) 00:09:21.611 fused_ordering(962) 00:09:21.611 fused_ordering(963) 00:09:21.611 fused_ordering(964) 00:09:21.611 fused_ordering(965) 00:09:21.611 fused_ordering(966) 00:09:21.611 fused_ordering(967) 00:09:21.611 fused_ordering(968) 00:09:21.611 fused_ordering(969) 00:09:21.611 fused_ordering(970) 00:09:21.611 fused_ordering(971) 00:09:21.611 fused_ordering(972) 00:09:21.611 fused_ordering(973) 00:09:21.611 fused_ordering(974) 00:09:21.611 fused_ordering(975) 00:09:21.611 fused_ordering(976) 00:09:21.611 fused_ordering(977) 00:09:21.611 fused_ordering(978) 00:09:21.611 fused_ordering(979) 00:09:21.611 fused_ordering(980) 00:09:21.611 fused_ordering(981) 00:09:21.611 fused_ordering(982) 00:09:21.611 fused_ordering(983) 00:09:21.611 fused_ordering(984) 00:09:21.611 fused_ordering(985) 00:09:21.611 fused_ordering(986) 00:09:21.611 fused_ordering(987) 00:09:21.611 fused_ordering(988) 00:09:21.611 fused_ordering(989) 00:09:21.611 fused_ordering(990) 00:09:21.611 fused_ordering(991) 00:09:21.611 fused_ordering(992) 00:09:21.611 fused_ordering(993) 00:09:21.611 fused_ordering(994) 00:09:21.611 fused_ordering(995) 00:09:21.611 fused_ordering(996) 00:09:21.611 fused_ordering(997) 00:09:21.611 fused_ordering(998) 00:09:21.611 fused_ordering(999) 00:09:21.611 fused_ordering(1000) 00:09:21.611 fused_ordering(1001) 00:09:21.611 fused_ordering(1002) 00:09:21.611 fused_ordering(1003) 00:09:21.611 fused_ordering(1004) 00:09:21.611 fused_ordering(1005) 00:09:21.611 fused_ordering(1006) 00:09:21.611 fused_ordering(1007) 00:09:21.611 fused_ordering(1008) 00:09:21.611 fused_ordering(1009) 00:09:21.611 fused_ordering(1010) 00:09:21.611 fused_ordering(1011) 00:09:21.611 fused_ordering(1012) 00:09:21.611 fused_ordering(1013) 00:09:21.611 fused_ordering(1014) 00:09:21.611 fused_ordering(1015) 00:09:21.611 fused_ordering(1016) 00:09:21.611 fused_ordering(1017) 00:09:21.611 fused_ordering(1018) 00:09:21.611 fused_ordering(1019) 00:09:21.611 fused_ordering(1020) 00:09:21.611 fused_ordering(1021) 00:09:21.611 fused_ordering(1022) 00:09:21.611 fused_ordering(1023) 00:09:21.611 03:20:46 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:09:21.611 03:20:46 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:09:21.611 03:20:46 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:21.611 03:20:46 -- nvmf/common.sh@117 -- # sync 00:09:21.611 03:20:46 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:09:21.611 03:20:46 -- nvmf/common.sh@120 -- # set +e 00:09:21.611 03:20:46 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:21.611 03:20:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:09:21.611 rmmod nvme_tcp 00:09:21.869 rmmod nvme_fabrics 00:09:21.869 rmmod nvme_keyring 00:09:21.869 03:20:46 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:21.869 03:20:46 -- nvmf/common.sh@124 -- # set -e 00:09:21.869 03:20:46 -- nvmf/common.sh@125 -- # return 0 00:09:21.869 03:20:46 -- nvmf/common.sh@478 -- # '[' -n 1389562 ']' 00:09:21.869 03:20:46 -- nvmf/common.sh@479 -- # killprocess 1389562 00:09:21.869 03:20:46 -- common/autotest_common.sh@936 -- # '[' -z 1389562 ']' 00:09:21.869 03:20:46 -- common/autotest_common.sh@940 -- # kill -0 1389562 00:09:21.869 03:20:46 -- common/autotest_common.sh@941 -- # uname 00:09:21.869 03:20:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:21.869 03:20:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1389562 00:09:21.869 03:20:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:09:21.869 03:20:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:09:21.869 03:20:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1389562' 00:09:21.869 killing process with pid 1389562 00:09:21.869 03:20:46 -- common/autotest_common.sh@955 -- # kill 1389562 00:09:21.869 03:20:46 -- common/autotest_common.sh@960 -- # wait 1389562 00:09:22.126 03:20:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:22.126 03:20:46 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:09:22.126 03:20:46 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:09:22.126 03:20:46 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:22.126 03:20:46 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:09:22.126 03:20:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:22.126 03:20:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:22.126 03:20:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:24.025 03:20:48 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:09:24.025 00:09:24.025 real 0m7.768s 00:09:24.025 user 0m5.537s 00:09:24.025 sys 0m3.344s 00:09:24.025 03:20:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:24.025 03:20:48 -- common/autotest_common.sh@10 -- # set +x 00:09:24.025 ************************************ 00:09:24.025 END TEST nvmf_fused_ordering 00:09:24.025 ************************************ 00:09:24.025 03:20:48 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:09:24.025 03:20:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:24.025 03:20:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:24.025 03:20:48 -- common/autotest_common.sh@10 -- # set +x 00:09:24.284 ************************************ 00:09:24.284 START TEST nvmf_delete_subsystem 00:09:24.284 ************************************ 00:09:24.284 03:20:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:09:24.284 * Looking for test storage... 00:09:24.284 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:24.284 03:20:49 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:24.284 03:20:49 -- nvmf/common.sh@7 -- # uname -s 00:09:24.284 03:20:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:24.284 03:20:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:24.284 03:20:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:24.284 03:20:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:24.284 03:20:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:24.284 03:20:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:24.284 03:20:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:24.284 03:20:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:24.284 03:20:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:24.284 03:20:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:24.284 03:20:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:09:24.284 03:20:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:09:24.284 03:20:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:24.284 03:20:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:24.284 03:20:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:24.284 03:20:49 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:24.284 03:20:49 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:24.284 03:20:49 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:24.284 03:20:49 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:24.284 03:20:49 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:24.284 03:20:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:24.284 03:20:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:24.284 03:20:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:24.284 03:20:49 -- paths/export.sh@5 -- # export PATH 00:09:24.284 03:20:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:24.284 03:20:49 -- nvmf/common.sh@47 -- # : 0 00:09:24.284 03:20:49 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:24.284 03:20:49 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:24.284 03:20:49 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:24.284 03:20:49 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:24.284 03:20:49 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:24.284 03:20:49 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:24.284 03:20:49 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:24.284 03:20:49 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:24.284 03:20:49 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:09:24.284 03:20:49 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:09:24.284 03:20:49 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:24.284 03:20:49 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:24.284 03:20:49 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:24.284 03:20:49 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:24.284 03:20:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:24.284 03:20:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:24.284 03:20:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:24.284 03:20:49 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:24.284 03:20:49 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:24.284 03:20:49 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:24.284 03:20:49 -- common/autotest_common.sh@10 -- # set +x 00:09:26.813 03:20:51 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:26.813 03:20:51 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:26.813 03:20:51 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:26.813 03:20:51 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:26.813 03:20:51 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:26.813 03:20:51 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:26.813 03:20:51 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:26.813 03:20:51 -- nvmf/common.sh@295 -- # net_devs=() 00:09:26.813 03:20:51 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:26.813 03:20:51 -- nvmf/common.sh@296 -- # e810=() 00:09:26.813 03:20:51 -- nvmf/common.sh@296 -- # local -ga e810 00:09:26.813 03:20:51 -- nvmf/common.sh@297 -- # x722=() 00:09:26.813 03:20:51 -- nvmf/common.sh@297 -- # local -ga x722 00:09:26.813 03:20:51 -- nvmf/common.sh@298 -- # mlx=() 00:09:26.813 03:20:51 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:26.813 03:20:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:26.813 03:20:51 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:26.813 03:20:51 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:09:26.813 03:20:51 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:26.813 03:20:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:26.813 03:20:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:09:26.813 Found 0000:09:00.0 (0x8086 - 0x159b) 00:09:26.813 03:20:51 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:26.813 03:20:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:09:26.813 Found 0000:09:00.1 (0x8086 - 0x159b) 00:09:26.813 03:20:51 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:26.813 03:20:51 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:26.813 03:20:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:26.813 03:20:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:26.813 03:20:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:26.813 03:20:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:09:26.813 Found net devices under 0000:09:00.0: cvl_0_0 00:09:26.813 03:20:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:26.813 03:20:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:26.813 03:20:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:26.813 03:20:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:26.813 03:20:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:26.813 03:20:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:09:26.813 Found net devices under 0000:09:00.1: cvl_0_1 00:09:26.813 03:20:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:26.813 03:20:51 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:26.813 03:20:51 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:26.813 03:20:51 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:09:26.813 03:20:51 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:26.813 03:20:51 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:26.813 03:20:51 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:26.813 03:20:51 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:09:26.813 03:20:51 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:26.813 03:20:51 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:26.813 03:20:51 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:09:26.813 03:20:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:26.813 03:20:51 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:26.813 03:20:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:09:26.813 03:20:51 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:09:26.813 03:20:51 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:09:26.813 03:20:51 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:26.813 03:20:51 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:26.813 03:20:51 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:26.813 03:20:51 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:09:26.813 03:20:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:26.813 03:20:51 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:26.813 03:20:51 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:26.813 03:20:51 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:09:26.813 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:26.813 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:09:26.813 00:09:26.813 --- 10.0.0.2 ping statistics --- 00:09:26.813 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:26.813 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:09:26.813 03:20:51 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:26.813 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:26.813 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:09:26.813 00:09:26.813 --- 10.0.0.1 ping statistics --- 00:09:26.813 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:26.813 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:09:26.813 03:20:51 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:26.813 03:20:51 -- nvmf/common.sh@411 -- # return 0 00:09:26.813 03:20:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:26.813 03:20:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:26.813 03:20:51 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:09:26.813 03:20:51 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:26.813 03:20:51 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:09:26.813 03:20:51 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:09:26.813 03:20:51 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:09:26.813 03:20:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:26.813 03:20:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:26.813 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:09:26.813 03:20:51 -- nvmf/common.sh@470 -- # nvmfpid=1391916 00:09:26.813 03:20:51 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:09:26.813 03:20:51 -- nvmf/common.sh@471 -- # waitforlisten 1391916 00:09:26.813 03:20:51 -- common/autotest_common.sh@817 -- # '[' -z 1391916 ']' 00:09:26.813 03:20:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:26.813 03:20:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:26.813 03:20:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:26.813 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:26.813 03:20:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:26.813 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:09:26.813 [2024-04-27 03:20:51.380311] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:09:26.813 [2024-04-27 03:20:51.380399] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:26.813 EAL: No free 2048 kB hugepages reported on node 1 00:09:26.813 [2024-04-27 03:20:51.450565] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:09:26.813 [2024-04-27 03:20:51.555500] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:26.813 [2024-04-27 03:20:51.555570] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:26.813 [2024-04-27 03:20:51.555584] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:26.813 [2024-04-27 03:20:51.555595] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:26.813 [2024-04-27 03:20:51.555605] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:26.813 [2024-04-27 03:20:51.555670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:26.813 [2024-04-27 03:20:51.555675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:26.813 03:20:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:26.813 03:20:51 -- common/autotest_common.sh@850 -- # return 0 00:09:26.813 03:20:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:26.813 03:20:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:26.813 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:09:26.813 03:20:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:26.814 03:20:51 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:26.814 03:20:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:26.814 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:09:26.814 [2024-04-27 03:20:51.704895] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:26.814 03:20:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:26.814 03:20:51 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:09:26.814 03:20:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:26.814 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:09:26.814 03:20:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:26.814 03:20:51 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:26.814 03:20:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:26.814 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:09:26.814 [2024-04-27 03:20:51.721197] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:26.814 03:20:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:26.814 03:20:51 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:09:26.814 03:20:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:26.814 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:09:26.814 NULL1 00:09:26.814 03:20:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:26.814 03:20:51 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:09:26.814 03:20:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:26.814 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:09:26.814 Delay0 00:09:26.814 03:20:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:26.814 03:20:51 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:26.814 03:20:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:26.814 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:09:26.814 03:20:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:26.814 03:20:51 -- target/delete_subsystem.sh@28 -- # perf_pid=1391991 00:09:26.814 03:20:51 -- target/delete_subsystem.sh@30 -- # sleep 2 00:09:26.814 03:20:51 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:09:26.814 EAL: No free 2048 kB hugepages reported on node 1 00:09:27.073 [2024-04-27 03:20:51.795860] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:09:28.969 03:20:53 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:28.969 03:20:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:28.969 03:20:53 -- common/autotest_common.sh@10 -- # set +x 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 starting I/O failed: -6 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 starting I/O failed: -6 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 starting I/O failed: -6 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 starting I/O failed: -6 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 starting I/O failed: -6 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 starting I/O failed: -6 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 starting I/O failed: -6 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 starting I/O failed: -6 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 starting I/O failed: -6 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 starting I/O failed: -6 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 [2024-04-27 03:20:53.876482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ba0 is same with the state(5) to be set 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.969 Write completed with error (sct=0, sc=8) 00:09:28.969 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 starting I/O failed: -6 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 starting I/O failed: -6 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 starting I/O failed: -6 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 starting I/O failed: -6 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 starting I/O failed: -6 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 starting I/O failed: -6 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 starting I/O failed: -6 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 starting I/O failed: -6 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 starting I/O failed: -6 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 starting I/O failed: -6 00:09:28.970 [2024-04-27 03:20:53.878520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f7808000c00 is same with the state(5) to be set 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Write completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:28.970 Read completed with error (sct=0, sc=8) 00:09:29.902 [2024-04-27 03:20:54.854537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f56180 is same with the state(5) to be set 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Write completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 Read completed with error (sct=0, sc=8) 00:09:29.902 [2024-04-27 03:20:54.878085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f780800c510 is same with the state(5) to be set 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 [2024-04-27 03:20:54.880782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 [2024-04-27 03:20:54.880997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37d30 is same with the state(5) to be set 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Write completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 Read completed with error (sct=0, sc=8) 00:09:30.161 [2024-04-27 03:20:54.882576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f780800bf90 is same with the state(5) to be set 00:09:30.161 03:20:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:30.161 [2024-04-27 03:20:54.883098] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f56180 (9): Bad file descriptor 00:09:30.161 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:09:30.161 03:20:54 -- target/delete_subsystem.sh@34 -- # delay=0 00:09:30.161 03:20:54 -- target/delete_subsystem.sh@35 -- # kill -0 1391991 00:09:30.161 03:20:54 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:09:30.161 Initializing NVMe Controllers 00:09:30.161 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:09:30.161 Controller IO queue size 128, less than required. 00:09:30.162 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:09:30.162 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:09:30.162 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:09:30.162 Initialization complete. Launching workers. 00:09:30.162 ======================================================== 00:09:30.162 Latency(us) 00:09:30.162 Device Information : IOPS MiB/s Average min max 00:09:30.162 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 162.86 0.08 913552.39 427.09 1046380.73 00:09:30.162 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 154.42 0.08 934540.01 361.39 1046312.94 00:09:30.162 ======================================================== 00:09:30.162 Total : 317.27 0.15 923767.02 361.39 1046380.73 00:09:30.162 00:09:30.421 03:20:55 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:09:30.421 03:20:55 -- target/delete_subsystem.sh@35 -- # kill -0 1391991 00:09:30.421 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1391991) - No such process 00:09:30.421 03:20:55 -- target/delete_subsystem.sh@45 -- # NOT wait 1391991 00:09:30.421 03:20:55 -- common/autotest_common.sh@638 -- # local es=0 00:09:30.421 03:20:55 -- common/autotest_common.sh@640 -- # valid_exec_arg wait 1391991 00:09:30.421 03:20:55 -- common/autotest_common.sh@626 -- # local arg=wait 00:09:30.421 03:20:55 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:30.421 03:20:55 -- common/autotest_common.sh@630 -- # type -t wait 00:09:30.421 03:20:55 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:30.421 03:20:55 -- common/autotest_common.sh@641 -- # wait 1391991 00:09:30.421 03:20:55 -- common/autotest_common.sh@641 -- # es=1 00:09:30.421 03:20:55 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:09:30.421 03:20:55 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:09:30.421 03:20:55 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:09:30.421 03:20:55 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:09:30.421 03:20:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:30.421 03:20:55 -- common/autotest_common.sh@10 -- # set +x 00:09:30.682 03:20:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:30.682 03:20:55 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:30.682 03:20:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:30.682 03:20:55 -- common/autotest_common.sh@10 -- # set +x 00:09:30.682 [2024-04-27 03:20:55.404334] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:30.682 03:20:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:30.682 03:20:55 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:30.682 03:20:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:30.682 03:20:55 -- common/autotest_common.sh@10 -- # set +x 00:09:30.682 03:20:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:30.682 03:20:55 -- target/delete_subsystem.sh@54 -- # perf_pid=1392400 00:09:30.682 03:20:55 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:09:30.682 03:20:55 -- target/delete_subsystem.sh@56 -- # delay=0 00:09:30.682 03:20:55 -- target/delete_subsystem.sh@57 -- # kill -0 1392400 00:09:30.682 03:20:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:09:30.682 EAL: No free 2048 kB hugepages reported on node 1 00:09:30.682 [2024-04-27 03:20:55.467623] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:09:31.247 03:20:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:09:31.247 03:20:55 -- target/delete_subsystem.sh@57 -- # kill -0 1392400 00:09:31.247 03:20:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:09:31.505 03:20:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:09:31.505 03:20:56 -- target/delete_subsystem.sh@57 -- # kill -0 1392400 00:09:31.505 03:20:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:09:32.070 03:20:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:09:32.070 03:20:56 -- target/delete_subsystem.sh@57 -- # kill -0 1392400 00:09:32.070 03:20:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:09:32.636 03:20:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:09:32.636 03:20:57 -- target/delete_subsystem.sh@57 -- # kill -0 1392400 00:09:32.636 03:20:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:09:33.201 03:20:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:09:33.201 03:20:57 -- target/delete_subsystem.sh@57 -- # kill -0 1392400 00:09:33.201 03:20:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:09:33.459 03:20:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:09:33.459 03:20:58 -- target/delete_subsystem.sh@57 -- # kill -0 1392400 00:09:33.459 03:20:58 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:09:33.717 Initializing NVMe Controllers 00:09:33.717 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:09:33.717 Controller IO queue size 128, less than required. 00:09:33.717 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:09:33.717 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:09:33.717 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:09:33.717 Initialization complete. Launching workers. 00:09:33.717 ======================================================== 00:09:33.717 Latency(us) 00:09:33.717 Device Information : IOPS MiB/s Average min max 00:09:33.717 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004555.37 1000195.74 1013618.50 00:09:33.717 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004575.10 1000328.10 1042050.88 00:09:33.717 ======================================================== 00:09:33.717 Total : 256.00 0.12 1004565.23 1000195.74 1042050.88 00:09:33.717 00:09:33.974 03:20:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:09:33.974 03:20:58 -- target/delete_subsystem.sh@57 -- # kill -0 1392400 00:09:33.974 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1392400) - No such process 00:09:33.974 03:20:58 -- target/delete_subsystem.sh@67 -- # wait 1392400 00:09:33.974 03:20:58 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:09:33.974 03:20:58 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:09:33.974 03:20:58 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:33.974 03:20:58 -- nvmf/common.sh@117 -- # sync 00:09:33.974 03:20:58 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:09:33.974 03:20:58 -- nvmf/common.sh@120 -- # set +e 00:09:33.974 03:20:58 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:33.974 03:20:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:09:33.974 rmmod nvme_tcp 00:09:34.233 rmmod nvme_fabrics 00:09:34.233 rmmod nvme_keyring 00:09:34.233 03:20:58 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:34.233 03:20:58 -- nvmf/common.sh@124 -- # set -e 00:09:34.233 03:20:58 -- nvmf/common.sh@125 -- # return 0 00:09:34.233 03:20:58 -- nvmf/common.sh@478 -- # '[' -n 1391916 ']' 00:09:34.233 03:20:58 -- nvmf/common.sh@479 -- # killprocess 1391916 00:09:34.233 03:20:58 -- common/autotest_common.sh@936 -- # '[' -z 1391916 ']' 00:09:34.233 03:20:58 -- common/autotest_common.sh@940 -- # kill -0 1391916 00:09:34.233 03:20:58 -- common/autotest_common.sh@941 -- # uname 00:09:34.233 03:20:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:34.233 03:20:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1391916 00:09:34.233 03:20:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:34.233 03:20:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:34.233 03:20:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1391916' 00:09:34.233 killing process with pid 1391916 00:09:34.233 03:20:59 -- common/autotest_common.sh@955 -- # kill 1391916 00:09:34.233 03:20:59 -- common/autotest_common.sh@960 -- # wait 1391916 00:09:34.492 03:20:59 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:34.492 03:20:59 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:09:34.492 03:20:59 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:09:34.492 03:20:59 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:34.492 03:20:59 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:09:34.492 03:20:59 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:34.492 03:20:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:34.492 03:20:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:36.394 03:21:01 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:09:36.394 00:09:36.394 real 0m12.253s 00:09:36.394 user 0m27.474s 00:09:36.394 sys 0m3.091s 00:09:36.394 03:21:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:36.394 03:21:01 -- common/autotest_common.sh@10 -- # set +x 00:09:36.394 ************************************ 00:09:36.394 END TEST nvmf_delete_subsystem 00:09:36.394 ************************************ 00:09:36.394 03:21:01 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=tcp 00:09:36.394 03:21:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:36.394 03:21:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:36.394 03:21:01 -- common/autotest_common.sh@10 -- # set +x 00:09:36.653 ************************************ 00:09:36.653 START TEST nvmf_ns_masking 00:09:36.653 ************************************ 00:09:36.653 03:21:01 -- common/autotest_common.sh@1111 -- # test/nvmf/target/ns_masking.sh --transport=tcp 00:09:36.653 * Looking for test storage... 00:09:36.653 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:36.653 03:21:01 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:36.653 03:21:01 -- nvmf/common.sh@7 -- # uname -s 00:09:36.653 03:21:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:36.653 03:21:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:36.653 03:21:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:36.653 03:21:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:36.653 03:21:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:36.653 03:21:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:36.653 03:21:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:36.653 03:21:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:36.653 03:21:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:36.653 03:21:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:36.653 03:21:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:09:36.653 03:21:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:09:36.653 03:21:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:36.653 03:21:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:36.653 03:21:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:36.653 03:21:01 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:36.653 03:21:01 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:36.653 03:21:01 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:36.653 03:21:01 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:36.653 03:21:01 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:36.653 03:21:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:36.653 03:21:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:36.653 03:21:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:36.653 03:21:01 -- paths/export.sh@5 -- # export PATH 00:09:36.653 03:21:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:36.653 03:21:01 -- nvmf/common.sh@47 -- # : 0 00:09:36.653 03:21:01 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:36.653 03:21:01 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:36.653 03:21:01 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:36.653 03:21:01 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:36.653 03:21:01 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:36.653 03:21:01 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:36.653 03:21:01 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:36.653 03:21:01 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:36.653 03:21:01 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:36.653 03:21:01 -- target/ns_masking.sh@11 -- # loops=5 00:09:36.653 03:21:01 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:09:36.653 03:21:01 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:09:36.653 03:21:01 -- target/ns_masking.sh@15 -- # uuidgen 00:09:36.653 03:21:01 -- target/ns_masking.sh@15 -- # HOSTID=c613db23-46e4-4713-8185-658b0b68933f 00:09:36.653 03:21:01 -- target/ns_masking.sh@44 -- # nvmftestinit 00:09:36.653 03:21:01 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:09:36.653 03:21:01 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:36.653 03:21:01 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:36.653 03:21:01 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:36.653 03:21:01 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:36.653 03:21:01 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:36.653 03:21:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:36.653 03:21:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:36.653 03:21:01 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:36.653 03:21:01 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:36.654 03:21:01 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:36.654 03:21:01 -- common/autotest_common.sh@10 -- # set +x 00:09:39.183 03:21:03 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:39.183 03:21:03 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:39.183 03:21:03 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:39.183 03:21:03 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:39.183 03:21:03 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:39.183 03:21:03 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:39.183 03:21:03 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:39.183 03:21:03 -- nvmf/common.sh@295 -- # net_devs=() 00:09:39.183 03:21:03 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:39.183 03:21:03 -- nvmf/common.sh@296 -- # e810=() 00:09:39.183 03:21:03 -- nvmf/common.sh@296 -- # local -ga e810 00:09:39.183 03:21:03 -- nvmf/common.sh@297 -- # x722=() 00:09:39.183 03:21:03 -- nvmf/common.sh@297 -- # local -ga x722 00:09:39.183 03:21:03 -- nvmf/common.sh@298 -- # mlx=() 00:09:39.183 03:21:03 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:39.183 03:21:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:39.183 03:21:03 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:39.183 03:21:03 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:09:39.183 03:21:03 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:39.183 03:21:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:39.183 03:21:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:09:39.183 Found 0000:09:00.0 (0x8086 - 0x159b) 00:09:39.183 03:21:03 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:39.183 03:21:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:09:39.183 Found 0000:09:00.1 (0x8086 - 0x159b) 00:09:39.183 03:21:03 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:39.183 03:21:03 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:39.183 03:21:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:39.183 03:21:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:39.183 03:21:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:39.183 03:21:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:09:39.183 Found net devices under 0000:09:00.0: cvl_0_0 00:09:39.183 03:21:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:39.183 03:21:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:39.183 03:21:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:39.183 03:21:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:39.183 03:21:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:39.183 03:21:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:09:39.183 Found net devices under 0000:09:00.1: cvl_0_1 00:09:39.183 03:21:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:39.183 03:21:03 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:39.183 03:21:03 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:39.183 03:21:03 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:09:39.183 03:21:03 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:39.183 03:21:03 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:39.183 03:21:03 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:39.183 03:21:03 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:09:39.183 03:21:03 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:39.183 03:21:03 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:39.183 03:21:03 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:09:39.183 03:21:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:39.183 03:21:03 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:39.183 03:21:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:09:39.183 03:21:03 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:09:39.183 03:21:03 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:09:39.183 03:21:03 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:39.183 03:21:03 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:39.183 03:21:03 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:39.183 03:21:03 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:09:39.183 03:21:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:39.183 03:21:03 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:39.183 03:21:03 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:39.183 03:21:03 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:09:39.183 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:39.183 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:09:39.183 00:09:39.183 --- 10.0.0.2 ping statistics --- 00:09:39.183 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:39.183 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:09:39.183 03:21:03 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:39.183 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:39.183 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:09:39.183 00:09:39.183 --- 10.0.0.1 ping statistics --- 00:09:39.183 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:39.183 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:09:39.183 03:21:03 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:39.183 03:21:03 -- nvmf/common.sh@411 -- # return 0 00:09:39.183 03:21:03 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:39.183 03:21:03 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:39.183 03:21:03 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:09:39.183 03:21:03 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:39.183 03:21:03 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:09:39.183 03:21:03 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:09:39.183 03:21:03 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:09:39.183 03:21:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:39.184 03:21:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:39.184 03:21:03 -- common/autotest_common.sh@10 -- # set +x 00:09:39.184 03:21:03 -- nvmf/common.sh@470 -- # nvmfpid=1394886 00:09:39.184 03:21:03 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:39.184 03:21:03 -- nvmf/common.sh@471 -- # waitforlisten 1394886 00:09:39.184 03:21:03 -- common/autotest_common.sh@817 -- # '[' -z 1394886 ']' 00:09:39.184 03:21:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:39.184 03:21:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:39.184 03:21:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:39.184 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:39.184 03:21:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:39.184 03:21:03 -- common/autotest_common.sh@10 -- # set +x 00:09:39.184 [2024-04-27 03:21:03.805586] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:09:39.184 [2024-04-27 03:21:03.805683] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:39.184 EAL: No free 2048 kB hugepages reported on node 1 00:09:39.184 [2024-04-27 03:21:03.871559] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:39.184 [2024-04-27 03:21:03.976644] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:39.184 [2024-04-27 03:21:03.976699] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:39.184 [2024-04-27 03:21:03.976722] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:39.184 [2024-04-27 03:21:03.976734] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:39.184 [2024-04-27 03:21:03.976745] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:39.184 [2024-04-27 03:21:03.976881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:39.184 [2024-04-27 03:21:03.976948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:39.184 [2024-04-27 03:21:03.977015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:39.184 [2024-04-27 03:21:03.977012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:39.184 03:21:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:39.184 03:21:04 -- common/autotest_common.sh@850 -- # return 0 00:09:39.184 03:21:04 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:39.184 03:21:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:39.184 03:21:04 -- common/autotest_common.sh@10 -- # set +x 00:09:39.184 03:21:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:39.184 03:21:04 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:09:39.459 [2024-04-27 03:21:04.398843] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:39.459 03:21:04 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:09:39.459 03:21:04 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:09:39.459 03:21:04 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:09:39.716 Malloc1 00:09:39.974 03:21:04 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:09:40.232 Malloc2 00:09:40.232 03:21:05 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:40.489 03:21:05 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:09:40.746 03:21:05 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:41.004 [2024-04-27 03:21:05.746202] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:41.004 03:21:05 -- target/ns_masking.sh@61 -- # connect 00:09:41.004 03:21:05 -- target/ns_masking.sh@18 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I c613db23-46e4-4713-8185-658b0b68933f -a 10.0.0.2 -s 4420 -i 4 00:09:41.004 03:21:05 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:09:41.004 03:21:05 -- common/autotest_common.sh@1184 -- # local i=0 00:09:41.004 03:21:05 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:41.004 03:21:05 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:09:41.004 03:21:05 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:43.531 03:21:07 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:43.531 03:21:07 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:43.531 03:21:07 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:43.531 03:21:07 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:09:43.531 03:21:07 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:43.531 03:21:07 -- common/autotest_common.sh@1194 -- # return 0 00:09:43.531 03:21:07 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:09:43.531 03:21:07 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:09:43.531 03:21:08 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:09:43.531 03:21:08 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:09:43.531 03:21:08 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:09:43.531 03:21:08 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:43.531 03:21:08 -- target/ns_masking.sh@39 -- # grep 0x1 00:09:43.531 [ 0]:0x1 00:09:43.531 03:21:08 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:09:43.531 03:21:08 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:43.531 03:21:08 -- target/ns_masking.sh@40 -- # nguid=e1946ebf455d49d9a95dc0e5c7b9cdf1 00:09:43.531 03:21:08 -- target/ns_masking.sh@41 -- # [[ e1946ebf455d49d9a95dc0e5c7b9cdf1 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:43.531 03:21:08 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:09:43.531 03:21:08 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:09:43.531 03:21:08 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:43.531 03:21:08 -- target/ns_masking.sh@39 -- # grep 0x1 00:09:43.531 [ 0]:0x1 00:09:43.531 03:21:08 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:09:43.531 03:21:08 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:43.531 03:21:08 -- target/ns_masking.sh@40 -- # nguid=e1946ebf455d49d9a95dc0e5c7b9cdf1 00:09:43.531 03:21:08 -- target/ns_masking.sh@41 -- # [[ e1946ebf455d49d9a95dc0e5c7b9cdf1 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:43.531 03:21:08 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:09:43.531 03:21:08 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:43.531 03:21:08 -- target/ns_masking.sh@39 -- # grep 0x2 00:09:43.531 [ 1]:0x2 00:09:43.531 03:21:08 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:09:43.531 03:21:08 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:43.531 03:21:08 -- target/ns_masking.sh@40 -- # nguid=9c34ce5577a74be29fe0244d79c48085 00:09:43.531 03:21:08 -- target/ns_masking.sh@41 -- # [[ 9c34ce5577a74be29fe0244d79c48085 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:43.531 03:21:08 -- target/ns_masking.sh@69 -- # disconnect 00:09:43.531 03:21:08 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:43.789 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.789 03:21:08 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:44.047 03:21:08 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:09:44.305 03:21:09 -- target/ns_masking.sh@77 -- # connect 1 00:09:44.305 03:21:09 -- target/ns_masking.sh@18 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I c613db23-46e4-4713-8185-658b0b68933f -a 10.0.0.2 -s 4420 -i 4 00:09:44.305 03:21:09 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:09:44.305 03:21:09 -- common/autotest_common.sh@1184 -- # local i=0 00:09:44.305 03:21:09 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:44.305 03:21:09 -- common/autotest_common.sh@1186 -- # [[ -n 1 ]] 00:09:44.305 03:21:09 -- common/autotest_common.sh@1187 -- # nvme_device_counter=1 00:09:44.305 03:21:09 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:46.204 03:21:11 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:46.204 03:21:11 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:46.204 03:21:11 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:46.204 03:21:11 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:09:46.204 03:21:11 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:46.204 03:21:11 -- common/autotest_common.sh@1194 -- # return 0 00:09:46.204 03:21:11 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:09:46.204 03:21:11 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:09:46.462 03:21:11 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:09:46.462 03:21:11 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:09:46.462 03:21:11 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:09:46.462 03:21:11 -- common/autotest_common.sh@638 -- # local es=0 00:09:46.462 03:21:11 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:09:46.462 03:21:11 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:09:46.462 03:21:11 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:46.462 03:21:11 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:09:46.462 03:21:11 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:46.462 03:21:11 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:09:46.462 03:21:11 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:46.462 03:21:11 -- target/ns_masking.sh@39 -- # grep 0x1 00:09:46.462 03:21:11 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:09:46.462 03:21:11 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:46.462 03:21:11 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:09:46.462 03:21:11 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:46.462 03:21:11 -- common/autotest_common.sh@641 -- # es=1 00:09:46.462 03:21:11 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:09:46.462 03:21:11 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:09:46.462 03:21:11 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:09:46.462 03:21:11 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:09:46.462 03:21:11 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:46.462 03:21:11 -- target/ns_masking.sh@39 -- # grep 0x2 00:09:46.462 [ 0]:0x2 00:09:46.462 03:21:11 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:09:46.462 03:21:11 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:46.462 03:21:11 -- target/ns_masking.sh@40 -- # nguid=9c34ce5577a74be29fe0244d79c48085 00:09:46.462 03:21:11 -- target/ns_masking.sh@41 -- # [[ 9c34ce5577a74be29fe0244d79c48085 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:46.462 03:21:11 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:09:46.720 03:21:11 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:09:46.720 03:21:11 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:46.720 03:21:11 -- target/ns_masking.sh@39 -- # grep 0x1 00:09:46.720 [ 0]:0x1 00:09:46.720 03:21:11 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:09:46.720 03:21:11 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:46.720 03:21:11 -- target/ns_masking.sh@40 -- # nguid=e1946ebf455d49d9a95dc0e5c7b9cdf1 00:09:46.720 03:21:11 -- target/ns_masking.sh@41 -- # [[ e1946ebf455d49d9a95dc0e5c7b9cdf1 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:46.720 03:21:11 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:09:46.720 03:21:11 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:46.720 03:21:11 -- target/ns_masking.sh@39 -- # grep 0x2 00:09:46.720 [ 1]:0x2 00:09:46.720 03:21:11 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:09:46.720 03:21:11 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:46.720 03:21:11 -- target/ns_masking.sh@40 -- # nguid=9c34ce5577a74be29fe0244d79c48085 00:09:46.720 03:21:11 -- target/ns_masking.sh@41 -- # [[ 9c34ce5577a74be29fe0244d79c48085 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:46.720 03:21:11 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:09:46.978 03:21:11 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:09:46.978 03:21:11 -- common/autotest_common.sh@638 -- # local es=0 00:09:46.978 03:21:11 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:09:46.978 03:21:11 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:09:46.978 03:21:11 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:46.978 03:21:11 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:09:46.978 03:21:11 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:46.978 03:21:11 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:09:46.978 03:21:11 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:46.978 03:21:11 -- target/ns_masking.sh@39 -- # grep 0x1 00:09:46.978 03:21:11 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:46.978 03:21:11 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:09:46.978 03:21:11 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:09:46.978 03:21:11 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:46.978 03:21:11 -- common/autotest_common.sh@641 -- # es=1 00:09:46.979 03:21:11 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:09:46.979 03:21:11 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:09:46.979 03:21:11 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:09:46.979 03:21:11 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:09:46.979 03:21:11 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:46.979 03:21:11 -- target/ns_masking.sh@39 -- # grep 0x2 00:09:46.979 [ 0]:0x2 00:09:46.979 03:21:11 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:09:47.236 03:21:11 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:47.236 03:21:11 -- target/ns_masking.sh@40 -- # nguid=9c34ce5577a74be29fe0244d79c48085 00:09:47.236 03:21:11 -- target/ns_masking.sh@41 -- # [[ 9c34ce5577a74be29fe0244d79c48085 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:47.236 03:21:11 -- target/ns_masking.sh@91 -- # disconnect 00:09:47.236 03:21:11 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:47.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.236 03:21:12 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:09:47.494 03:21:12 -- target/ns_masking.sh@95 -- # connect 2 00:09:47.494 03:21:12 -- target/ns_masking.sh@18 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I c613db23-46e4-4713-8185-658b0b68933f -a 10.0.0.2 -s 4420 -i 4 00:09:47.494 03:21:12 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:09:47.494 03:21:12 -- common/autotest_common.sh@1184 -- # local i=0 00:09:47.494 03:21:12 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:47.494 03:21:12 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:09:47.494 03:21:12 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:09:47.494 03:21:12 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:50.072 03:21:14 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:50.072 03:21:14 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:50.072 03:21:14 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:50.072 03:21:14 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:09:50.072 03:21:14 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:50.072 03:21:14 -- common/autotest_common.sh@1194 -- # return 0 00:09:50.072 03:21:14 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:09:50.072 03:21:14 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:09:50.072 03:21:14 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:09:50.072 03:21:14 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:09:50.072 03:21:14 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:09:50.072 03:21:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:50.072 03:21:14 -- target/ns_masking.sh@39 -- # grep 0x1 00:09:50.072 [ 0]:0x1 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # nguid=e1946ebf455d49d9a95dc0e5c7b9cdf1 00:09:50.073 03:21:14 -- target/ns_masking.sh@41 -- # [[ e1946ebf455d49d9a95dc0e5c7b9cdf1 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:50.073 03:21:14 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:09:50.073 03:21:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:50.073 03:21:14 -- target/ns_masking.sh@39 -- # grep 0x2 00:09:50.073 [ 1]:0x2 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # nguid=9c34ce5577a74be29fe0244d79c48085 00:09:50.073 03:21:14 -- target/ns_masking.sh@41 -- # [[ 9c34ce5577a74be29fe0244d79c48085 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:50.073 03:21:14 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:09:50.073 03:21:14 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:09:50.073 03:21:14 -- common/autotest_common.sh@638 -- # local es=0 00:09:50.073 03:21:14 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:09:50.073 03:21:14 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:09:50.073 03:21:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:50.073 03:21:14 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:09:50.073 03:21:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:50.073 03:21:14 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:09:50.073 03:21:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:50.073 03:21:14 -- target/ns_masking.sh@39 -- # grep 0x1 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:09:50.073 03:21:14 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:50.073 03:21:14 -- common/autotest_common.sh@641 -- # es=1 00:09:50.073 03:21:14 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:09:50.073 03:21:14 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:09:50.073 03:21:14 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:09:50.073 03:21:14 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:09:50.073 03:21:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:50.073 03:21:14 -- target/ns_masking.sh@39 -- # grep 0x2 00:09:50.073 [ 0]:0x2 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:50.073 03:21:14 -- target/ns_masking.sh@40 -- # nguid=9c34ce5577a74be29fe0244d79c48085 00:09:50.073 03:21:14 -- target/ns_masking.sh@41 -- # [[ 9c34ce5577a74be29fe0244d79c48085 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:50.073 03:21:14 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:09:50.073 03:21:14 -- common/autotest_common.sh@638 -- # local es=0 00:09:50.073 03:21:14 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:09:50.073 03:21:14 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:50.073 03:21:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:50.073 03:21:14 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:50.073 03:21:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:50.073 03:21:14 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:50.073 03:21:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:50.073 03:21:14 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:50.073 03:21:14 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:09:50.073 03:21:14 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:09:50.331 [2024-04-27 03:21:15.156385] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:09:50.331 request: 00:09:50.332 { 00:09:50.332 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:09:50.332 "nsid": 2, 00:09:50.332 "host": "nqn.2016-06.io.spdk:host1", 00:09:50.332 "method": "nvmf_ns_remove_host", 00:09:50.332 "req_id": 1 00:09:50.332 } 00:09:50.332 Got JSON-RPC error response 00:09:50.332 response: 00:09:50.332 { 00:09:50.332 "code": -32602, 00:09:50.332 "message": "Invalid parameters" 00:09:50.332 } 00:09:50.332 03:21:15 -- common/autotest_common.sh@641 -- # es=1 00:09:50.332 03:21:15 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:09:50.332 03:21:15 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:09:50.332 03:21:15 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:09:50.332 03:21:15 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:09:50.332 03:21:15 -- common/autotest_common.sh@638 -- # local es=0 00:09:50.332 03:21:15 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:09:50.332 03:21:15 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:09:50.332 03:21:15 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:50.332 03:21:15 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:09:50.332 03:21:15 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:09:50.332 03:21:15 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:09:50.332 03:21:15 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:50.332 03:21:15 -- target/ns_masking.sh@39 -- # grep 0x1 00:09:50.332 03:21:15 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:09:50.332 03:21:15 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:50.332 03:21:15 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:09:50.332 03:21:15 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:50.332 03:21:15 -- common/autotest_common.sh@641 -- # es=1 00:09:50.332 03:21:15 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:09:50.332 03:21:15 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:09:50.332 03:21:15 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:09:50.332 03:21:15 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:09:50.332 03:21:15 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:09:50.332 03:21:15 -- target/ns_masking.sh@39 -- # grep 0x2 00:09:50.332 [ 0]:0x2 00:09:50.332 03:21:15 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:09:50.332 03:21:15 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:09:50.589 03:21:15 -- target/ns_masking.sh@40 -- # nguid=9c34ce5577a74be29fe0244d79c48085 00:09:50.589 03:21:15 -- target/ns_masking.sh@41 -- # [[ 9c34ce5577a74be29fe0244d79c48085 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:09:50.589 03:21:15 -- target/ns_masking.sh@108 -- # disconnect 00:09:50.589 03:21:15 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:50.589 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.589 03:21:15 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:50.847 03:21:15 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:09:50.847 03:21:15 -- target/ns_masking.sh@114 -- # nvmftestfini 00:09:50.847 03:21:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:50.847 03:21:15 -- nvmf/common.sh@117 -- # sync 00:09:50.847 03:21:15 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:09:50.847 03:21:15 -- nvmf/common.sh@120 -- # set +e 00:09:50.847 03:21:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:50.847 03:21:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:09:50.847 rmmod nvme_tcp 00:09:50.847 rmmod nvme_fabrics 00:09:50.847 rmmod nvme_keyring 00:09:50.847 03:21:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:50.847 03:21:15 -- nvmf/common.sh@124 -- # set -e 00:09:50.847 03:21:15 -- nvmf/common.sh@125 -- # return 0 00:09:50.847 03:21:15 -- nvmf/common.sh@478 -- # '[' -n 1394886 ']' 00:09:50.847 03:21:15 -- nvmf/common.sh@479 -- # killprocess 1394886 00:09:50.847 03:21:15 -- common/autotest_common.sh@936 -- # '[' -z 1394886 ']' 00:09:50.847 03:21:15 -- common/autotest_common.sh@940 -- # kill -0 1394886 00:09:50.847 03:21:15 -- common/autotest_common.sh@941 -- # uname 00:09:50.847 03:21:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:50.847 03:21:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1394886 00:09:50.847 03:21:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:50.847 03:21:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:50.847 03:21:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1394886' 00:09:50.847 killing process with pid 1394886 00:09:50.847 03:21:15 -- common/autotest_common.sh@955 -- # kill 1394886 00:09:50.847 03:21:15 -- common/autotest_common.sh@960 -- # wait 1394886 00:09:51.413 03:21:16 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:51.413 03:21:16 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:09:51.413 03:21:16 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:09:51.413 03:21:16 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:51.413 03:21:16 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:09:51.413 03:21:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:51.413 03:21:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:51.413 03:21:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:53.318 03:21:18 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:09:53.318 00:09:53.318 real 0m16.685s 00:09:53.318 user 0m51.721s 00:09:53.318 sys 0m3.845s 00:09:53.318 03:21:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:53.318 03:21:18 -- common/autotest_common.sh@10 -- # set +x 00:09:53.318 ************************************ 00:09:53.318 END TEST nvmf_ns_masking 00:09:53.318 ************************************ 00:09:53.318 03:21:18 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:09:53.318 03:21:18 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:09:53.318 03:21:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:53.318 03:21:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:53.318 03:21:18 -- common/autotest_common.sh@10 -- # set +x 00:09:53.318 ************************************ 00:09:53.318 START TEST nvmf_nvme_cli 00:09:53.318 ************************************ 00:09:53.318 03:21:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:09:53.577 * Looking for test storage... 00:09:53.577 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:53.577 03:21:18 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:53.577 03:21:18 -- nvmf/common.sh@7 -- # uname -s 00:09:53.577 03:21:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:53.577 03:21:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:53.577 03:21:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:53.577 03:21:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:53.577 03:21:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:53.577 03:21:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:53.577 03:21:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:53.577 03:21:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:53.577 03:21:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:53.577 03:21:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:53.577 03:21:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:09:53.577 03:21:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:09:53.577 03:21:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:53.577 03:21:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:53.577 03:21:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:53.577 03:21:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:53.577 03:21:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:53.577 03:21:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:53.577 03:21:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:53.577 03:21:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:53.577 03:21:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:53.577 03:21:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:53.577 03:21:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:53.577 03:21:18 -- paths/export.sh@5 -- # export PATH 00:09:53.577 03:21:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:53.577 03:21:18 -- nvmf/common.sh@47 -- # : 0 00:09:53.577 03:21:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:53.577 03:21:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:53.577 03:21:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:53.577 03:21:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:53.577 03:21:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:53.577 03:21:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:53.577 03:21:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:53.577 03:21:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:53.577 03:21:18 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:53.578 03:21:18 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:53.578 03:21:18 -- target/nvme_cli.sh@14 -- # devs=() 00:09:53.578 03:21:18 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:09:53.578 03:21:18 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:09:53.578 03:21:18 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:53.578 03:21:18 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:53.578 03:21:18 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:53.578 03:21:18 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:53.578 03:21:18 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:53.578 03:21:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:53.578 03:21:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:53.578 03:21:18 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:53.578 03:21:18 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:53.578 03:21:18 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:53.578 03:21:18 -- common/autotest_common.sh@10 -- # set +x 00:09:55.478 03:21:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:55.478 03:21:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:55.478 03:21:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:55.478 03:21:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:55.478 03:21:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:55.478 03:21:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:55.478 03:21:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:55.478 03:21:20 -- nvmf/common.sh@295 -- # net_devs=() 00:09:55.478 03:21:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:55.478 03:21:20 -- nvmf/common.sh@296 -- # e810=() 00:09:55.478 03:21:20 -- nvmf/common.sh@296 -- # local -ga e810 00:09:55.478 03:21:20 -- nvmf/common.sh@297 -- # x722=() 00:09:55.478 03:21:20 -- nvmf/common.sh@297 -- # local -ga x722 00:09:55.478 03:21:20 -- nvmf/common.sh@298 -- # mlx=() 00:09:55.478 03:21:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:55.478 03:21:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:55.479 03:21:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:55.479 03:21:20 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:09:55.479 03:21:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:55.479 03:21:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:55.479 03:21:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:09:55.479 Found 0000:09:00.0 (0x8086 - 0x159b) 00:09:55.479 03:21:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:55.479 03:21:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:09:55.479 Found 0000:09:00.1 (0x8086 - 0x159b) 00:09:55.479 03:21:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:55.479 03:21:20 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:55.479 03:21:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:55.479 03:21:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:55.479 03:21:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:55.479 03:21:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:09:55.479 Found net devices under 0000:09:00.0: cvl_0_0 00:09:55.479 03:21:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:55.479 03:21:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:55.479 03:21:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:55.479 03:21:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:55.479 03:21:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:55.479 03:21:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:09:55.479 Found net devices under 0000:09:00.1: cvl_0_1 00:09:55.479 03:21:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:55.479 03:21:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:55.479 03:21:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:55.479 03:21:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:09:55.479 03:21:20 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:55.479 03:21:20 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:55.479 03:21:20 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:55.479 03:21:20 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:09:55.479 03:21:20 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:55.479 03:21:20 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:55.479 03:21:20 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:09:55.479 03:21:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:55.479 03:21:20 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:55.479 03:21:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:09:55.479 03:21:20 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:09:55.479 03:21:20 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:09:55.479 03:21:20 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:55.479 03:21:20 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:55.479 03:21:20 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:55.479 03:21:20 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:09:55.479 03:21:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:55.479 03:21:20 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:55.479 03:21:20 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:55.479 03:21:20 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:09:55.479 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:55.479 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:09:55.479 00:09:55.479 --- 10.0.0.2 ping statistics --- 00:09:55.479 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:55.479 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:09:55.479 03:21:20 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:55.479 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:55.479 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:09:55.479 00:09:55.479 --- 10.0.0.1 ping statistics --- 00:09:55.479 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:55.479 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:09:55.479 03:21:20 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:55.479 03:21:20 -- nvmf/common.sh@411 -- # return 0 00:09:55.479 03:21:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:55.479 03:21:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:55.479 03:21:20 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:09:55.479 03:21:20 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:55.479 03:21:20 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:09:55.479 03:21:20 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:09:55.737 03:21:20 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:09:55.737 03:21:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:55.737 03:21:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:55.737 03:21:20 -- common/autotest_common.sh@10 -- # set +x 00:09:55.737 03:21:20 -- nvmf/common.sh@470 -- # nvmfpid=1398934 00:09:55.737 03:21:20 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:55.737 03:21:20 -- nvmf/common.sh@471 -- # waitforlisten 1398934 00:09:55.737 03:21:20 -- common/autotest_common.sh@817 -- # '[' -z 1398934 ']' 00:09:55.737 03:21:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:55.737 03:21:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:55.737 03:21:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:55.737 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:55.737 03:21:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:55.737 03:21:20 -- common/autotest_common.sh@10 -- # set +x 00:09:55.737 [2024-04-27 03:21:20.534300] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:09:55.737 [2024-04-27 03:21:20.534393] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:55.737 EAL: No free 2048 kB hugepages reported on node 1 00:09:55.737 [2024-04-27 03:21:20.605682] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:55.995 [2024-04-27 03:21:20.727372] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:55.995 [2024-04-27 03:21:20.727429] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:55.995 [2024-04-27 03:21:20.727445] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:55.995 [2024-04-27 03:21:20.727459] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:55.995 [2024-04-27 03:21:20.727471] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:55.995 [2024-04-27 03:21:20.727536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:55.995 [2024-04-27 03:21:20.727603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:55.995 [2024-04-27 03:21:20.727658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:55.995 [2024-04-27 03:21:20.727661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:56.561 03:21:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:56.561 03:21:21 -- common/autotest_common.sh@850 -- # return 0 00:09:56.561 03:21:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:56.561 03:21:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:56.561 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:09:56.819 03:21:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:56.819 03:21:21 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:56.819 03:21:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.819 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:09:56.819 [2024-04-27 03:21:21.563409] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:56.819 03:21:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.819 03:21:21 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:09:56.819 03:21:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.819 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:09:56.819 Malloc0 00:09:56.819 03:21:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.819 03:21:21 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:09:56.819 03:21:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.819 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:09:56.819 Malloc1 00:09:56.819 03:21:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.819 03:21:21 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:09:56.819 03:21:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.819 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:09:56.819 03:21:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.819 03:21:21 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:56.819 03:21:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.819 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:09:56.819 03:21:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.819 03:21:21 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:56.819 03:21:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.819 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:09:56.819 03:21:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.819 03:21:21 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:56.819 03:21:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.819 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:09:56.819 [2024-04-27 03:21:21.649816] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:56.819 03:21:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.819 03:21:21 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:09:56.819 03:21:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.819 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:09:56.819 03:21:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.819 03:21:21 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -a 10.0.0.2 -s 4420 00:09:56.819 00:09:56.819 Discovery Log Number of Records 2, Generation counter 2 00:09:56.819 =====Discovery Log Entry 0====== 00:09:56.819 trtype: tcp 00:09:56.819 adrfam: ipv4 00:09:56.819 subtype: current discovery subsystem 00:09:56.819 treq: not required 00:09:56.819 portid: 0 00:09:56.819 trsvcid: 4420 00:09:56.819 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:56.819 traddr: 10.0.0.2 00:09:56.819 eflags: explicit discovery connections, duplicate discovery information 00:09:56.819 sectype: none 00:09:56.819 =====Discovery Log Entry 1====== 00:09:56.819 trtype: tcp 00:09:56.819 adrfam: ipv4 00:09:56.819 subtype: nvme subsystem 00:09:56.819 treq: not required 00:09:56.819 portid: 0 00:09:56.819 trsvcid: 4420 00:09:56.819 subnqn: nqn.2016-06.io.spdk:cnode1 00:09:56.819 traddr: 10.0.0.2 00:09:56.819 eflags: none 00:09:56.819 sectype: none 00:09:56.819 03:21:21 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:09:56.819 03:21:21 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:09:56.819 03:21:21 -- nvmf/common.sh@511 -- # local dev _ 00:09:56.819 03:21:21 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:56.819 03:21:21 -- nvmf/common.sh@510 -- # nvme list 00:09:56.819 03:21:21 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:09:56.819 03:21:21 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:56.819 03:21:21 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:09:56.819 03:21:21 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:56.819 03:21:21 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:09:56.819 03:21:21 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:09:57.753 03:21:22 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:09:57.753 03:21:22 -- common/autotest_common.sh@1184 -- # local i=0 00:09:57.753 03:21:22 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:57.753 03:21:22 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:09:57.753 03:21:22 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:09:57.753 03:21:22 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:59.649 03:21:24 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:59.649 03:21:24 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:59.649 03:21:24 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:59.649 03:21:24 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:09:59.649 03:21:24 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:59.649 03:21:24 -- common/autotest_common.sh@1194 -- # return 0 00:09:59.649 03:21:24 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:09:59.649 03:21:24 -- nvmf/common.sh@511 -- # local dev _ 00:09:59.649 03:21:24 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:59.649 03:21:24 -- nvmf/common.sh@510 -- # nvme list 00:09:59.649 03:21:24 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:09:59.649 03:21:24 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:59.649 03:21:24 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:09:59.649 03:21:24 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:59.649 03:21:24 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:09:59.649 03:21:24 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:09:59.649 03:21:24 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:59.649 03:21:24 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:09:59.649 03:21:24 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:09:59.649 03:21:24 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:59.649 03:21:24 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:09:59.649 /dev/nvme0n1 ]] 00:09:59.649 03:21:24 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:09:59.649 03:21:24 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:09:59.649 03:21:24 -- nvmf/common.sh@511 -- # local dev _ 00:09:59.649 03:21:24 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:59.649 03:21:24 -- nvmf/common.sh@510 -- # nvme list 00:09:59.649 03:21:24 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:09:59.649 03:21:24 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:59.649 03:21:24 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:09:59.649 03:21:24 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:59.649 03:21:24 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:09:59.649 03:21:24 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:09:59.649 03:21:24 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:59.649 03:21:24 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:09:59.649 03:21:24 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:09:59.649 03:21:24 -- nvmf/common.sh@513 -- # read -r dev _ 00:09:59.649 03:21:24 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:09:59.649 03:21:24 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:59.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.649 03:21:24 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:59.649 03:21:24 -- common/autotest_common.sh@1205 -- # local i=0 00:09:59.649 03:21:24 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:09:59.649 03:21:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:59.649 03:21:24 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:09:59.649 03:21:24 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:59.649 03:21:24 -- common/autotest_common.sh@1217 -- # return 0 00:09:59.649 03:21:24 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:09:59.649 03:21:24 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:59.649 03:21:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:59.649 03:21:24 -- common/autotest_common.sh@10 -- # set +x 00:09:59.649 03:21:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:59.649 03:21:24 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:09:59.649 03:21:24 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:09:59.649 03:21:24 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:59.649 03:21:24 -- nvmf/common.sh@117 -- # sync 00:09:59.649 03:21:24 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:09:59.649 03:21:24 -- nvmf/common.sh@120 -- # set +e 00:09:59.649 03:21:24 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:59.649 03:21:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:09:59.908 rmmod nvme_tcp 00:09:59.908 rmmod nvme_fabrics 00:09:59.908 rmmod nvme_keyring 00:09:59.908 03:21:24 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:59.908 03:21:24 -- nvmf/common.sh@124 -- # set -e 00:09:59.908 03:21:24 -- nvmf/common.sh@125 -- # return 0 00:09:59.908 03:21:24 -- nvmf/common.sh@478 -- # '[' -n 1398934 ']' 00:09:59.908 03:21:24 -- nvmf/common.sh@479 -- # killprocess 1398934 00:09:59.908 03:21:24 -- common/autotest_common.sh@936 -- # '[' -z 1398934 ']' 00:09:59.908 03:21:24 -- common/autotest_common.sh@940 -- # kill -0 1398934 00:09:59.908 03:21:24 -- common/autotest_common.sh@941 -- # uname 00:09:59.908 03:21:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:59.908 03:21:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1398934 00:09:59.908 03:21:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:59.908 03:21:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:59.908 03:21:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1398934' 00:09:59.908 killing process with pid 1398934 00:09:59.908 03:21:24 -- common/autotest_common.sh@955 -- # kill 1398934 00:09:59.908 03:21:24 -- common/autotest_common.sh@960 -- # wait 1398934 00:10:00.166 03:21:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:00.166 03:21:25 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:10:00.166 03:21:25 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:10:00.166 03:21:25 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:10:00.166 03:21:25 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:10:00.166 03:21:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:00.166 03:21:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:00.166 03:21:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:02.704 03:21:27 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:10:02.704 00:10:02.704 real 0m8.812s 00:10:02.704 user 0m17.767s 00:10:02.704 sys 0m2.249s 00:10:02.704 03:21:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:02.704 03:21:27 -- common/autotest_common.sh@10 -- # set +x 00:10:02.704 ************************************ 00:10:02.704 END TEST nvmf_nvme_cli 00:10:02.704 ************************************ 00:10:02.704 03:21:27 -- nvmf/nvmf.sh@40 -- # [[ 1 -eq 1 ]] 00:10:02.704 03:21:27 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:10:02.704 03:21:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:02.704 03:21:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:02.704 03:21:27 -- common/autotest_common.sh@10 -- # set +x 00:10:02.704 ************************************ 00:10:02.704 START TEST nvmf_vfio_user 00:10:02.704 ************************************ 00:10:02.704 03:21:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:10:02.704 * Looking for test storage... 00:10:02.704 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:10:02.704 03:21:27 -- nvmf/common.sh@7 -- # uname -s 00:10:02.704 03:21:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:02.704 03:21:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:02.704 03:21:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:02.704 03:21:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:02.704 03:21:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:02.704 03:21:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:02.704 03:21:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:02.704 03:21:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:02.704 03:21:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:02.704 03:21:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:02.704 03:21:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:10:02.704 03:21:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:10:02.704 03:21:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:02.704 03:21:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:02.704 03:21:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:02.704 03:21:27 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:02.704 03:21:27 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:10:02.704 03:21:27 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:02.704 03:21:27 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:02.704 03:21:27 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:02.704 03:21:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:02.704 03:21:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:02.704 03:21:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:02.704 03:21:27 -- paths/export.sh@5 -- # export PATH 00:10:02.704 03:21:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:02.704 03:21:27 -- nvmf/common.sh@47 -- # : 0 00:10:02.704 03:21:27 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:02.704 03:21:27 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:02.704 03:21:27 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:02.704 03:21:27 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:02.704 03:21:27 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:02.704 03:21:27 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:02.704 03:21:27 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:02.704 03:21:27 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1399869 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1399869' 00:10:02.704 Process pid: 1399869 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1399869 00:10:02.704 03:21:27 -- common/autotest_common.sh@817 -- # '[' -z 1399869 ']' 00:10:02.704 03:21:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:02.704 03:21:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:02.704 03:21:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:02.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:02.704 03:21:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:02.704 03:21:27 -- common/autotest_common.sh@10 -- # set +x 00:10:02.704 [2024-04-27 03:21:27.343010] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:10:02.704 [2024-04-27 03:21:27.343087] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:02.704 EAL: No free 2048 kB hugepages reported on node 1 00:10:02.704 [2024-04-27 03:21:27.401558] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:02.704 [2024-04-27 03:21:27.506174] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:02.704 [2024-04-27 03:21:27.506234] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:02.704 [2024-04-27 03:21:27.506254] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:02.704 [2024-04-27 03:21:27.506274] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:02.704 [2024-04-27 03:21:27.506285] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:02.704 [2024-04-27 03:21:27.506340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:02.704 [2024-04-27 03:21:27.506394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:02.704 [2024-04-27 03:21:27.506460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:02.704 [2024-04-27 03:21:27.506463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:02.704 03:21:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:02.704 03:21:27 -- common/autotest_common.sh@850 -- # return 0 00:10:02.704 03:21:27 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:10:04.074 03:21:28 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:10:04.074 03:21:28 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:10:04.074 03:21:28 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:10:04.074 03:21:28 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:10:04.074 03:21:28 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:10:04.074 03:21:28 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:10:04.332 Malloc1 00:10:04.332 03:21:29 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:10:04.589 03:21:29 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:10:04.846 03:21:29 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:10:05.103 03:21:29 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:10:05.103 03:21:29 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:10:05.103 03:21:29 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:10:05.360 Malloc2 00:10:05.360 03:21:30 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:10:05.618 03:21:30 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:10:05.876 03:21:30 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:10:06.137 03:21:30 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:10:06.137 03:21:30 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:10:06.137 03:21:30 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:10:06.137 03:21:30 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:10:06.137 03:21:30 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:10:06.137 03:21:30 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:10:06.137 [2024-04-27 03:21:30.908685] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:10:06.137 [2024-04-27 03:21:30.908728] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1400409 ] 00:10:06.137 EAL: No free 2048 kB hugepages reported on node 1 00:10:06.137 [2024-04-27 03:21:30.943515] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:10:06.137 [2024-04-27 03:21:30.949732] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:10:06.137 [2024-04-27 03:21:30.949761] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fb658f72000 00:10:06.137 [2024-04-27 03:21:30.950722] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:10:06.137 [2024-04-27 03:21:30.951715] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:10:06.137 [2024-04-27 03:21:30.952721] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:10:06.137 [2024-04-27 03:21:30.953732] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:10:06.137 [2024-04-27 03:21:30.954737] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:10:06.137 [2024-04-27 03:21:30.955737] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:10:06.137 [2024-04-27 03:21:30.956743] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:10:06.137 [2024-04-27 03:21:30.957747] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:10:06.137 [2024-04-27 03:21:30.958763] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:10:06.137 [2024-04-27 03:21:30.958786] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fb658f67000 00:10:06.137 [2024-04-27 03:21:30.959904] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:10:06.137 [2024-04-27 03:21:30.973839] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:10:06.137 [2024-04-27 03:21:30.973876] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:10:06.137 [2024-04-27 03:21:30.982897] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:10:06.137 [2024-04-27 03:21:30.982951] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:10:06.137 [2024-04-27 03:21:30.983039] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:10:06.137 [2024-04-27 03:21:30.983067] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:10:06.137 [2024-04-27 03:21:30.983077] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:10:06.137 [2024-04-27 03:21:30.983883] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:10:06.137 [2024-04-27 03:21:30.983902] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:10:06.137 [2024-04-27 03:21:30.983914] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:10:06.137 [2024-04-27 03:21:30.984881] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:10:06.137 [2024-04-27 03:21:30.984898] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:10:06.137 [2024-04-27 03:21:30.984911] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:10:06.137 [2024-04-27 03:21:30.985889] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:10:06.137 [2024-04-27 03:21:30.985908] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:10:06.137 [2024-04-27 03:21:30.986895] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:10:06.137 [2024-04-27 03:21:30.986915] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:10:06.137 [2024-04-27 03:21:30.986925] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:10:06.137 [2024-04-27 03:21:30.986936] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:10:06.137 [2024-04-27 03:21:30.987045] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:10:06.137 [2024-04-27 03:21:30.987053] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:10:06.137 [2024-04-27 03:21:30.987061] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:10:06.137 [2024-04-27 03:21:30.987907] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:10:06.137 [2024-04-27 03:21:30.988908] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:10:06.137 [2024-04-27 03:21:30.989915] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:10:06.137 [2024-04-27 03:21:30.990910] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:10:06.137 [2024-04-27 03:21:30.991004] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:10:06.137 [2024-04-27 03:21:30.991928] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:10:06.137 [2024-04-27 03:21:30.991945] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:10:06.137 [2024-04-27 03:21:30.991954] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.991977] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:10:06.137 [2024-04-27 03:21:30.991990] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992014] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:10:06.137 [2024-04-27 03:21:30.992024] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:10:06.137 [2024-04-27 03:21:30.992042] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992112] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:10:06.137 [2024-04-27 03:21:30.992120] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:10:06.137 [2024-04-27 03:21:30.992133] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:10:06.137 [2024-04-27 03:21:30.992141] nvme_ctrlr.c:2002:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:10:06.137 [2024-04-27 03:21:30.992149] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:10:06.137 [2024-04-27 03:21:30.992156] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:10:06.137 [2024-04-27 03:21:30.992164] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992175] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992189] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992225] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:10:06.137 [2024-04-27 03:21:30.992239] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:10:06.137 [2024-04-27 03:21:30.992272] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:10:06.137 [2024-04-27 03:21:30.992294] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:10:06.137 [2024-04-27 03:21:30.992303] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992318] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992333] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992355] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:10:06.137 [2024-04-27 03:21:30.992363] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992378] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992389] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992402] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992464] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992479] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992495] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:10:06.137 [2024-04-27 03:21:30.992505] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:10:06.137 [2024-04-27 03:21:30.992514] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992546] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:10:06.137 [2024-04-27 03:21:30.992580] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992595] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992607] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:10:06.137 [2024-04-27 03:21:30.992615] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:10:06.137 [2024-04-27 03:21:30.992625] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992667] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992681] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992692] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:10:06.137 [2024-04-27 03:21:30.992700] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:10:06.137 [2024-04-27 03:21:30.992709] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992738] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992749] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992763] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992773] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992781] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992789] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:10:06.137 [2024-04-27 03:21:30.992796] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:10:06.137 [2024-04-27 03:21:30.992804] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:10:06.137 [2024-04-27 03:21:30.992829] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992869] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992895] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992922] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.992933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.992949] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:10:06.137 [2024-04-27 03:21:30.992958] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:10:06.137 [2024-04-27 03:21:30.992964] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:10:06.137 [2024-04-27 03:21:30.992970] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:10:06.137 [2024-04-27 03:21:30.992979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:10:06.137 [2024-04-27 03:21:30.992990] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:10:06.137 [2024-04-27 03:21:30.992998] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:10:06.137 [2024-04-27 03:21:30.993007] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.993018] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:10:06.137 [2024-04-27 03:21:30.993026] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:10:06.137 [2024-04-27 03:21:30.993034] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.993045] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:10:06.137 [2024-04-27 03:21:30.993053] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:10:06.137 [2024-04-27 03:21:30.993062] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:10:06.137 [2024-04-27 03:21:30.993073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.993093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.993109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:10:06.137 [2024-04-27 03:21:30.993121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:10:06.137 ===================================================== 00:10:06.137 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:10:06.137 ===================================================== 00:10:06.137 Controller Capabilities/Features 00:10:06.137 ================================ 00:10:06.137 Vendor ID: 4e58 00:10:06.137 Subsystem Vendor ID: 4e58 00:10:06.137 Serial Number: SPDK1 00:10:06.137 Model Number: SPDK bdev Controller 00:10:06.137 Firmware Version: 24.05 00:10:06.137 Recommended Arb Burst: 6 00:10:06.137 IEEE OUI Identifier: 8d 6b 50 00:10:06.137 Multi-path I/O 00:10:06.137 May have multiple subsystem ports: Yes 00:10:06.137 May have multiple controllers: Yes 00:10:06.137 Associated with SR-IOV VF: No 00:10:06.137 Max Data Transfer Size: 131072 00:10:06.137 Max Number of Namespaces: 32 00:10:06.137 Max Number of I/O Queues: 127 00:10:06.137 NVMe Specification Version (VS): 1.3 00:10:06.137 NVMe Specification Version (Identify): 1.3 00:10:06.137 Maximum Queue Entries: 256 00:10:06.137 Contiguous Queues Required: Yes 00:10:06.137 Arbitration Mechanisms Supported 00:10:06.137 Weighted Round Robin: Not Supported 00:10:06.137 Vendor Specific: Not Supported 00:10:06.137 Reset Timeout: 15000 ms 00:10:06.137 Doorbell Stride: 4 bytes 00:10:06.137 NVM Subsystem Reset: Not Supported 00:10:06.137 Command Sets Supported 00:10:06.137 NVM Command Set: Supported 00:10:06.137 Boot Partition: Not Supported 00:10:06.137 Memory Page Size Minimum: 4096 bytes 00:10:06.137 Memory Page Size Maximum: 4096 bytes 00:10:06.137 Persistent Memory Region: Not Supported 00:10:06.138 Optional Asynchronous Events Supported 00:10:06.138 Namespace Attribute Notices: Supported 00:10:06.138 Firmware Activation Notices: Not Supported 00:10:06.138 ANA Change Notices: Not Supported 00:10:06.138 PLE Aggregate Log Change Notices: Not Supported 00:10:06.138 LBA Status Info Alert Notices: Not Supported 00:10:06.138 EGE Aggregate Log Change Notices: Not Supported 00:10:06.138 Normal NVM Subsystem Shutdown event: Not Supported 00:10:06.138 Zone Descriptor Change Notices: Not Supported 00:10:06.138 Discovery Log Change Notices: Not Supported 00:10:06.138 Controller Attributes 00:10:06.138 128-bit Host Identifier: Supported 00:10:06.138 Non-Operational Permissive Mode: Not Supported 00:10:06.138 NVM Sets: Not Supported 00:10:06.138 Read Recovery Levels: Not Supported 00:10:06.138 Endurance Groups: Not Supported 00:10:06.138 Predictable Latency Mode: Not Supported 00:10:06.138 Traffic Based Keep ALive: Not Supported 00:10:06.138 Namespace Granularity: Not Supported 00:10:06.138 SQ Associations: Not Supported 00:10:06.138 UUID List: Not Supported 00:10:06.138 Multi-Domain Subsystem: Not Supported 00:10:06.138 Fixed Capacity Management: Not Supported 00:10:06.138 Variable Capacity Management: Not Supported 00:10:06.138 Delete Endurance Group: Not Supported 00:10:06.138 Delete NVM Set: Not Supported 00:10:06.138 Extended LBA Formats Supported: Not Supported 00:10:06.138 Flexible Data Placement Supported: Not Supported 00:10:06.138 00:10:06.138 Controller Memory Buffer Support 00:10:06.138 ================================ 00:10:06.138 Supported: No 00:10:06.138 00:10:06.138 Persistent Memory Region Support 00:10:06.138 ================================ 00:10:06.138 Supported: No 00:10:06.138 00:10:06.138 Admin Command Set Attributes 00:10:06.138 ============================ 00:10:06.138 Security Send/Receive: Not Supported 00:10:06.138 Format NVM: Not Supported 00:10:06.138 Firmware Activate/Download: Not Supported 00:10:06.138 Namespace Management: Not Supported 00:10:06.138 Device Self-Test: Not Supported 00:10:06.138 Directives: Not Supported 00:10:06.138 NVMe-MI: Not Supported 00:10:06.138 Virtualization Management: Not Supported 00:10:06.138 Doorbell Buffer Config: Not Supported 00:10:06.138 Get LBA Status Capability: Not Supported 00:10:06.138 Command & Feature Lockdown Capability: Not Supported 00:10:06.138 Abort Command Limit: 4 00:10:06.138 Async Event Request Limit: 4 00:10:06.138 Number of Firmware Slots: N/A 00:10:06.138 Firmware Slot 1 Read-Only: N/A 00:10:06.138 Firmware Activation Without Reset: N/A 00:10:06.138 Multiple Update Detection Support: N/A 00:10:06.138 Firmware Update Granularity: No Information Provided 00:10:06.138 Per-Namespace SMART Log: No 00:10:06.138 Asymmetric Namespace Access Log Page: Not Supported 00:10:06.138 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:10:06.138 Command Effects Log Page: Supported 00:10:06.138 Get Log Page Extended Data: Supported 00:10:06.138 Telemetry Log Pages: Not Supported 00:10:06.138 Persistent Event Log Pages: Not Supported 00:10:06.138 Supported Log Pages Log Page: May Support 00:10:06.138 Commands Supported & Effects Log Page: Not Supported 00:10:06.138 Feature Identifiers & Effects Log Page:May Support 00:10:06.138 NVMe-MI Commands & Effects Log Page: May Support 00:10:06.138 Data Area 4 for Telemetry Log: Not Supported 00:10:06.138 Error Log Page Entries Supported: 128 00:10:06.138 Keep Alive: Supported 00:10:06.138 Keep Alive Granularity: 10000 ms 00:10:06.138 00:10:06.138 NVM Command Set Attributes 00:10:06.138 ========================== 00:10:06.138 Submission Queue Entry Size 00:10:06.138 Max: 64 00:10:06.138 Min: 64 00:10:06.138 Completion Queue Entry Size 00:10:06.138 Max: 16 00:10:06.138 Min: 16 00:10:06.138 Number of Namespaces: 32 00:10:06.138 Compare Command: Supported 00:10:06.138 Write Uncorrectable Command: Not Supported 00:10:06.138 Dataset Management Command: Supported 00:10:06.138 Write Zeroes Command: Supported 00:10:06.138 Set Features Save Field: Not Supported 00:10:06.138 Reservations: Not Supported 00:10:06.138 Timestamp: Not Supported 00:10:06.138 Copy: Supported 00:10:06.138 Volatile Write Cache: Present 00:10:06.138 Atomic Write Unit (Normal): 1 00:10:06.138 Atomic Write Unit (PFail): 1 00:10:06.138 Atomic Compare & Write Unit: 1 00:10:06.138 Fused Compare & Write: Supported 00:10:06.138 Scatter-Gather List 00:10:06.138 SGL Command Set: Supported (Dword aligned) 00:10:06.138 SGL Keyed: Not Supported 00:10:06.138 SGL Bit Bucket Descriptor: Not Supported 00:10:06.138 SGL Metadata Pointer: Not Supported 00:10:06.138 Oversized SGL: Not Supported 00:10:06.138 SGL Metadata Address: Not Supported 00:10:06.138 SGL Offset: Not Supported 00:10:06.138 Transport SGL Data Block: Not Supported 00:10:06.138 Replay Protected Memory Block: Not Supported 00:10:06.138 00:10:06.138 Firmware Slot Information 00:10:06.138 ========================= 00:10:06.138 Active slot: 1 00:10:06.138 Slot 1 Firmware Revision: 24.05 00:10:06.138 00:10:06.138 00:10:06.138 Commands Supported and Effects 00:10:06.138 ============================== 00:10:06.138 Admin Commands 00:10:06.138 -------------- 00:10:06.138 Get Log Page (02h): Supported 00:10:06.138 Identify (06h): Supported 00:10:06.138 Abort (08h): Supported 00:10:06.138 Set Features (09h): Supported 00:10:06.138 Get Features (0Ah): Supported 00:10:06.138 Asynchronous Event Request (0Ch): Supported 00:10:06.138 Keep Alive (18h): Supported 00:10:06.138 I/O Commands 00:10:06.138 ------------ 00:10:06.138 Flush (00h): Supported LBA-Change 00:10:06.138 Write (01h): Supported LBA-Change 00:10:06.138 Read (02h): Supported 00:10:06.138 Compare (05h): Supported 00:10:06.138 Write Zeroes (08h): Supported LBA-Change 00:10:06.138 Dataset Management (09h): Supported LBA-Change 00:10:06.138 Copy (19h): Supported LBA-Change 00:10:06.138 Unknown (79h): Supported LBA-Change 00:10:06.138 Unknown (7Ah): Supported 00:10:06.138 00:10:06.138 Error Log 00:10:06.138 ========= 00:10:06.138 00:10:06.138 Arbitration 00:10:06.138 =========== 00:10:06.138 Arbitration Burst: 1 00:10:06.138 00:10:06.138 Power Management 00:10:06.138 ================ 00:10:06.138 Number of Power States: 1 00:10:06.138 Current Power State: Power State #0 00:10:06.138 Power State #0: 00:10:06.138 Max Power: 0.00 W 00:10:06.138 Non-Operational State: Operational 00:10:06.138 Entry Latency: Not Reported 00:10:06.138 Exit Latency: Not Reported 00:10:06.138 Relative Read Throughput: 0 00:10:06.138 Relative Read Latency: 0 00:10:06.138 Relative Write Throughput: 0 00:10:06.138 Relative Write Latency: 0 00:10:06.138 Idle Power: Not Reported 00:10:06.138 Active Power: Not Reported 00:10:06.138 Non-Operational Permissive Mode: Not Supported 00:10:06.138 00:10:06.138 Health Information 00:10:06.138 ================== 00:10:06.138 Critical Warnings: 00:10:06.138 Available Spare Space: OK 00:10:06.138 Temperature: OK 00:10:06.138 Device Reliability: OK 00:10:06.138 Read Only: No 00:10:06.138 Volatile Memory Backup: OK 00:10:06.138 Current Temperature: 0 Kelvin (-2[2024-04-27 03:21:30.993275] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:10:06.138 [2024-04-27 03:21:30.993292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:10:06.138 [2024-04-27 03:21:30.993330] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:10:06.138 [2024-04-27 03:21:30.993351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:10:06.138 [2024-04-27 03:21:30.993363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:10:06.138 [2024-04-27 03:21:30.993373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:10:06.138 [2024-04-27 03:21:30.993383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:10:06.138 [2024-04-27 03:21:30.993945] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:10:06.138 [2024-04-27 03:21:30.993964] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:10:06.138 [2024-04-27 03:21:30.994945] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:10:06.138 [2024-04-27 03:21:30.995016] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:10:06.138 [2024-04-27 03:21:30.995030] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:10:06.138 [2024-04-27 03:21:30.995953] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:10:06.138 [2024-04-27 03:21:30.995974] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:10:06.138 [2024-04-27 03:21:30.996027] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:10:06.138 [2024-04-27 03:21:30.997993] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:10:06.138 73 Celsius) 00:10:06.138 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:10:06.138 Available Spare: 0% 00:10:06.138 Available Spare Threshold: 0% 00:10:06.138 Life Percentage Used: 0% 00:10:06.138 Data Units Read: 0 00:10:06.138 Data Units Written: 0 00:10:06.138 Host Read Commands: 0 00:10:06.138 Host Write Commands: 0 00:10:06.138 Controller Busy Time: 0 minutes 00:10:06.138 Power Cycles: 0 00:10:06.138 Power On Hours: 0 hours 00:10:06.138 Unsafe Shutdowns: 0 00:10:06.138 Unrecoverable Media Errors: 0 00:10:06.138 Lifetime Error Log Entries: 0 00:10:06.138 Warning Temperature Time: 0 minutes 00:10:06.138 Critical Temperature Time: 0 minutes 00:10:06.138 00:10:06.138 Number of Queues 00:10:06.138 ================ 00:10:06.138 Number of I/O Submission Queues: 127 00:10:06.138 Number of I/O Completion Queues: 127 00:10:06.138 00:10:06.138 Active Namespaces 00:10:06.138 ================= 00:10:06.138 Namespace ID:1 00:10:06.138 Error Recovery Timeout: Unlimited 00:10:06.138 Command Set Identifier: NVM (00h) 00:10:06.138 Deallocate: Supported 00:10:06.138 Deallocated/Unwritten Error: Not Supported 00:10:06.138 Deallocated Read Value: Unknown 00:10:06.138 Deallocate in Write Zeroes: Not Supported 00:10:06.138 Deallocated Guard Field: 0xFFFF 00:10:06.138 Flush: Supported 00:10:06.138 Reservation: Supported 00:10:06.138 Namespace Sharing Capabilities: Multiple Controllers 00:10:06.138 Size (in LBAs): 131072 (0GiB) 00:10:06.138 Capacity (in LBAs): 131072 (0GiB) 00:10:06.138 Utilization (in LBAs): 131072 (0GiB) 00:10:06.138 NGUID: 294FB7CF818E434897FAADBB2024DA7A 00:10:06.138 UUID: 294fb7cf-818e-4348-97fa-adbb2024da7a 00:10:06.138 Thin Provisioning: Not Supported 00:10:06.138 Per-NS Atomic Units: Yes 00:10:06.138 Atomic Boundary Size (Normal): 0 00:10:06.138 Atomic Boundary Size (PFail): 0 00:10:06.138 Atomic Boundary Offset: 0 00:10:06.138 Maximum Single Source Range Length: 65535 00:10:06.138 Maximum Copy Length: 65535 00:10:06.138 Maximum Source Range Count: 1 00:10:06.138 NGUID/EUI64 Never Reused: No 00:10:06.138 Namespace Write Protected: No 00:10:06.138 Number of LBA Formats: 1 00:10:06.138 Current LBA Format: LBA Format #00 00:10:06.138 LBA Format #00: Data Size: 512 Metadata Size: 0 00:10:06.138 00:10:06.138 03:21:31 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:10:06.138 EAL: No free 2048 kB hugepages reported on node 1 00:10:06.397 [2024-04-27 03:21:31.232111] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:10:11.694 [2024-04-27 03:21:36.254382] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:10:11.694 Initializing NVMe Controllers 00:10:11.694 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:10:11.694 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:10:11.694 Initialization complete. Launching workers. 00:10:11.694 ======================================================== 00:10:11.694 Latency(us) 00:10:11.694 Device Information : IOPS MiB/s Average min max 00:10:11.694 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 35842.54 140.01 3570.52 1166.31 8775.18 00:10:11.694 ======================================================== 00:10:11.694 Total : 35842.54 140.01 3570.52 1166.31 8775.18 00:10:11.694 00:10:11.695 03:21:36 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:10:11.695 EAL: No free 2048 kB hugepages reported on node 1 00:10:11.695 [2024-04-27 03:21:36.499550] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:10:16.959 [2024-04-27 03:21:41.539832] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:10:16.959 Initializing NVMe Controllers 00:10:16.959 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:10:16.959 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:10:16.960 Initialization complete. Launching workers. 00:10:16.960 ======================================================== 00:10:16.960 Latency(us) 00:10:16.960 Device Information : IOPS MiB/s Average min max 00:10:16.960 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16057.20 62.72 7976.66 5968.99 9985.30 00:10:16.960 ======================================================== 00:10:16.960 Total : 16057.20 62.72 7976.66 5968.99 9985.30 00:10:16.960 00:10:16.960 03:21:41 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:10:16.960 EAL: No free 2048 kB hugepages reported on node 1 00:10:16.960 [2024-04-27 03:21:41.751870] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:10:22.224 [2024-04-27 03:21:46.826633] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:10:22.224 Initializing NVMe Controllers 00:10:22.224 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:10:22.224 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:10:22.224 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:10:22.224 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:10:22.224 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:10:22.224 Initialization complete. Launching workers. 00:10:22.224 Starting thread on core 2 00:10:22.224 Starting thread on core 3 00:10:22.224 Starting thread on core 1 00:10:22.224 03:21:46 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:10:22.224 EAL: No free 2048 kB hugepages reported on node 1 00:10:22.224 [2024-04-27 03:21:47.131278] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:10:25.510 [2024-04-27 03:21:50.198531] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:10:25.510 Initializing NVMe Controllers 00:10:25.510 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:10:25.510 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:10:25.510 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:10:25.510 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:10:25.510 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:10:25.510 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:10:25.510 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:10:25.510 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:10:25.510 Initialization complete. Launching workers. 00:10:25.510 Starting thread on core 1 with urgent priority queue 00:10:25.510 Starting thread on core 2 with urgent priority queue 00:10:25.510 Starting thread on core 3 with urgent priority queue 00:10:25.510 Starting thread on core 0 with urgent priority queue 00:10:25.510 SPDK bdev Controller (SPDK1 ) core 0: 4722.00 IO/s 21.18 secs/100000 ios 00:10:25.510 SPDK bdev Controller (SPDK1 ) core 1: 5401.33 IO/s 18.51 secs/100000 ios 00:10:25.510 SPDK bdev Controller (SPDK1 ) core 2: 5424.67 IO/s 18.43 secs/100000 ios 00:10:25.510 SPDK bdev Controller (SPDK1 ) core 3: 5048.67 IO/s 19.81 secs/100000 ios 00:10:25.510 ======================================================== 00:10:25.510 00:10:25.510 03:21:50 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:10:25.510 EAL: No free 2048 kB hugepages reported on node 1 00:10:25.510 [2024-04-27 03:21:50.483819] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:10:25.768 [2024-04-27 03:21:50.516502] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:10:25.768 Initializing NVMe Controllers 00:10:25.768 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:10:25.768 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:10:25.768 Namespace ID: 1 size: 0GB 00:10:25.768 Initialization complete. 00:10:25.768 INFO: using host memory buffer for IO 00:10:25.768 Hello world! 00:10:25.768 03:21:50 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:10:25.768 EAL: No free 2048 kB hugepages reported on node 1 00:10:26.026 [2024-04-27 03:21:50.807712] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:10:26.961 Initializing NVMe Controllers 00:10:26.961 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:10:26.961 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:10:26.961 Initialization complete. Launching workers. 00:10:26.961 submit (in ns) avg, min, max = 7380.5, 3460.0, 4014591.1 00:10:26.961 complete (in ns) avg, min, max = 24565.3, 2056.7, 4043620.0 00:10:26.961 00:10:26.961 Submit histogram 00:10:26.961 ================ 00:10:26.961 Range in us Cumulative Count 00:10:26.961 3.437 - 3.461: 0.0073% ( 1) 00:10:26.961 3.461 - 3.484: 0.0364% ( 4) 00:10:26.961 3.484 - 3.508: 0.9609% ( 127) 00:10:26.961 3.508 - 3.532: 3.0866% ( 292) 00:10:26.961 3.532 - 3.556: 8.2696% ( 712) 00:10:26.961 3.556 - 3.579: 16.6994% ( 1158) 00:10:26.961 3.579 - 3.603: 25.2748% ( 1178) 00:10:26.961 3.603 - 3.627: 34.3015% ( 1240) 00:10:26.961 3.627 - 3.650: 42.6804% ( 1151) 00:10:26.961 3.650 - 3.674: 50.1638% ( 1028) 00:10:26.961 3.674 - 3.698: 57.7273% ( 1039) 00:10:26.961 3.698 - 3.721: 62.5173% ( 658) 00:10:26.961 3.721 - 3.745: 66.4556% ( 541) 00:10:26.961 3.745 - 3.769: 68.8287% ( 326) 00:10:26.961 3.769 - 3.793: 72.0681% ( 445) 00:10:26.961 3.793 - 3.816: 75.1329% ( 421) 00:10:26.961 3.816 - 3.840: 78.5907% ( 475) 00:10:26.961 3.840 - 3.864: 82.1431% ( 488) 00:10:26.961 3.864 - 3.887: 84.7492% ( 358) 00:10:26.961 3.887 - 3.911: 87.3699% ( 360) 00:10:26.961 3.911 - 3.935: 89.2262% ( 255) 00:10:26.961 3.935 - 3.959: 90.6967% ( 202) 00:10:26.961 3.959 - 3.982: 92.0288% ( 183) 00:10:26.961 3.982 - 4.006: 93.0043% ( 134) 00:10:26.961 4.006 - 4.030: 93.8269% ( 113) 00:10:26.961 4.030 - 4.053: 94.4384% ( 84) 00:10:26.961 4.053 - 4.077: 95.0062% ( 78) 00:10:26.962 4.077 - 4.101: 95.5594% ( 76) 00:10:26.962 4.101 - 4.124: 96.0035% ( 61) 00:10:26.962 4.124 - 4.148: 96.2728% ( 37) 00:10:26.962 4.148 - 4.172: 96.5203% ( 34) 00:10:26.962 4.172 - 4.196: 96.6295% ( 15) 00:10:26.962 4.196 - 4.219: 96.7533% ( 17) 00:10:26.962 4.219 - 4.243: 96.8406% ( 12) 00:10:26.962 4.243 - 4.267: 96.9353% ( 13) 00:10:26.962 4.267 - 4.290: 97.0590% ( 17) 00:10:26.962 4.290 - 4.314: 97.1173% ( 8) 00:10:26.962 4.314 - 4.338: 97.2046% ( 12) 00:10:26.962 4.338 - 4.361: 97.2701% ( 9) 00:10:26.962 4.361 - 4.385: 97.3138% ( 6) 00:10:26.962 4.385 - 4.409: 97.3575% ( 6) 00:10:26.962 4.409 - 4.433: 97.4012% ( 6) 00:10:26.962 4.433 - 4.456: 97.4230% ( 3) 00:10:26.962 4.456 - 4.480: 97.4376% ( 2) 00:10:26.962 4.480 - 4.504: 97.4521% ( 2) 00:10:26.962 4.504 - 4.527: 97.4885% ( 5) 00:10:26.962 4.527 - 4.551: 97.5322% ( 6) 00:10:26.962 4.551 - 4.575: 97.5541% ( 3) 00:10:26.962 4.575 - 4.599: 97.5686% ( 2) 00:10:26.962 4.599 - 4.622: 97.5977% ( 4) 00:10:26.962 4.622 - 4.646: 97.6341% ( 5) 00:10:26.962 4.646 - 4.670: 97.6996% ( 9) 00:10:26.962 4.670 - 4.693: 97.7360% ( 5) 00:10:26.962 4.693 - 4.717: 97.7797% ( 6) 00:10:26.962 4.717 - 4.741: 97.8234% ( 6) 00:10:26.962 4.741 - 4.764: 97.8598% ( 5) 00:10:26.962 4.764 - 4.788: 97.8962% ( 5) 00:10:26.962 4.788 - 4.812: 97.9399% ( 6) 00:10:26.962 4.812 - 4.836: 97.9981% ( 8) 00:10:26.962 4.836 - 4.859: 98.0345% ( 5) 00:10:26.962 4.859 - 4.883: 98.0563% ( 3) 00:10:26.962 4.883 - 4.907: 98.0855% ( 4) 00:10:26.962 4.907 - 4.930: 98.1291% ( 6) 00:10:26.962 4.930 - 4.954: 98.1437% ( 2) 00:10:26.962 4.978 - 5.001: 98.1874% ( 6) 00:10:26.962 5.001 - 5.025: 98.2092% ( 3) 00:10:26.962 5.049 - 5.073: 98.2311% ( 3) 00:10:26.962 5.073 - 5.096: 98.2529% ( 3) 00:10:26.962 5.096 - 5.120: 98.2966% ( 6) 00:10:26.962 5.120 - 5.144: 98.3184% ( 3) 00:10:26.962 5.144 - 5.167: 98.3330% ( 2) 00:10:26.962 5.167 - 5.191: 98.3475% ( 2) 00:10:26.962 5.215 - 5.239: 98.3694% ( 3) 00:10:26.962 5.239 - 5.262: 98.3766% ( 1) 00:10:26.962 5.262 - 5.286: 98.3839% ( 1) 00:10:26.962 5.310 - 5.333: 98.4058% ( 3) 00:10:26.962 5.381 - 5.404: 98.4130% ( 1) 00:10:26.962 5.428 - 5.452: 98.4203% ( 1) 00:10:26.962 5.807 - 5.831: 98.4276% ( 1) 00:10:26.962 6.116 - 6.163: 98.4349% ( 1) 00:10:26.962 6.163 - 6.210: 98.4422% ( 1) 00:10:26.962 6.447 - 6.495: 98.4567% ( 2) 00:10:26.962 6.732 - 6.779: 98.4640% ( 1) 00:10:26.962 7.016 - 7.064: 98.4713% ( 1) 00:10:26.962 7.064 - 7.111: 98.4858% ( 2) 00:10:26.962 7.111 - 7.159: 98.5004% ( 2) 00:10:26.962 7.159 - 7.206: 98.5077% ( 1) 00:10:26.962 7.253 - 7.301: 98.5368% ( 4) 00:10:26.962 7.396 - 7.443: 98.5514% ( 2) 00:10:26.962 7.443 - 7.490: 98.5659% ( 2) 00:10:26.962 7.490 - 7.538: 98.5805% ( 2) 00:10:26.962 7.538 - 7.585: 98.5878% ( 1) 00:10:26.962 7.633 - 7.680: 98.6169% ( 4) 00:10:26.962 7.680 - 7.727: 98.6242% ( 1) 00:10:26.962 7.727 - 7.775: 98.6314% ( 1) 00:10:26.962 7.775 - 7.822: 98.6387% ( 1) 00:10:26.962 7.822 - 7.870: 98.6460% ( 1) 00:10:26.962 7.964 - 8.012: 98.6606% ( 2) 00:10:26.962 8.012 - 8.059: 98.6824% ( 3) 00:10:26.962 8.059 - 8.107: 98.6897% ( 1) 00:10:26.962 8.107 - 8.154: 98.6969% ( 1) 00:10:26.962 8.249 - 8.296: 98.7115% ( 2) 00:10:26.962 8.391 - 8.439: 98.7188% ( 1) 00:10:26.962 8.533 - 8.581: 98.7261% ( 1) 00:10:26.962 8.723 - 8.770: 98.7406% ( 2) 00:10:26.962 8.818 - 8.865: 98.7479% ( 1) 00:10:26.962 9.007 - 9.055: 98.7552% ( 1) 00:10:26.962 9.102 - 9.150: 98.7625% ( 1) 00:10:26.962 9.339 - 9.387: 98.7770% ( 2) 00:10:26.962 9.387 - 9.434: 98.7843% ( 1) 00:10:26.962 9.719 - 9.766: 98.7989% ( 2) 00:10:26.962 10.145 - 10.193: 98.8061% ( 1) 00:10:26.962 10.240 - 10.287: 98.8134% ( 1) 00:10:26.962 10.287 - 10.335: 98.8280% ( 2) 00:10:26.962 10.335 - 10.382: 98.8353% ( 1) 00:10:26.962 10.382 - 10.430: 98.8425% ( 1) 00:10:26.962 10.809 - 10.856: 98.8498% ( 1) 00:10:26.962 10.856 - 10.904: 98.8571% ( 1) 00:10:26.962 10.999 - 11.046: 98.8644% ( 1) 00:10:26.962 11.046 - 11.093: 98.8717% ( 1) 00:10:26.962 11.662 - 11.710: 98.8789% ( 1) 00:10:26.962 11.710 - 11.757: 98.8862% ( 1) 00:10:26.962 11.757 - 11.804: 98.8935% ( 1) 00:10:26.962 11.804 - 11.852: 98.9008% ( 1) 00:10:26.962 11.994 - 12.041: 98.9081% ( 1) 00:10:26.962 12.136 - 12.231: 98.9299% ( 3) 00:10:26.962 12.231 - 12.326: 98.9372% ( 1) 00:10:26.962 12.705 - 12.800: 98.9445% ( 1) 00:10:26.962 12.990 - 13.084: 98.9590% ( 2) 00:10:26.962 13.084 - 13.179: 98.9663% ( 1) 00:10:26.962 13.274 - 13.369: 98.9809% ( 2) 00:10:26.962 13.464 - 13.559: 98.9954% ( 2) 00:10:26.962 13.559 - 13.653: 99.0027% ( 1) 00:10:26.962 13.748 - 13.843: 99.0100% ( 1) 00:10:26.962 13.843 - 13.938: 99.0173% ( 1) 00:10:26.962 14.033 - 14.127: 99.0245% ( 1) 00:10:26.962 14.127 - 14.222: 99.0318% ( 1) 00:10:26.962 14.222 - 14.317: 99.0391% ( 1) 00:10:26.962 14.981 - 15.076: 99.0464% ( 1) 00:10:26.962 17.067 - 17.161: 99.0537% ( 1) 00:10:26.962 17.351 - 17.446: 99.0682% ( 2) 00:10:26.962 17.541 - 17.636: 99.0973% ( 4) 00:10:26.962 17.636 - 17.730: 99.1264% ( 4) 00:10:26.962 17.730 - 17.825: 99.1483% ( 3) 00:10:26.962 17.825 - 17.920: 99.1920% ( 6) 00:10:26.962 17.920 - 18.015: 99.2866% ( 13) 00:10:26.962 18.015 - 18.110: 99.3157% ( 4) 00:10:26.962 18.110 - 18.204: 99.3740% ( 8) 00:10:26.962 18.204 - 18.299: 99.3885% ( 2) 00:10:26.962 18.299 - 18.394: 99.4395% ( 7) 00:10:26.962 18.394 - 18.489: 99.5341% ( 13) 00:10:26.962 18.489 - 18.584: 99.5851% ( 7) 00:10:26.962 18.584 - 18.679: 99.6215% ( 5) 00:10:26.962 18.679 - 18.773: 99.7015% ( 11) 00:10:26.962 18.773 - 18.868: 99.7234% ( 3) 00:10:26.962 18.868 - 18.963: 99.7379% ( 2) 00:10:26.962 18.963 - 19.058: 99.7452% ( 1) 00:10:26.962 19.058 - 19.153: 99.7889% ( 6) 00:10:26.962 19.153 - 19.247: 99.8107% ( 3) 00:10:26.962 19.247 - 19.342: 99.8326% ( 3) 00:10:26.962 19.342 - 19.437: 99.8471% ( 2) 00:10:26.962 19.437 - 19.532: 99.8617% ( 2) 00:10:26.962 19.721 - 19.816: 99.8690% ( 1) 00:10:26.962 20.101 - 20.196: 99.8762% ( 1) 00:10:26.962 20.575 - 20.670: 99.8835% ( 1) 00:10:26.962 21.049 - 21.144: 99.8908% ( 1) 00:10:26.962 22.850 - 22.945: 99.8981% ( 1) 00:10:26.962 26.738 - 26.927: 99.9054% ( 1) 00:10:26.962 28.444 - 28.634: 99.9126% ( 1) 00:10:26.962 3980.705 - 4004.978: 99.9927% ( 11) 00:10:26.962 4004.978 - 4029.250: 100.0000% ( 1) 00:10:26.962 00:10:26.962 Complete histogram 00:10:26.962 ================== 00:10:26.962 Range in us Cumulative Count 00:10:26.962 2.050 - 2.062: 0.5387% ( 74) 00:10:26.962 2.062 - 2.074: 11.5746% ( 1516) 00:10:26.962 2.074 - 2.086: 16.6485% ( 697) 00:10:26.962 2.086 - 2.098: 24.6488% ( 1099) 00:10:26.962 2.098 - 2.110: 54.0875% ( 4044) 00:10:26.962 2.110 - 2.121: 61.1342% ( 968) 00:10:26.962 2.121 - 2.133: 64.8176% ( 506) 00:10:26.962 2.133 - 2.145: 69.4912% ( 642) 00:10:26.962 2.145 - 2.157: 70.8961% ( 193) 00:10:26.962 2.157 - 2.169: 75.9700% ( 697) 00:10:26.962 2.169 - 2.181: 84.5818% ( 1183) 00:10:26.962 2.181 - 2.193: 87.2388% ( 365) 00:10:26.962 2.193 - 2.204: 88.3599% ( 154) 00:10:26.962 2.204 - 2.216: 89.7358% ( 189) 00:10:26.962 2.216 - 2.228: 90.6020% ( 119) 00:10:26.962 2.228 - 2.240: 91.5047% ( 124) 00:10:26.962 2.240 - 2.252: 93.7250% ( 305) 00:10:26.962 2.252 - 2.264: 94.6349% ( 125) 00:10:26.962 2.264 - 2.276: 94.9188% ( 39) 00:10:26.962 2.276 - 2.287: 95.1955% ( 38) 00:10:26.962 2.287 - 2.299: 95.4502% ( 35) 00:10:26.962 2.299 - 2.311: 95.5230% ( 10) 00:10:26.962 2.311 - 2.323: 95.7633% ( 33) 00:10:26.962 2.323 - 2.335: 95.9016% ( 19) 00:10:26.962 2.335 - 2.347: 95.9525% ( 7) 00:10:26.962 2.347 - 2.359: 96.0399% ( 12) 00:10:26.962 2.359 - 2.370: 96.2219% ( 25) 00:10:26.962 2.370 - 2.382: 96.3602% ( 19) 00:10:26.962 2.382 - 2.394: 96.5640% ( 28) 00:10:26.962 2.394 - 2.406: 96.8261% ( 36) 00:10:26.962 2.406 - 2.418: 97.0663% ( 33) 00:10:26.962 2.418 - 2.430: 97.3357% ( 37) 00:10:26.962 2.430 - 2.441: 97.6050% ( 37) 00:10:26.962 2.441 - 2.453: 97.7506% ( 20) 00:10:26.962 2.453 - 2.465: 97.8671% ( 16) 00:10:26.962 2.465 - 2.477: 97.9763% ( 15) 00:10:26.962 2.477 - 2.489: 98.0855% ( 15) 00:10:26.962 2.489 - 2.501: 98.1583% ( 10) 00:10:26.962 2.501 - 2.513: 98.1801% ( 3) 00:10:26.962 2.513 - 2.524: 98.2165% ( 5) 00:10:26.962 2.524 - 2.536: 98.2529% ( 5) 00:10:26.962 2.536 - 2.548: 98.2747% ( 3) 00:10:26.962 2.548 - 2.560: 98.3111% ( 5) 00:10:26.962 2.560 - 2.572: 98.3330% ( 3) 00:10:26.962 2.572 - 2.584: 98.3475% ( 2) 00:10:26.962 2.584 - 2.596: 98.3548% ( 1) 00:10:26.962 2.607 - 2.619: 98.3621% ( 1) 00:10:26.962 2.619 - 2.631: 98.3694% ( 1) 00:10:26.962 2.631 - 2.643: 98.3912% ( 3) 00:10:26.962 2.655 - 2.667: 98.4058% ( 2) 00:10:26.962 2.667 - 2.679: 98.4130% ( 1) 00:10:26.962 2.679 - 2.690: 98.4203% ( 1) 00:10:26.962 2.690 - 2.702: 98.4276% ( 1) 00:10:26.962 2.714 - 2.726: 98.4349% ( 1) 00:10:26.963 2.750 - 2.761: 98.4422% ( 1) 00:10:26.963 2.761 - 2.773: 98.4494% ( 1) 00:10:26.963 2.797 - 2.809: 98.4567% ( 1) 00:10:26.963 2.833 - 2.844: 98.4640% ( 1) 00:10:26.963 2.844 - 2.856: 98.4786% ( 2) 00:10:26.963 2.856 - 2.868: 98.4858% ( 1) 00:10:26.963 2.880 - 2.892: 98.5004% ( 2) 00:10:26.963 2.904 - 2.916: 98.5077% ( 1) 00:10:26.963 2.916 - 2.927: 98.5150% ( 1) 00:10:26.963 2.927 - 2.939: 98.5222% ( 1) 00:10:26.963 2.939 - 2.951: 98.5368% ( 2) 00:10:26.963 2.951 - 2.963: 98.5441% ( 1) 00:10:26.963 2.975 - 2.987: 98.5586% ( 2) 00:10:26.963 2.987 - 2.999: 98.5659% ( 1) 00:10:26.963 3.034 - 3.058: 98.5732% ( 1) 00:10:26.963 3.081 - 3.105: 98.5805% ( 1) 00:10:26.963 3.105 - 3.129: 98.5950% ( 2) 00:10:26.963 3.129 - 3.153: 98.6023% ( 1) 00:10:26.963 3.224 - 3.247: 98.6096% ( 1) 00:10:26.963 3.247 - 3.271: 98.6169% ( 1) 00:10:26.963 3.271 - 3.295: 98.6242% ( 1) 00:10:26.963 3.295 - 3.319: 98.6314% ( 1) 00:10:26.963 3.319 - 3.342: 98.6387% ( 1) 00:10:26.963 3.342 - 3.366: 98.6533% ( 2) 00:10:26.963 3.366 - 3.390: 98.6751% ( 3) 00:10:26.963 3.390 - 3.413: 98.6824% ( 1) 00:10:26.963 3.413 - 3.437: 9[2024-04-27 03:21:51.829910] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:10:26.963 8.7042% ( 3) 00:10:26.963 3.461 - 3.484: 98.7188% ( 2) 00:10:26.963 3.532 - 3.556: 98.7333% ( 2) 00:10:26.963 3.556 - 3.579: 98.7406% ( 1) 00:10:26.963 3.579 - 3.603: 98.7479% ( 1) 00:10:26.963 3.603 - 3.627: 98.7552% ( 1) 00:10:26.963 3.627 - 3.650: 98.7625% ( 1) 00:10:26.963 3.698 - 3.721: 98.7770% ( 2) 00:10:26.963 3.721 - 3.745: 98.7843% ( 1) 00:10:26.963 3.745 - 3.769: 98.7916% ( 1) 00:10:26.963 3.769 - 3.793: 98.7989% ( 1) 00:10:26.963 3.816 - 3.840: 98.8061% ( 1) 00:10:26.963 3.840 - 3.864: 98.8134% ( 1) 00:10:26.963 4.053 - 4.077: 98.8207% ( 1) 00:10:26.963 4.196 - 4.219: 98.8280% ( 1) 00:10:26.963 4.219 - 4.243: 98.8353% ( 1) 00:10:26.963 4.907 - 4.930: 98.8425% ( 1) 00:10:26.963 4.954 - 4.978: 98.8498% ( 1) 00:10:26.963 5.239 - 5.262: 98.8571% ( 1) 00:10:26.963 5.760 - 5.784: 98.8644% ( 1) 00:10:26.963 5.831 - 5.855: 98.8717% ( 1) 00:10:26.963 5.950 - 5.973: 98.8789% ( 1) 00:10:26.963 5.973 - 5.997: 98.8862% ( 1) 00:10:26.963 6.021 - 6.044: 98.8935% ( 1) 00:10:26.963 6.305 - 6.353: 98.9008% ( 1) 00:10:26.963 6.353 - 6.400: 98.9153% ( 2) 00:10:26.963 6.400 - 6.447: 98.9226% ( 1) 00:10:26.963 6.637 - 6.684: 98.9372% ( 2) 00:10:26.963 6.874 - 6.921: 98.9445% ( 1) 00:10:26.963 12.326 - 12.421: 98.9517% ( 1) 00:10:26.963 15.644 - 15.739: 98.9663% ( 2) 00:10:26.963 15.739 - 15.834: 98.9881% ( 3) 00:10:26.963 15.834 - 15.929: 99.0027% ( 2) 00:10:26.963 15.929 - 16.024: 99.0173% ( 2) 00:10:26.963 16.024 - 16.119: 99.0318% ( 2) 00:10:26.963 16.119 - 16.213: 99.0464% ( 2) 00:10:26.963 16.213 - 16.308: 99.0900% ( 6) 00:10:26.963 16.308 - 16.403: 99.1119% ( 3) 00:10:26.963 16.403 - 16.498: 99.1192% ( 1) 00:10:26.963 16.498 - 16.593: 99.1337% ( 2) 00:10:26.963 16.593 - 16.687: 99.1701% ( 5) 00:10:26.963 16.687 - 16.782: 99.2065% ( 5) 00:10:26.963 16.782 - 16.877: 99.2575% ( 7) 00:10:26.963 16.877 - 16.972: 99.2939% ( 5) 00:10:26.963 16.972 - 17.067: 99.3012% ( 1) 00:10:26.963 17.067 - 17.161: 99.3157% ( 2) 00:10:26.963 17.161 - 17.256: 99.3230% ( 1) 00:10:26.963 17.256 - 17.351: 99.3376% ( 2) 00:10:26.963 17.351 - 17.446: 99.3594% ( 3) 00:10:26.963 17.446 - 17.541: 99.3667% ( 1) 00:10:26.963 17.636 - 17.730: 99.3812% ( 2) 00:10:26.963 17.730 - 17.825: 99.3958% ( 2) 00:10:26.963 17.825 - 17.920: 99.4031% ( 1) 00:10:26.963 18.204 - 18.299: 99.4104% ( 1) 00:10:26.963 18.489 - 18.584: 99.4249% ( 2) 00:10:26.963 20.575 - 20.670: 99.4322% ( 1) 00:10:26.963 42.098 - 42.287: 99.4395% ( 1) 00:10:26.963 2997.665 - 3009.801: 99.4467% ( 1) 00:10:26.963 3980.705 - 4004.978: 99.8981% ( 62) 00:10:26.963 4004.978 - 4029.250: 99.9927% ( 13) 00:10:26.963 4029.250 - 4053.523: 100.0000% ( 1) 00:10:26.963 00:10:26.963 03:21:51 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:10:26.963 03:21:51 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:10:26.963 03:21:51 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:10:26.963 03:21:51 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:10:26.963 03:21:51 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:10:27.222 [2024-04-27 03:21:52.096507] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:10:27.222 [ 00:10:27.222 { 00:10:27.222 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:10:27.222 "subtype": "Discovery", 00:10:27.222 "listen_addresses": [], 00:10:27.222 "allow_any_host": true, 00:10:27.222 "hosts": [] 00:10:27.222 }, 00:10:27.222 { 00:10:27.222 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:10:27.222 "subtype": "NVMe", 00:10:27.222 "listen_addresses": [ 00:10:27.222 { 00:10:27.222 "transport": "VFIOUSER", 00:10:27.222 "trtype": "VFIOUSER", 00:10:27.222 "adrfam": "IPv4", 00:10:27.222 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:10:27.222 "trsvcid": "0" 00:10:27.222 } 00:10:27.222 ], 00:10:27.222 "allow_any_host": true, 00:10:27.222 "hosts": [], 00:10:27.222 "serial_number": "SPDK1", 00:10:27.222 "model_number": "SPDK bdev Controller", 00:10:27.222 "max_namespaces": 32, 00:10:27.222 "min_cntlid": 1, 00:10:27.222 "max_cntlid": 65519, 00:10:27.222 "namespaces": [ 00:10:27.222 { 00:10:27.222 "nsid": 1, 00:10:27.222 "bdev_name": "Malloc1", 00:10:27.222 "name": "Malloc1", 00:10:27.222 "nguid": "294FB7CF818E434897FAADBB2024DA7A", 00:10:27.222 "uuid": "294fb7cf-818e-4348-97fa-adbb2024da7a" 00:10:27.222 } 00:10:27.222 ] 00:10:27.222 }, 00:10:27.222 { 00:10:27.222 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:10:27.222 "subtype": "NVMe", 00:10:27.222 "listen_addresses": [ 00:10:27.222 { 00:10:27.222 "transport": "VFIOUSER", 00:10:27.222 "trtype": "VFIOUSER", 00:10:27.222 "adrfam": "IPv4", 00:10:27.222 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:10:27.222 "trsvcid": "0" 00:10:27.222 } 00:10:27.222 ], 00:10:27.222 "allow_any_host": true, 00:10:27.222 "hosts": [], 00:10:27.222 "serial_number": "SPDK2", 00:10:27.222 "model_number": "SPDK bdev Controller", 00:10:27.222 "max_namespaces": 32, 00:10:27.222 "min_cntlid": 1, 00:10:27.222 "max_cntlid": 65519, 00:10:27.222 "namespaces": [ 00:10:27.222 { 00:10:27.222 "nsid": 1, 00:10:27.222 "bdev_name": "Malloc2", 00:10:27.222 "name": "Malloc2", 00:10:27.222 "nguid": "534909308D2C49D288DFC8946AA39B34", 00:10:27.222 "uuid": "53490930-8d2c-49d2-88df-c8946aa39b34" 00:10:27.222 } 00:10:27.222 ] 00:10:27.222 } 00:10:27.222 ] 00:10:27.222 03:21:52 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:10:27.222 03:21:52 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1402819 00:10:27.222 03:21:52 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:10:27.222 03:21:52 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:10:27.222 03:21:52 -- common/autotest_common.sh@1251 -- # local i=0 00:10:27.222 03:21:52 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:10:27.222 03:21:52 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:10:27.222 03:21:52 -- common/autotest_common.sh@1262 -- # return 0 00:10:27.222 03:21:52 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:10:27.222 03:21:52 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:10:27.222 EAL: No free 2048 kB hugepages reported on node 1 00:10:27.481 [2024-04-27 03:21:52.275735] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:10:27.481 Malloc3 00:10:27.481 03:21:52 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:10:27.761 [2024-04-27 03:21:52.677737] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:10:27.761 03:21:52 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:10:27.761 Asynchronous Event Request test 00:10:27.761 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:10:27.761 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:10:27.761 Registering asynchronous event callbacks... 00:10:27.761 Starting namespace attribute notice tests for all controllers... 00:10:27.761 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:10:27.761 aer_cb - Changed Namespace 00:10:27.761 Cleaning up... 00:10:28.019 [ 00:10:28.019 { 00:10:28.019 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:10:28.019 "subtype": "Discovery", 00:10:28.019 "listen_addresses": [], 00:10:28.019 "allow_any_host": true, 00:10:28.019 "hosts": [] 00:10:28.019 }, 00:10:28.019 { 00:10:28.019 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:10:28.019 "subtype": "NVMe", 00:10:28.019 "listen_addresses": [ 00:10:28.019 { 00:10:28.019 "transport": "VFIOUSER", 00:10:28.019 "trtype": "VFIOUSER", 00:10:28.019 "adrfam": "IPv4", 00:10:28.019 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:10:28.019 "trsvcid": "0" 00:10:28.019 } 00:10:28.019 ], 00:10:28.019 "allow_any_host": true, 00:10:28.019 "hosts": [], 00:10:28.019 "serial_number": "SPDK1", 00:10:28.019 "model_number": "SPDK bdev Controller", 00:10:28.019 "max_namespaces": 32, 00:10:28.019 "min_cntlid": 1, 00:10:28.019 "max_cntlid": 65519, 00:10:28.019 "namespaces": [ 00:10:28.019 { 00:10:28.019 "nsid": 1, 00:10:28.019 "bdev_name": "Malloc1", 00:10:28.019 "name": "Malloc1", 00:10:28.019 "nguid": "294FB7CF818E434897FAADBB2024DA7A", 00:10:28.019 "uuid": "294fb7cf-818e-4348-97fa-adbb2024da7a" 00:10:28.019 }, 00:10:28.019 { 00:10:28.019 "nsid": 2, 00:10:28.019 "bdev_name": "Malloc3", 00:10:28.019 "name": "Malloc3", 00:10:28.019 "nguid": "0CD735556CA14E78B6826AEFD3FE5C23", 00:10:28.019 "uuid": "0cd73555-6ca1-4e78-b682-6aefd3fe5c23" 00:10:28.019 } 00:10:28.019 ] 00:10:28.019 }, 00:10:28.019 { 00:10:28.019 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:10:28.019 "subtype": "NVMe", 00:10:28.019 "listen_addresses": [ 00:10:28.019 { 00:10:28.019 "transport": "VFIOUSER", 00:10:28.019 "trtype": "VFIOUSER", 00:10:28.019 "adrfam": "IPv4", 00:10:28.019 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:10:28.019 "trsvcid": "0" 00:10:28.019 } 00:10:28.019 ], 00:10:28.019 "allow_any_host": true, 00:10:28.019 "hosts": [], 00:10:28.019 "serial_number": "SPDK2", 00:10:28.019 "model_number": "SPDK bdev Controller", 00:10:28.019 "max_namespaces": 32, 00:10:28.019 "min_cntlid": 1, 00:10:28.019 "max_cntlid": 65519, 00:10:28.019 "namespaces": [ 00:10:28.019 { 00:10:28.019 "nsid": 1, 00:10:28.019 "bdev_name": "Malloc2", 00:10:28.019 "name": "Malloc2", 00:10:28.019 "nguid": "534909308D2C49D288DFC8946AA39B34", 00:10:28.019 "uuid": "53490930-8d2c-49d2-88df-c8946aa39b34" 00:10:28.019 } 00:10:28.019 ] 00:10:28.019 } 00:10:28.019 ] 00:10:28.019 03:21:52 -- target/nvmf_vfio_user.sh@44 -- # wait 1402819 00:10:28.019 03:21:52 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:10:28.019 03:21:52 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:10:28.019 03:21:52 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:10:28.019 03:21:52 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:10:28.019 [2024-04-27 03:21:52.992181] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:10:28.019 [2024-04-27 03:21:52.992217] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1402956 ] 00:10:28.279 EAL: No free 2048 kB hugepages reported on node 1 00:10:28.279 [2024-04-27 03:21:53.024283] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:10:28.279 [2024-04-27 03:21:53.032565] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:10:28.279 [2024-04-27 03:21:53.032594] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fcb62b64000 00:10:28.279 [2024-04-27 03:21:53.033539] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:10:28.279 [2024-04-27 03:21:53.034544] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:10:28.279 [2024-04-27 03:21:53.035545] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:10:28.280 [2024-04-27 03:21:53.036574] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:10:28.280 [2024-04-27 03:21:53.037582] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:10:28.280 [2024-04-27 03:21:53.038586] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:10:28.280 [2024-04-27 03:21:53.039588] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:10:28.280 [2024-04-27 03:21:53.040591] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:10:28.280 [2024-04-27 03:21:53.041618] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:10:28.280 [2024-04-27 03:21:53.041659] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fcb62b59000 00:10:28.280 [2024-04-27 03:21:53.042776] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:10:28.280 [2024-04-27 03:21:53.058966] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:10:28.280 [2024-04-27 03:21:53.058998] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:10:28.280 [2024-04-27 03:21:53.064102] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:10:28.280 [2024-04-27 03:21:53.064155] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:10:28.280 [2024-04-27 03:21:53.064263] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:10:28.280 [2024-04-27 03:21:53.064289] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:10:28.280 [2024-04-27 03:21:53.064322] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:10:28.280 [2024-04-27 03:21:53.065110] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:10:28.280 [2024-04-27 03:21:53.065129] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:10:28.280 [2024-04-27 03:21:53.065142] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:10:28.280 [2024-04-27 03:21:53.066112] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:10:28.280 [2024-04-27 03:21:53.066132] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:10:28.280 [2024-04-27 03:21:53.066145] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:10:28.280 [2024-04-27 03:21:53.067118] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:10:28.280 [2024-04-27 03:21:53.067137] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:10:28.280 [2024-04-27 03:21:53.068120] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:10:28.280 [2024-04-27 03:21:53.068139] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:10:28.280 [2024-04-27 03:21:53.068147] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:10:28.280 [2024-04-27 03:21:53.068158] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:10:28.280 [2024-04-27 03:21:53.068268] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:10:28.280 [2024-04-27 03:21:53.068279] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:10:28.280 [2024-04-27 03:21:53.068287] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:10:28.280 [2024-04-27 03:21:53.069125] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:10:28.280 [2024-04-27 03:21:53.070130] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:10:28.280 [2024-04-27 03:21:53.071144] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:10:28.280 [2024-04-27 03:21:53.072140] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:10:28.280 [2024-04-27 03:21:53.072217] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:10:28.280 [2024-04-27 03:21:53.073154] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:10:28.280 [2024-04-27 03:21:53.073173] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:10:28.280 [2024-04-27 03:21:53.073182] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.073209] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:10:28.280 [2024-04-27 03:21:53.073222] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.073266] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:10:28.280 [2024-04-27 03:21:53.073277] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:10:28.280 [2024-04-27 03:21:53.073294] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:10:28.280 [2024-04-27 03:21:53.081259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:10:28.280 [2024-04-27 03:21:53.081282] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:10:28.280 [2024-04-27 03:21:53.081291] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:10:28.280 [2024-04-27 03:21:53.081299] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:10:28.280 [2024-04-27 03:21:53.081307] nvme_ctrlr.c:2002:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:10:28.280 [2024-04-27 03:21:53.081315] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:10:28.280 [2024-04-27 03:21:53.081324] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:10:28.280 [2024-04-27 03:21:53.081332] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.081345] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.081361] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:10:28.280 [2024-04-27 03:21:53.089255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:10:28.280 [2024-04-27 03:21:53.089284] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:10:28.280 [2024-04-27 03:21:53.089299] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:10:28.280 [2024-04-27 03:21:53.089312] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:10:28.280 [2024-04-27 03:21:53.089324] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:10:28.280 [2024-04-27 03:21:53.089333] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.089348] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.089363] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:10:28.280 [2024-04-27 03:21:53.095299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:10:28.280 [2024-04-27 03:21:53.095342] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:10:28.280 [2024-04-27 03:21:53.095352] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.095373] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.095384] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.095398] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:10:28.280 [2024-04-27 03:21:53.105273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:10:28.280 [2024-04-27 03:21:53.105346] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.105364] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.105378] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:10:28.280 [2024-04-27 03:21:53.105387] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:10:28.280 [2024-04-27 03:21:53.105397] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:10:28.280 [2024-04-27 03:21:53.113255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:10:28.280 [2024-04-27 03:21:53.113277] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:10:28.280 [2024-04-27 03:21:53.113312] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.113328] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.113341] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:10:28.280 [2024-04-27 03:21:53.113350] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:10:28.280 [2024-04-27 03:21:53.113360] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:10:28.280 [2024-04-27 03:21:53.121260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:10:28.280 [2024-04-27 03:21:53.121288] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.121303] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:10:28.280 [2024-04-27 03:21:53.121316] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:10:28.280 [2024-04-27 03:21:53.121324] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:10:28.280 [2024-04-27 03:21:53.121334] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:10:28.281 [2024-04-27 03:21:53.129257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:10:28.281 [2024-04-27 03:21:53.129278] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:10:28.281 [2024-04-27 03:21:53.129304] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:10:28.281 [2024-04-27 03:21:53.129323] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:10:28.281 [2024-04-27 03:21:53.129333] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:10:28.281 [2024-04-27 03:21:53.129342] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:10:28.281 [2024-04-27 03:21:53.129350] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:10:28.281 [2024-04-27 03:21:53.129357] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:10:28.281 [2024-04-27 03:21:53.129366] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:10:28.281 [2024-04-27 03:21:53.129391] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:10:28.281 [2024-04-27 03:21:53.137258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:10:28.281 [2024-04-27 03:21:53.137284] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:10:28.281 [2024-04-27 03:21:53.145258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:10:28.281 [2024-04-27 03:21:53.145283] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:10:28.281 [2024-04-27 03:21:53.153259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:10:28.281 [2024-04-27 03:21:53.153283] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:10:28.281 [2024-04-27 03:21:53.161269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:10:28.281 [2024-04-27 03:21:53.161296] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:10:28.281 [2024-04-27 03:21:53.161306] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:10:28.281 [2024-04-27 03:21:53.161312] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:10:28.281 [2024-04-27 03:21:53.161318] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:10:28.281 [2024-04-27 03:21:53.161328] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:10:28.281 [2024-04-27 03:21:53.161340] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:10:28.281 [2024-04-27 03:21:53.161348] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:10:28.281 [2024-04-27 03:21:53.161357] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:10:28.281 [2024-04-27 03:21:53.161368] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:10:28.281 [2024-04-27 03:21:53.161376] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:10:28.281 [2024-04-27 03:21:53.161385] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:10:28.281 [2024-04-27 03:21:53.161397] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:10:28.281 [2024-04-27 03:21:53.161405] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:10:28.281 [2024-04-27 03:21:53.161414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:10:28.281 [2024-04-27 03:21:53.169258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:10:28.281 [2024-04-27 03:21:53.169286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:10:28.281 [2024-04-27 03:21:53.169302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:10:28.281 [2024-04-27 03:21:53.169314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:10:28.281 ===================================================== 00:10:28.281 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:10:28.281 ===================================================== 00:10:28.281 Controller Capabilities/Features 00:10:28.281 ================================ 00:10:28.281 Vendor ID: 4e58 00:10:28.281 Subsystem Vendor ID: 4e58 00:10:28.281 Serial Number: SPDK2 00:10:28.281 Model Number: SPDK bdev Controller 00:10:28.281 Firmware Version: 24.05 00:10:28.281 Recommended Arb Burst: 6 00:10:28.281 IEEE OUI Identifier: 8d 6b 50 00:10:28.281 Multi-path I/O 00:10:28.281 May have multiple subsystem ports: Yes 00:10:28.281 May have multiple controllers: Yes 00:10:28.281 Associated with SR-IOV VF: No 00:10:28.281 Max Data Transfer Size: 131072 00:10:28.281 Max Number of Namespaces: 32 00:10:28.281 Max Number of I/O Queues: 127 00:10:28.281 NVMe Specification Version (VS): 1.3 00:10:28.281 NVMe Specification Version (Identify): 1.3 00:10:28.281 Maximum Queue Entries: 256 00:10:28.281 Contiguous Queues Required: Yes 00:10:28.281 Arbitration Mechanisms Supported 00:10:28.281 Weighted Round Robin: Not Supported 00:10:28.281 Vendor Specific: Not Supported 00:10:28.281 Reset Timeout: 15000 ms 00:10:28.281 Doorbell Stride: 4 bytes 00:10:28.281 NVM Subsystem Reset: Not Supported 00:10:28.281 Command Sets Supported 00:10:28.281 NVM Command Set: Supported 00:10:28.281 Boot Partition: Not Supported 00:10:28.281 Memory Page Size Minimum: 4096 bytes 00:10:28.281 Memory Page Size Maximum: 4096 bytes 00:10:28.281 Persistent Memory Region: Not Supported 00:10:28.281 Optional Asynchronous Events Supported 00:10:28.281 Namespace Attribute Notices: Supported 00:10:28.281 Firmware Activation Notices: Not Supported 00:10:28.281 ANA Change Notices: Not Supported 00:10:28.281 PLE Aggregate Log Change Notices: Not Supported 00:10:28.281 LBA Status Info Alert Notices: Not Supported 00:10:28.281 EGE Aggregate Log Change Notices: Not Supported 00:10:28.281 Normal NVM Subsystem Shutdown event: Not Supported 00:10:28.281 Zone Descriptor Change Notices: Not Supported 00:10:28.281 Discovery Log Change Notices: Not Supported 00:10:28.281 Controller Attributes 00:10:28.281 128-bit Host Identifier: Supported 00:10:28.281 Non-Operational Permissive Mode: Not Supported 00:10:28.281 NVM Sets: Not Supported 00:10:28.281 Read Recovery Levels: Not Supported 00:10:28.281 Endurance Groups: Not Supported 00:10:28.281 Predictable Latency Mode: Not Supported 00:10:28.281 Traffic Based Keep ALive: Not Supported 00:10:28.281 Namespace Granularity: Not Supported 00:10:28.281 SQ Associations: Not Supported 00:10:28.281 UUID List: Not Supported 00:10:28.281 Multi-Domain Subsystem: Not Supported 00:10:28.281 Fixed Capacity Management: Not Supported 00:10:28.281 Variable Capacity Management: Not Supported 00:10:28.281 Delete Endurance Group: Not Supported 00:10:28.281 Delete NVM Set: Not Supported 00:10:28.281 Extended LBA Formats Supported: Not Supported 00:10:28.281 Flexible Data Placement Supported: Not Supported 00:10:28.281 00:10:28.281 Controller Memory Buffer Support 00:10:28.281 ================================ 00:10:28.281 Supported: No 00:10:28.281 00:10:28.281 Persistent Memory Region Support 00:10:28.281 ================================ 00:10:28.281 Supported: No 00:10:28.281 00:10:28.281 Admin Command Set Attributes 00:10:28.281 ============================ 00:10:28.281 Security Send/Receive: Not Supported 00:10:28.281 Format NVM: Not Supported 00:10:28.281 Firmware Activate/Download: Not Supported 00:10:28.281 Namespace Management: Not Supported 00:10:28.281 Device Self-Test: Not Supported 00:10:28.281 Directives: Not Supported 00:10:28.281 NVMe-MI: Not Supported 00:10:28.281 Virtualization Management: Not Supported 00:10:28.281 Doorbell Buffer Config: Not Supported 00:10:28.281 Get LBA Status Capability: Not Supported 00:10:28.281 Command & Feature Lockdown Capability: Not Supported 00:10:28.281 Abort Command Limit: 4 00:10:28.281 Async Event Request Limit: 4 00:10:28.281 Number of Firmware Slots: N/A 00:10:28.281 Firmware Slot 1 Read-Only: N/A 00:10:28.281 Firmware Activation Without Reset: N/A 00:10:28.281 Multiple Update Detection Support: N/A 00:10:28.281 Firmware Update Granularity: No Information Provided 00:10:28.281 Per-Namespace SMART Log: No 00:10:28.281 Asymmetric Namespace Access Log Page: Not Supported 00:10:28.281 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:10:28.281 Command Effects Log Page: Supported 00:10:28.281 Get Log Page Extended Data: Supported 00:10:28.281 Telemetry Log Pages: Not Supported 00:10:28.281 Persistent Event Log Pages: Not Supported 00:10:28.281 Supported Log Pages Log Page: May Support 00:10:28.281 Commands Supported & Effects Log Page: Not Supported 00:10:28.281 Feature Identifiers & Effects Log Page:May Support 00:10:28.281 NVMe-MI Commands & Effects Log Page: May Support 00:10:28.281 Data Area 4 for Telemetry Log: Not Supported 00:10:28.281 Error Log Page Entries Supported: 128 00:10:28.281 Keep Alive: Supported 00:10:28.281 Keep Alive Granularity: 10000 ms 00:10:28.281 00:10:28.281 NVM Command Set Attributes 00:10:28.282 ========================== 00:10:28.282 Submission Queue Entry Size 00:10:28.282 Max: 64 00:10:28.282 Min: 64 00:10:28.282 Completion Queue Entry Size 00:10:28.282 Max: 16 00:10:28.282 Min: 16 00:10:28.282 Number of Namespaces: 32 00:10:28.282 Compare Command: Supported 00:10:28.282 Write Uncorrectable Command: Not Supported 00:10:28.282 Dataset Management Command: Supported 00:10:28.282 Write Zeroes Command: Supported 00:10:28.282 Set Features Save Field: Not Supported 00:10:28.282 Reservations: Not Supported 00:10:28.282 Timestamp: Not Supported 00:10:28.282 Copy: Supported 00:10:28.282 Volatile Write Cache: Present 00:10:28.282 Atomic Write Unit (Normal): 1 00:10:28.282 Atomic Write Unit (PFail): 1 00:10:28.282 Atomic Compare & Write Unit: 1 00:10:28.282 Fused Compare & Write: Supported 00:10:28.282 Scatter-Gather List 00:10:28.282 SGL Command Set: Supported (Dword aligned) 00:10:28.282 SGL Keyed: Not Supported 00:10:28.282 SGL Bit Bucket Descriptor: Not Supported 00:10:28.282 SGL Metadata Pointer: Not Supported 00:10:28.282 Oversized SGL: Not Supported 00:10:28.282 SGL Metadata Address: Not Supported 00:10:28.282 SGL Offset: Not Supported 00:10:28.282 Transport SGL Data Block: Not Supported 00:10:28.282 Replay Protected Memory Block: Not Supported 00:10:28.282 00:10:28.282 Firmware Slot Information 00:10:28.282 ========================= 00:10:28.282 Active slot: 1 00:10:28.282 Slot 1 Firmware Revision: 24.05 00:10:28.282 00:10:28.282 00:10:28.282 Commands Supported and Effects 00:10:28.282 ============================== 00:10:28.282 Admin Commands 00:10:28.282 -------------- 00:10:28.282 Get Log Page (02h): Supported 00:10:28.282 Identify (06h): Supported 00:10:28.282 Abort (08h): Supported 00:10:28.282 Set Features (09h): Supported 00:10:28.282 Get Features (0Ah): Supported 00:10:28.282 Asynchronous Event Request (0Ch): Supported 00:10:28.282 Keep Alive (18h): Supported 00:10:28.282 I/O Commands 00:10:28.282 ------------ 00:10:28.282 Flush (00h): Supported LBA-Change 00:10:28.282 Write (01h): Supported LBA-Change 00:10:28.282 Read (02h): Supported 00:10:28.282 Compare (05h): Supported 00:10:28.282 Write Zeroes (08h): Supported LBA-Change 00:10:28.282 Dataset Management (09h): Supported LBA-Change 00:10:28.282 Copy (19h): Supported LBA-Change 00:10:28.282 Unknown (79h): Supported LBA-Change 00:10:28.282 Unknown (7Ah): Supported 00:10:28.282 00:10:28.282 Error Log 00:10:28.282 ========= 00:10:28.282 00:10:28.282 Arbitration 00:10:28.282 =========== 00:10:28.282 Arbitration Burst: 1 00:10:28.282 00:10:28.282 Power Management 00:10:28.282 ================ 00:10:28.282 Number of Power States: 1 00:10:28.282 Current Power State: Power State #0 00:10:28.282 Power State #0: 00:10:28.282 Max Power: 0.00 W 00:10:28.282 Non-Operational State: Operational 00:10:28.282 Entry Latency: Not Reported 00:10:28.282 Exit Latency: Not Reported 00:10:28.282 Relative Read Throughput: 0 00:10:28.282 Relative Read Latency: 0 00:10:28.282 Relative Write Throughput: 0 00:10:28.282 Relative Write Latency: 0 00:10:28.282 Idle Power: Not Reported 00:10:28.282 Active Power: Not Reported 00:10:28.282 Non-Operational Permissive Mode: Not Supported 00:10:28.282 00:10:28.282 Health Information 00:10:28.282 ================== 00:10:28.282 Critical Warnings: 00:10:28.282 Available Spare Space: OK 00:10:28.282 Temperature: OK 00:10:28.282 Device Reliability: OK 00:10:28.282 Read Only: No 00:10:28.282 Volatile Memory Backup: OK 00:10:28.282 Current Temperature: 0 Kelvin (-2[2024-04-27 03:21:53.169440] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:10:28.282 [2024-04-27 03:21:53.177259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:10:28.282 [2024-04-27 03:21:53.177303] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:10:28.282 [2024-04-27 03:21:53.177320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:10:28.282 [2024-04-27 03:21:53.177331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:10:28.282 [2024-04-27 03:21:53.177341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:10:28.282 [2024-04-27 03:21:53.177351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:10:28.282 [2024-04-27 03:21:53.177437] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:10:28.282 [2024-04-27 03:21:53.177458] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:10:28.282 [2024-04-27 03:21:53.178432] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:10:28.282 [2024-04-27 03:21:53.178505] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:10:28.282 [2024-04-27 03:21:53.178520] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:10:28.282 [2024-04-27 03:21:53.179448] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:10:28.282 [2024-04-27 03:21:53.179473] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:10:28.282 [2024-04-27 03:21:53.179526] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:10:28.282 [2024-04-27 03:21:53.180774] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:10:28.282 73 Celsius) 00:10:28.282 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:10:28.282 Available Spare: 0% 00:10:28.282 Available Spare Threshold: 0% 00:10:28.282 Life Percentage Used: 0% 00:10:28.282 Data Units Read: 0 00:10:28.282 Data Units Written: 0 00:10:28.282 Host Read Commands: 0 00:10:28.282 Host Write Commands: 0 00:10:28.282 Controller Busy Time: 0 minutes 00:10:28.282 Power Cycles: 0 00:10:28.282 Power On Hours: 0 hours 00:10:28.282 Unsafe Shutdowns: 0 00:10:28.282 Unrecoverable Media Errors: 0 00:10:28.282 Lifetime Error Log Entries: 0 00:10:28.282 Warning Temperature Time: 0 minutes 00:10:28.282 Critical Temperature Time: 0 minutes 00:10:28.282 00:10:28.282 Number of Queues 00:10:28.282 ================ 00:10:28.282 Number of I/O Submission Queues: 127 00:10:28.282 Number of I/O Completion Queues: 127 00:10:28.282 00:10:28.282 Active Namespaces 00:10:28.282 ================= 00:10:28.282 Namespace ID:1 00:10:28.282 Error Recovery Timeout: Unlimited 00:10:28.282 Command Set Identifier: NVM (00h) 00:10:28.282 Deallocate: Supported 00:10:28.282 Deallocated/Unwritten Error: Not Supported 00:10:28.282 Deallocated Read Value: Unknown 00:10:28.282 Deallocate in Write Zeroes: Not Supported 00:10:28.282 Deallocated Guard Field: 0xFFFF 00:10:28.282 Flush: Supported 00:10:28.282 Reservation: Supported 00:10:28.282 Namespace Sharing Capabilities: Multiple Controllers 00:10:28.282 Size (in LBAs): 131072 (0GiB) 00:10:28.282 Capacity (in LBAs): 131072 (0GiB) 00:10:28.282 Utilization (in LBAs): 131072 (0GiB) 00:10:28.282 NGUID: 534909308D2C49D288DFC8946AA39B34 00:10:28.282 UUID: 53490930-8d2c-49d2-88df-c8946aa39b34 00:10:28.282 Thin Provisioning: Not Supported 00:10:28.282 Per-NS Atomic Units: Yes 00:10:28.282 Atomic Boundary Size (Normal): 0 00:10:28.282 Atomic Boundary Size (PFail): 0 00:10:28.282 Atomic Boundary Offset: 0 00:10:28.282 Maximum Single Source Range Length: 65535 00:10:28.282 Maximum Copy Length: 65535 00:10:28.282 Maximum Source Range Count: 1 00:10:28.282 NGUID/EUI64 Never Reused: No 00:10:28.282 Namespace Write Protected: No 00:10:28.282 Number of LBA Formats: 1 00:10:28.282 Current LBA Format: LBA Format #00 00:10:28.282 LBA Format #00: Data Size: 512 Metadata Size: 0 00:10:28.282 00:10:28.282 03:21:53 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:10:28.282 EAL: No free 2048 kB hugepages reported on node 1 00:10:28.540 [2024-04-27 03:21:53.406025] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:10:33.816 [2024-04-27 03:21:58.514595] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:10:33.816 Initializing NVMe Controllers 00:10:33.816 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:10:33.816 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:10:33.816 Initialization complete. Launching workers. 00:10:33.816 ======================================================== 00:10:33.816 Latency(us) 00:10:33.816 Device Information : IOPS MiB/s Average min max 00:10:33.816 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36146.00 141.20 3541.96 1146.03 9508.44 00:10:33.816 ======================================================== 00:10:33.816 Total : 36146.00 141.20 3541.96 1146.03 9508.44 00:10:33.816 00:10:33.816 03:21:58 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:10:33.816 EAL: No free 2048 kB hugepages reported on node 1 00:10:33.816 [2024-04-27 03:21:58.746244] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:10:39.107 [2024-04-27 03:22:03.770168] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:10:39.107 Initializing NVMe Controllers 00:10:39.107 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:10:39.107 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:10:39.107 Initialization complete. Launching workers. 00:10:39.107 ======================================================== 00:10:39.107 Latency(us) 00:10:39.107 Device Information : IOPS MiB/s Average min max 00:10:39.107 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 32337.27 126.32 3957.54 1200.12 7799.10 00:10:39.107 ======================================================== 00:10:39.107 Total : 32337.27 126.32 3957.54 1200.12 7799.10 00:10:39.107 00:10:39.107 03:22:03 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:10:39.107 EAL: No free 2048 kB hugepages reported on node 1 00:10:39.107 [2024-04-27 03:22:03.968077] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:10:44.402 [2024-04-27 03:22:09.104382] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:10:44.402 Initializing NVMe Controllers 00:10:44.402 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:10:44.402 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:10:44.402 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:10:44.402 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:10:44.402 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:10:44.402 Initialization complete. Launching workers. 00:10:44.402 Starting thread on core 2 00:10:44.402 Starting thread on core 3 00:10:44.402 Starting thread on core 1 00:10:44.402 03:22:09 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:10:44.402 EAL: No free 2048 kB hugepages reported on node 1 00:10:44.661 [2024-04-27 03:22:09.397705] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:10:48.846 [2024-04-27 03:22:13.116723] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:10:48.846 Initializing NVMe Controllers 00:10:48.846 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:10:48.846 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:10:48.846 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:10:48.846 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:10:48.846 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:10:48.846 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:10:48.846 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:10:48.846 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:10:48.846 Initialization complete. Launching workers. 00:10:48.846 Starting thread on core 1 with urgent priority queue 00:10:48.846 Starting thread on core 2 with urgent priority queue 00:10:48.846 Starting thread on core 3 with urgent priority queue 00:10:48.846 Starting thread on core 0 with urgent priority queue 00:10:48.846 SPDK bdev Controller (SPDK2 ) core 0: 5197.33 IO/s 19.24 secs/100000 ios 00:10:48.846 SPDK bdev Controller (SPDK2 ) core 1: 6092.00 IO/s 16.41 secs/100000 ios 00:10:48.846 SPDK bdev Controller (SPDK2 ) core 2: 5847.67 IO/s 17.10 secs/100000 ios 00:10:48.846 SPDK bdev Controller (SPDK2 ) core 3: 5993.00 IO/s 16.69 secs/100000 ios 00:10:48.846 ======================================================== 00:10:48.846 00:10:48.846 03:22:13 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:10:48.846 EAL: No free 2048 kB hugepages reported on node 1 00:10:48.846 [2024-04-27 03:22:13.409831] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:10:48.846 [2024-04-27 03:22:13.418886] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:10:48.846 Initializing NVMe Controllers 00:10:48.846 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:10:48.846 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:10:48.846 Namespace ID: 1 size: 0GB 00:10:48.846 Initialization complete. 00:10:48.846 INFO: using host memory buffer for IO 00:10:48.846 Hello world! 00:10:48.846 03:22:13 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:10:48.846 EAL: No free 2048 kB hugepages reported on node 1 00:10:48.846 [2024-04-27 03:22:13.693611] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:10:50.218 Initializing NVMe Controllers 00:10:50.218 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:10:50.218 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:10:50.218 Initialization complete. Launching workers. 00:10:50.218 submit (in ns) avg, min, max = 7436.8, 3594.4, 4002833.3 00:10:50.218 complete (in ns) avg, min, max = 25522.1, 2041.1, 4016523.3 00:10:50.218 00:10:50.218 Submit histogram 00:10:50.218 ================ 00:10:50.218 Range in us Cumulative Count 00:10:50.218 3.579 - 3.603: 0.0792% ( 11) 00:10:50.218 3.603 - 3.627: 1.8068% ( 240) 00:10:50.218 3.627 - 3.650: 8.8252% ( 975) 00:10:50.218 3.650 - 3.674: 19.9251% ( 1542) 00:10:50.218 3.674 - 3.698: 32.5583% ( 1755) 00:10:50.218 3.698 - 3.721: 42.5857% ( 1393) 00:10:50.218 3.721 - 3.745: 49.7193% ( 991) 00:10:50.218 3.745 - 3.769: 53.9231% ( 584) 00:10:50.218 3.769 - 3.793: 57.9758% ( 563) 00:10:50.218 3.793 - 3.816: 61.6614% ( 512) 00:10:50.218 3.816 - 3.840: 64.5479% ( 401) 00:10:50.218 3.840 - 3.864: 67.2833% ( 380) 00:10:50.218 3.864 - 3.887: 70.6234% ( 464) 00:10:50.218 3.887 - 3.911: 75.5543% ( 685) 00:10:50.218 3.911 - 3.935: 80.8595% ( 737) 00:10:50.218 3.935 - 3.959: 84.8474% ( 554) 00:10:50.218 3.959 - 3.982: 86.8413% ( 277) 00:10:50.218 3.982 - 4.006: 88.3242% ( 206) 00:10:50.218 4.006 - 4.030: 89.7207% ( 194) 00:10:50.218 4.030 - 4.053: 90.7645% ( 145) 00:10:50.218 4.053 - 4.077: 91.6211% ( 119) 00:10:50.218 4.077 - 4.101: 92.2905% ( 93) 00:10:50.218 4.101 - 4.124: 93.1327% ( 117) 00:10:50.218 4.124 - 4.148: 94.2053% ( 149) 00:10:50.218 4.148 - 4.172: 94.9251% ( 100) 00:10:50.218 4.172 - 4.196: 95.4362% ( 71) 00:10:50.218 4.196 - 4.219: 95.8537% ( 58) 00:10:50.218 4.219 - 4.243: 96.1345% ( 39) 00:10:50.218 4.243 - 4.267: 96.3288% ( 27) 00:10:50.218 4.267 - 4.290: 96.4152% ( 12) 00:10:50.218 4.290 - 4.314: 96.5376% ( 17) 00:10:50.218 4.314 - 4.338: 96.6384% ( 14) 00:10:50.218 4.338 - 4.361: 96.7463% ( 15) 00:10:50.218 4.361 - 4.385: 96.8543% ( 15) 00:10:50.218 4.385 - 4.409: 96.9191% ( 9) 00:10:50.218 4.409 - 4.433: 96.9983% ( 11) 00:10:50.218 4.433 - 4.456: 97.0631% ( 9) 00:10:50.218 4.456 - 4.480: 97.0990% ( 5) 00:10:50.218 4.480 - 4.504: 97.1566% ( 8) 00:10:50.218 4.504 - 4.527: 97.2142% ( 8) 00:10:50.218 4.527 - 4.551: 97.2502% ( 5) 00:10:50.218 4.551 - 4.575: 97.2574% ( 1) 00:10:50.218 4.622 - 4.646: 97.2646% ( 1) 00:10:50.218 4.670 - 4.693: 97.2862% ( 3) 00:10:50.218 4.693 - 4.717: 97.3006% ( 2) 00:10:50.218 4.717 - 4.741: 97.3150% ( 2) 00:10:50.218 4.741 - 4.764: 97.3366% ( 3) 00:10:50.218 4.764 - 4.788: 97.3654% ( 4) 00:10:50.218 4.788 - 4.812: 97.4086% ( 6) 00:10:50.218 4.812 - 4.836: 97.4878% ( 11) 00:10:50.218 4.836 - 4.859: 97.5453% ( 8) 00:10:50.218 4.859 - 4.883: 97.5957% ( 7) 00:10:50.218 4.883 - 4.907: 97.6821% ( 12) 00:10:50.218 4.907 - 4.930: 97.7829% ( 14) 00:10:50.218 4.930 - 4.954: 97.8117% ( 4) 00:10:50.218 4.954 - 4.978: 97.8621% ( 7) 00:10:50.218 4.978 - 5.001: 97.8765% ( 2) 00:10:50.218 5.001 - 5.025: 97.9413% ( 9) 00:10:50.218 5.025 - 5.049: 97.9701% ( 4) 00:10:50.218 5.049 - 5.073: 97.9988% ( 4) 00:10:50.218 5.073 - 5.096: 98.0276% ( 4) 00:10:50.218 5.096 - 5.120: 98.0564% ( 4) 00:10:50.218 5.120 - 5.144: 98.0924% ( 5) 00:10:50.218 5.144 - 5.167: 98.1140% ( 3) 00:10:50.218 5.191 - 5.215: 98.1428% ( 4) 00:10:50.219 5.215 - 5.239: 98.1572% ( 2) 00:10:50.219 5.239 - 5.262: 98.1644% ( 1) 00:10:50.219 5.286 - 5.310: 98.1716% ( 1) 00:10:50.219 5.310 - 5.333: 98.1788% ( 1) 00:10:50.219 5.333 - 5.357: 98.1932% ( 2) 00:10:50.219 5.357 - 5.381: 98.2004% ( 1) 00:10:50.219 5.452 - 5.476: 98.2076% ( 1) 00:10:50.219 5.476 - 5.499: 98.2220% ( 2) 00:10:50.219 5.499 - 5.523: 98.2364% ( 2) 00:10:50.219 5.523 - 5.547: 98.2580% ( 3) 00:10:50.219 5.547 - 5.570: 98.2652% ( 1) 00:10:50.219 5.570 - 5.594: 98.2724% ( 1) 00:10:50.219 5.665 - 5.689: 98.2796% ( 1) 00:10:50.219 5.713 - 5.736: 98.2868% ( 1) 00:10:50.219 5.736 - 5.760: 98.2940% ( 1) 00:10:50.219 5.879 - 5.902: 98.3084% ( 2) 00:10:50.219 5.926 - 5.950: 98.3228% ( 2) 00:10:50.219 5.950 - 5.973: 98.3372% ( 2) 00:10:50.219 5.973 - 5.997: 98.3588% ( 3) 00:10:50.219 5.997 - 6.021: 98.3660% ( 1) 00:10:50.219 6.044 - 6.068: 98.3732% ( 1) 00:10:50.219 6.116 - 6.163: 98.3804% ( 1) 00:10:50.219 6.163 - 6.210: 98.3876% ( 1) 00:10:50.219 6.210 - 6.258: 98.4020% ( 2) 00:10:50.219 6.258 - 6.305: 98.4164% ( 2) 00:10:50.219 6.305 - 6.353: 98.4308% ( 2) 00:10:50.219 6.353 - 6.400: 98.4379% ( 1) 00:10:50.219 6.400 - 6.447: 98.4451% ( 1) 00:10:50.219 6.447 - 6.495: 98.4523% ( 1) 00:10:50.219 6.495 - 6.542: 98.4595% ( 1) 00:10:50.219 6.542 - 6.590: 98.4667% ( 1) 00:10:50.219 6.732 - 6.779: 98.4811% ( 2) 00:10:50.219 6.874 - 6.921: 98.4883% ( 1) 00:10:50.219 7.111 - 7.159: 98.5099% ( 3) 00:10:50.219 7.159 - 7.206: 98.5243% ( 2) 00:10:50.219 7.253 - 7.301: 98.5315% ( 1) 00:10:50.219 7.348 - 7.396: 98.5387% ( 1) 00:10:50.219 7.396 - 7.443: 98.5459% ( 1) 00:10:50.219 7.538 - 7.585: 98.5531% ( 1) 00:10:50.219 7.585 - 7.633: 98.5675% ( 2) 00:10:50.219 7.680 - 7.727: 98.5819% ( 2) 00:10:50.219 7.727 - 7.775: 98.5963% ( 2) 00:10:50.219 7.775 - 7.822: 98.6035% ( 1) 00:10:50.219 7.870 - 7.917: 98.6179% ( 2) 00:10:50.219 7.917 - 7.964: 98.6251% ( 1) 00:10:50.219 7.964 - 8.012: 98.6467% ( 3) 00:10:50.219 8.012 - 8.059: 98.6755% ( 4) 00:10:50.219 8.059 - 8.107: 98.6899% ( 2) 00:10:50.219 8.154 - 8.201: 98.7043% ( 2) 00:10:50.219 8.296 - 8.344: 98.7115% ( 1) 00:10:50.219 8.344 - 8.391: 98.7187% ( 1) 00:10:50.219 8.439 - 8.486: 98.7259% ( 1) 00:10:50.219 8.581 - 8.628: 98.7403% ( 2) 00:10:50.219 8.770 - 8.818: 98.7475% ( 1) 00:10:50.219 8.818 - 8.865: 98.7547% ( 1) 00:10:50.219 9.055 - 9.102: 98.7619% ( 1) 00:10:50.219 9.244 - 9.292: 98.7691% ( 1) 00:10:50.219 9.624 - 9.671: 98.7763% ( 1) 00:10:50.219 9.671 - 9.719: 98.7835% ( 1) 00:10:50.219 10.003 - 10.050: 98.7907% ( 1) 00:10:50.219 10.193 - 10.240: 98.7979% ( 1) 00:10:50.219 10.951 - 10.999: 98.8051% ( 1) 00:10:50.219 11.330 - 11.378: 98.8123% ( 1) 00:10:50.219 11.473 - 11.520: 98.8195% ( 1) 00:10:50.219 11.757 - 11.804: 98.8267% ( 1) 00:10:50.219 11.947 - 11.994: 98.8339% ( 1) 00:10:50.219 12.041 - 12.089: 98.8411% ( 1) 00:10:50.219 12.136 - 12.231: 98.8483% ( 1) 00:10:50.219 12.516 - 12.610: 98.8555% ( 1) 00:10:50.219 12.610 - 12.705: 98.8627% ( 1) 00:10:50.219 12.990 - 13.084: 98.8699% ( 1) 00:10:50.219 13.084 - 13.179: 98.8771% ( 1) 00:10:50.219 13.179 - 13.274: 98.8842% ( 1) 00:10:50.219 13.274 - 13.369: 98.8914% ( 1) 00:10:50.219 13.938 - 14.033: 98.8986% ( 1) 00:10:50.219 14.222 - 14.317: 98.9130% ( 2) 00:10:50.219 14.791 - 14.886: 98.9202% ( 1) 00:10:50.219 14.981 - 15.076: 98.9274% ( 1) 00:10:50.219 15.739 - 15.834: 98.9346% ( 1) 00:10:50.219 16.024 - 16.119: 98.9490% ( 2) 00:10:50.219 16.687 - 16.782: 98.9562% ( 1) 00:10:50.219 17.067 - 17.161: 98.9634% ( 1) 00:10:50.219 17.161 - 17.256: 98.9706% ( 1) 00:10:50.219 17.351 - 17.446: 98.9778% ( 1) 00:10:50.219 17.446 - 17.541: 99.0066% ( 4) 00:10:50.219 17.541 - 17.636: 99.0426% ( 5) 00:10:50.219 17.636 - 17.730: 99.0714% ( 4) 00:10:50.219 17.730 - 17.825: 99.1362% ( 9) 00:10:50.219 17.825 - 17.920: 99.1722% ( 5) 00:10:50.219 17.920 - 18.015: 99.2370% ( 9) 00:10:50.219 18.015 - 18.110: 99.3090% ( 10) 00:10:50.219 18.110 - 18.204: 99.3737% ( 9) 00:10:50.219 18.204 - 18.299: 99.4673% ( 13) 00:10:50.219 18.299 - 18.394: 99.5321% ( 9) 00:10:50.219 18.394 - 18.489: 99.6041% ( 10) 00:10:50.219 18.489 - 18.584: 99.6545% ( 7) 00:10:50.219 18.584 - 18.679: 99.6977% ( 6) 00:10:50.219 18.679 - 18.773: 99.7265% ( 4) 00:10:50.219 18.773 - 18.868: 99.7337% ( 1) 00:10:50.219 18.868 - 18.963: 99.7481% ( 2) 00:10:50.219 18.963 - 19.058: 99.7768% ( 4) 00:10:50.219 19.058 - 19.153: 99.7984% ( 3) 00:10:50.219 19.153 - 19.247: 99.8200% ( 3) 00:10:50.219 19.342 - 19.437: 99.8272% ( 1) 00:10:50.219 19.437 - 19.532: 99.8344% ( 1) 00:10:50.219 19.532 - 19.627: 99.8416% ( 1) 00:10:50.219 19.721 - 19.816: 99.8488% ( 1) 00:10:50.219 19.816 - 19.911: 99.8632% ( 2) 00:10:50.219 20.385 - 20.480: 99.8704% ( 1) 00:10:50.219 20.764 - 20.859: 99.8776% ( 1) 00:10:50.219 21.523 - 21.618: 99.8848% ( 1) 00:10:50.219 21.713 - 21.807: 99.8920% ( 1) 00:10:50.219 21.902 - 21.997: 99.8992% ( 1) 00:10:50.219 22.850 - 22.945: 99.9064% ( 1) 00:10:50.219 23.040 - 23.135: 99.9136% ( 1) 00:10:50.219 3980.705 - 4004.978: 100.0000% ( 12) 00:10:50.219 00:10:50.219 Complete histogram 00:10:50.219 ================== 00:10:50.219 Range in us Cumulative Count 00:10:50.219 2.039 - 2.050: 3.9303% ( 546) 00:10:50.219 2.050 - 2.062: 14.5191% ( 1471) 00:10:50.219 2.062 - 2.074: 16.6139% ( 291) 00:10:50.219 2.074 - 2.086: 38.0003% ( 2971) 00:10:50.219 2.086 - 2.098: 58.3861% ( 2832) 00:10:50.219 2.098 - 2.110: 61.8126% ( 476) 00:10:50.219 2.110 - 2.121: 65.8437% ( 560) 00:10:50.219 2.121 - 2.133: 67.5281% ( 234) 00:10:50.219 2.133 - 2.145: 68.6870% ( 161) 00:10:50.219 2.145 - 2.157: 75.7630% ( 983) 00:10:50.219 2.157 - 2.169: 80.3484% ( 637) 00:10:50.219 2.169 - 2.181: 81.4138% ( 148) 00:10:50.219 2.181 - 2.193: 83.0406% ( 226) 00:10:50.219 2.193 - 2.204: 84.5955% ( 216) 00:10:50.219 2.204 - 2.216: 85.5024% ( 126) 00:10:50.219 2.216 - 2.228: 89.6559% ( 577) 00:10:50.219 2.228 - 2.240: 92.9888% ( 463) 00:10:50.219 2.240 - 2.252: 93.7590% ( 107) 00:10:50.219 2.252 - 2.264: 94.4141% ( 91) 00:10:50.219 2.264 - 2.276: 94.7812% ( 51) 00:10:50.219 2.276 - 2.287: 94.9539% ( 24) 00:10:50.219 2.287 - 2.299: 95.2203% ( 37) 00:10:50.219 2.299 - 2.311: 95.4434% ( 31) 00:10:50.220 2.311 - 2.323: 95.6234% ( 25) 00:10:50.220 2.323 - 2.335: 95.7026% ( 11) 00:10:50.220 2.335 - 2.347: 95.8537% ( 21) 00:10:50.220 2.347 - 2.359: 96.0481% ( 27) 00:10:50.220 2.359 - 2.370: 96.2712% ( 31) 00:10:50.220 2.370 - 2.382: 96.4656% ( 27) 00:10:50.220 2.382 - 2.394: 96.8183% ( 49) 00:10:50.220 2.394 - 2.406: 97.1062% ( 40) 00:10:50.220 2.406 - 2.418: 97.2214% ( 16) 00:10:50.220 2.418 - 2.430: 97.3942% ( 24) 00:10:50.220 2.430 - 2.441: 97.5166% ( 17) 00:10:50.220 2.441 - 2.453: 97.6101% ( 13) 00:10:50.220 2.453 - 2.465: 97.7973% ( 26) 00:10:50.220 2.465 - 2.477: 97.9269% ( 18) 00:10:50.220 2.477 - 2.489: 98.0132% ( 12) 00:10:50.220 2.489 - 2.501: 98.0780% ( 9) 00:10:50.220 2.501 - 2.513: 98.1500% ( 10) 00:10:50.220 2.513 - 2.524: 98.1716% ( 3) 00:10:50.220 2.524 - 2.536: 98.1932% ( 3) 00:10:50.220 2.536 - 2.548: 98.2220% ( 4) 00:10:50.220 2.548 - 2.560: 98.2364% ( 2) 00:10:50.220 2.560 - 2.572: 98.2580% ( 3) 00:10:50.220 2.572 - 2.584: 98.2652% ( 1) 00:10:50.220 2.596 - 2.607: 98.2940% ( 4) 00:10:50.220 2.619 - 2.631: 98.3012% ( 1) 00:10:50.220 2.655 - 2.667: 98.3156% ( 2) 00:10:50.220 2.679 - 2.690: 98.3300% ( 2) 00:10:50.220 2.714 - 2.726: 98.3372% ( 1) 00:10:50.220 2.773 - 2.785: 98.3444% ( 1) 00:10:50.220 2.785 - 2.797: 98.3588% ( 2) 00:10:50.220 2.809 - 2.821: 98.3732% ( 2) 00:10:50.220 2.821 - 2.833: 98.3948% ( 3) 00:10:50.220 2.833 - 2.844: 98.4164% ( 3) 00:10:50.220 2.844 - 2.856: 98.4236% ( 1) 00:10:50.220 2.868 - 2.880: 98.4308% ( 1) 00:10:50.220 2.880 - 2.892: 98.4379% ( 1) 00:10:50.220 2.904 - 2.916: 98.4451% ( 1) 00:10:50.220 2.916 - 2.927: 98.4667% ( 3) 00:10:50.220 2.927 - 2.939: 98.4739% ( 1) 00:10:50.220 2.939 - 2.951: 98.4955% ( 3) 00:10:50.220 2.975 - 2.987: 98.5027% ( 1) 00:10:50.220 2.999 - 3.010: 98.5099% ( 1) 00:10:50.220 3.010 - 3.022: 98.5171% ( 1) 00:10:50.220 3.022 - 3.034: 98.5243% ( 1) 00:10:50.220 3.034 - 3.058: 98.5315% ( 1) 00:10:50.220 3.058 - 3.081: 98.5387% ( 1) 00:10:50.220 3.366 - 3.390: 98.5531% ( 2) 00:10:50.220 3.413 - 3.437: 9[2024-04-27 03:22:14.788029] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:10:50.220 8.5747% ( 3) 00:10:50.220 3.437 - 3.461: 98.5963% ( 3) 00:10:50.220 3.461 - 3.484: 98.6179% ( 3) 00:10:50.220 3.484 - 3.508: 98.6323% ( 2) 00:10:50.220 3.508 - 3.532: 98.6395% ( 1) 00:10:50.220 3.532 - 3.556: 98.6611% ( 3) 00:10:50.220 3.556 - 3.579: 98.6683% ( 1) 00:10:50.220 3.579 - 3.603: 98.6899% ( 3) 00:10:50.220 3.603 - 3.627: 98.6971% ( 1) 00:10:50.220 3.650 - 3.674: 98.7043% ( 1) 00:10:50.220 3.674 - 3.698: 98.7259% ( 3) 00:10:50.220 3.721 - 3.745: 98.7331% ( 1) 00:10:50.220 3.769 - 3.793: 98.7475% ( 2) 00:10:50.220 4.172 - 4.196: 98.7547% ( 1) 00:10:50.220 4.883 - 4.907: 98.7619% ( 1) 00:10:50.220 5.310 - 5.333: 98.7691% ( 1) 00:10:50.220 5.476 - 5.499: 98.7763% ( 1) 00:10:50.220 5.665 - 5.689: 98.7835% ( 1) 00:10:50.220 5.855 - 5.879: 98.7979% ( 2) 00:10:50.220 5.997 - 6.021: 98.8051% ( 1) 00:10:50.220 6.068 - 6.116: 98.8123% ( 1) 00:10:50.220 6.163 - 6.210: 98.8195% ( 1) 00:10:50.220 6.210 - 6.258: 98.8267% ( 1) 00:10:50.220 6.353 - 6.400: 98.8339% ( 1) 00:10:50.220 6.400 - 6.447: 98.8411% ( 1) 00:10:50.220 6.495 - 6.542: 98.8483% ( 1) 00:10:50.220 6.542 - 6.590: 98.8699% ( 3) 00:10:50.220 6.590 - 6.637: 98.8771% ( 1) 00:10:50.220 6.684 - 6.732: 98.8914% ( 2) 00:10:50.220 7.016 - 7.064: 98.8986% ( 1) 00:10:50.220 7.301 - 7.348: 98.9058% ( 1) 00:10:50.220 7.585 - 7.633: 98.9130% ( 1) 00:10:50.220 8.012 - 8.059: 98.9202% ( 1) 00:10:50.220 8.154 - 8.201: 98.9274% ( 1) 00:10:50.220 8.201 - 8.249: 98.9346% ( 1) 00:10:50.220 12.990 - 13.084: 98.9418% ( 1) 00:10:50.220 15.360 - 15.455: 98.9490% ( 1) 00:10:50.220 15.455 - 15.550: 98.9634% ( 2) 00:10:50.220 15.644 - 15.739: 98.9922% ( 4) 00:10:50.220 15.739 - 15.834: 98.9994% ( 1) 00:10:50.220 15.834 - 15.929: 99.0066% ( 1) 00:10:50.220 15.929 - 16.024: 99.0426% ( 5) 00:10:50.220 16.024 - 16.119: 99.0642% ( 3) 00:10:50.220 16.119 - 16.213: 99.1002% ( 5) 00:10:50.220 16.213 - 16.308: 99.1362% ( 5) 00:10:50.220 16.308 - 16.403: 99.1794% ( 6) 00:10:50.220 16.403 - 16.498: 99.2082% ( 4) 00:10:50.220 16.498 - 16.593: 99.2154% ( 1) 00:10:50.220 16.593 - 16.687: 99.2442% ( 4) 00:10:50.220 16.687 - 16.782: 99.2586% ( 2) 00:10:50.220 16.782 - 16.877: 99.3090% ( 7) 00:10:50.220 16.877 - 16.972: 99.3162% ( 1) 00:10:50.220 16.972 - 17.067: 99.3234% ( 1) 00:10:50.220 17.067 - 17.161: 99.3305% ( 1) 00:10:50.220 17.161 - 17.256: 99.3377% ( 1) 00:10:50.220 17.256 - 17.351: 99.3521% ( 2) 00:10:50.220 17.351 - 17.446: 99.3593% ( 1) 00:10:50.220 17.541 - 17.636: 99.3737% ( 2) 00:10:50.220 17.730 - 17.825: 99.3809% ( 1) 00:10:50.220 17.920 - 18.015: 99.3953% ( 2) 00:10:50.220 18.015 - 18.110: 99.4025% ( 1) 00:10:50.220 18.584 - 18.679: 99.4097% ( 1) 00:10:50.220 21.049 - 21.144: 99.4169% ( 1) 00:10:50.220 3980.705 - 4004.978: 99.9280% ( 71) 00:10:50.220 4004.978 - 4029.250: 100.0000% ( 10) 00:10:50.220 00:10:50.220 03:22:14 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:10:50.220 03:22:14 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:10:50.220 03:22:14 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:10:50.220 03:22:14 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:10:50.220 03:22:14 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:10:50.220 [ 00:10:50.220 { 00:10:50.220 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:10:50.220 "subtype": "Discovery", 00:10:50.220 "listen_addresses": [], 00:10:50.220 "allow_any_host": true, 00:10:50.220 "hosts": [] 00:10:50.220 }, 00:10:50.220 { 00:10:50.220 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:10:50.220 "subtype": "NVMe", 00:10:50.220 "listen_addresses": [ 00:10:50.220 { 00:10:50.220 "transport": "VFIOUSER", 00:10:50.220 "trtype": "VFIOUSER", 00:10:50.220 "adrfam": "IPv4", 00:10:50.220 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:10:50.220 "trsvcid": "0" 00:10:50.220 } 00:10:50.220 ], 00:10:50.220 "allow_any_host": true, 00:10:50.220 "hosts": [], 00:10:50.220 "serial_number": "SPDK1", 00:10:50.220 "model_number": "SPDK bdev Controller", 00:10:50.220 "max_namespaces": 32, 00:10:50.220 "min_cntlid": 1, 00:10:50.220 "max_cntlid": 65519, 00:10:50.220 "namespaces": [ 00:10:50.220 { 00:10:50.220 "nsid": 1, 00:10:50.220 "bdev_name": "Malloc1", 00:10:50.220 "name": "Malloc1", 00:10:50.220 "nguid": "294FB7CF818E434897FAADBB2024DA7A", 00:10:50.220 "uuid": "294fb7cf-818e-4348-97fa-adbb2024da7a" 00:10:50.220 }, 00:10:50.220 { 00:10:50.220 "nsid": 2, 00:10:50.220 "bdev_name": "Malloc3", 00:10:50.220 "name": "Malloc3", 00:10:50.220 "nguid": "0CD735556CA14E78B6826AEFD3FE5C23", 00:10:50.221 "uuid": "0cd73555-6ca1-4e78-b682-6aefd3fe5c23" 00:10:50.221 } 00:10:50.221 ] 00:10:50.221 }, 00:10:50.221 { 00:10:50.221 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:10:50.221 "subtype": "NVMe", 00:10:50.221 "listen_addresses": [ 00:10:50.221 { 00:10:50.221 "transport": "VFIOUSER", 00:10:50.221 "trtype": "VFIOUSER", 00:10:50.221 "adrfam": "IPv4", 00:10:50.221 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:10:50.221 "trsvcid": "0" 00:10:50.221 } 00:10:50.221 ], 00:10:50.221 "allow_any_host": true, 00:10:50.221 "hosts": [], 00:10:50.221 "serial_number": "SPDK2", 00:10:50.221 "model_number": "SPDK bdev Controller", 00:10:50.221 "max_namespaces": 32, 00:10:50.221 "min_cntlid": 1, 00:10:50.221 "max_cntlid": 65519, 00:10:50.221 "namespaces": [ 00:10:50.221 { 00:10:50.221 "nsid": 1, 00:10:50.221 "bdev_name": "Malloc2", 00:10:50.221 "name": "Malloc2", 00:10:50.221 "nguid": "534909308D2C49D288DFC8946AA39B34", 00:10:50.221 "uuid": "53490930-8d2c-49d2-88df-c8946aa39b34" 00:10:50.221 } 00:10:50.221 ] 00:10:50.221 } 00:10:50.221 ] 00:10:50.221 03:22:15 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:10:50.221 03:22:15 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1405605 00:10:50.221 03:22:15 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:10:50.221 03:22:15 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:10:50.221 03:22:15 -- common/autotest_common.sh@1251 -- # local i=0 00:10:50.221 03:22:15 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:10:50.221 03:22:15 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:10:50.221 03:22:15 -- common/autotest_common.sh@1262 -- # return 0 00:10:50.221 03:22:15 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:10:50.221 03:22:15 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:10:50.221 EAL: No free 2048 kB hugepages reported on node 1 00:10:50.479 [2024-04-27 03:22:15.240716] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:10:50.479 Malloc4 00:10:50.479 03:22:15 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:10:50.736 [2024-04-27 03:22:15.582340] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:10:50.736 03:22:15 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:10:50.736 Asynchronous Event Request test 00:10:50.736 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:10:50.736 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:10:50.736 Registering asynchronous event callbacks... 00:10:50.736 Starting namespace attribute notice tests for all controllers... 00:10:50.736 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:10:50.736 aer_cb - Changed Namespace 00:10:50.736 Cleaning up... 00:10:50.994 [ 00:10:50.994 { 00:10:50.994 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:10:50.994 "subtype": "Discovery", 00:10:50.994 "listen_addresses": [], 00:10:50.994 "allow_any_host": true, 00:10:50.994 "hosts": [] 00:10:50.994 }, 00:10:50.994 { 00:10:50.994 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:10:50.994 "subtype": "NVMe", 00:10:50.994 "listen_addresses": [ 00:10:50.994 { 00:10:50.994 "transport": "VFIOUSER", 00:10:50.994 "trtype": "VFIOUSER", 00:10:50.994 "adrfam": "IPv4", 00:10:50.994 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:10:50.994 "trsvcid": "0" 00:10:50.994 } 00:10:50.994 ], 00:10:50.994 "allow_any_host": true, 00:10:50.994 "hosts": [], 00:10:50.994 "serial_number": "SPDK1", 00:10:50.994 "model_number": "SPDK bdev Controller", 00:10:50.994 "max_namespaces": 32, 00:10:50.994 "min_cntlid": 1, 00:10:50.994 "max_cntlid": 65519, 00:10:50.994 "namespaces": [ 00:10:50.994 { 00:10:50.994 "nsid": 1, 00:10:50.994 "bdev_name": "Malloc1", 00:10:50.994 "name": "Malloc1", 00:10:50.994 "nguid": "294FB7CF818E434897FAADBB2024DA7A", 00:10:50.994 "uuid": "294fb7cf-818e-4348-97fa-adbb2024da7a" 00:10:50.994 }, 00:10:50.994 { 00:10:50.994 "nsid": 2, 00:10:50.994 "bdev_name": "Malloc3", 00:10:50.994 "name": "Malloc3", 00:10:50.994 "nguid": "0CD735556CA14E78B6826AEFD3FE5C23", 00:10:50.994 "uuid": "0cd73555-6ca1-4e78-b682-6aefd3fe5c23" 00:10:50.994 } 00:10:50.994 ] 00:10:50.994 }, 00:10:50.994 { 00:10:50.994 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:10:50.994 "subtype": "NVMe", 00:10:50.994 "listen_addresses": [ 00:10:50.994 { 00:10:50.994 "transport": "VFIOUSER", 00:10:50.994 "trtype": "VFIOUSER", 00:10:50.994 "adrfam": "IPv4", 00:10:50.994 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:10:50.994 "trsvcid": "0" 00:10:50.994 } 00:10:50.994 ], 00:10:50.994 "allow_any_host": true, 00:10:50.994 "hosts": [], 00:10:50.994 "serial_number": "SPDK2", 00:10:50.994 "model_number": "SPDK bdev Controller", 00:10:50.994 "max_namespaces": 32, 00:10:50.994 "min_cntlid": 1, 00:10:50.994 "max_cntlid": 65519, 00:10:50.994 "namespaces": [ 00:10:50.994 { 00:10:50.994 "nsid": 1, 00:10:50.994 "bdev_name": "Malloc2", 00:10:50.994 "name": "Malloc2", 00:10:50.994 "nguid": "534909308D2C49D288DFC8946AA39B34", 00:10:50.994 "uuid": "53490930-8d2c-49d2-88df-c8946aa39b34" 00:10:50.994 }, 00:10:50.994 { 00:10:50.994 "nsid": 2, 00:10:50.994 "bdev_name": "Malloc4", 00:10:50.994 "name": "Malloc4", 00:10:50.994 "nguid": "99D7D8E21DD442F58B7645BC63D9A33D", 00:10:50.994 "uuid": "99d7d8e2-1dd4-42f5-8b76-45bc63d9a33d" 00:10:50.994 } 00:10:50.994 ] 00:10:50.994 } 00:10:50.994 ] 00:10:50.994 03:22:15 -- target/nvmf_vfio_user.sh@44 -- # wait 1405605 00:10:50.994 03:22:15 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:10:50.994 03:22:15 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1399869 00:10:50.994 03:22:15 -- common/autotest_common.sh@936 -- # '[' -z 1399869 ']' 00:10:50.994 03:22:15 -- common/autotest_common.sh@940 -- # kill -0 1399869 00:10:50.994 03:22:15 -- common/autotest_common.sh@941 -- # uname 00:10:50.994 03:22:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:50.994 03:22:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1399869 00:10:50.994 03:22:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:10:50.994 03:22:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:10:50.994 03:22:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1399869' 00:10:50.994 killing process with pid 1399869 00:10:50.994 03:22:15 -- common/autotest_common.sh@955 -- # kill 1399869 00:10:50.994 [2024-04-27 03:22:15.866349] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:10:50.994 03:22:15 -- common/autotest_common.sh@960 -- # wait 1399869 00:10:51.253 03:22:16 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:10:51.253 03:22:16 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:10:51.253 03:22:16 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:10:51.253 03:22:16 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:10:51.253 03:22:16 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:10:51.253 03:22:16 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1405747 00:10:51.253 03:22:16 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:10:51.253 03:22:16 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1405747' 00:10:51.253 Process pid: 1405747 00:10:51.253 03:22:16 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:10:51.253 03:22:16 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1405747 00:10:51.253 03:22:16 -- common/autotest_common.sh@817 -- # '[' -z 1405747 ']' 00:10:51.253 03:22:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:51.253 03:22:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:51.253 03:22:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:51.253 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:51.253 03:22:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:51.253 03:22:16 -- common/autotest_common.sh@10 -- # set +x 00:10:51.511 [2024-04-27 03:22:16.263276] thread.c:2927:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:10:51.511 [2024-04-27 03:22:16.264329] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:10:51.512 [2024-04-27 03:22:16.264395] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:51.512 EAL: No free 2048 kB hugepages reported on node 1 00:10:51.512 [2024-04-27 03:22:16.325443] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:51.512 [2024-04-27 03:22:16.435754] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:51.512 [2024-04-27 03:22:16.435817] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:51.512 [2024-04-27 03:22:16.435841] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:51.512 [2024-04-27 03:22:16.435855] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:51.512 [2024-04-27 03:22:16.435867] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:51.512 [2024-04-27 03:22:16.435950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:51.512 [2024-04-27 03:22:16.436018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:51.512 [2024-04-27 03:22:16.436109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:51.512 [2024-04-27 03:22:16.436111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:51.770 [2024-04-27 03:22:16.543669] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:10:51.770 [2024-04-27 03:22:16.543932] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:10:51.770 [2024-04-27 03:22:16.544219] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:10:51.770 [2024-04-27 03:22:16.544990] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:10:51.770 [2024-04-27 03:22:16.545108] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:10:52.336 03:22:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:52.336 03:22:17 -- common/autotest_common.sh@850 -- # return 0 00:10:52.336 03:22:17 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:10:53.269 03:22:18 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:10:53.528 03:22:18 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:10:53.528 03:22:18 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:10:53.528 03:22:18 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:10:53.528 03:22:18 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:10:53.528 03:22:18 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:10:53.786 Malloc1 00:10:53.786 03:22:18 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:10:54.352 03:22:19 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:10:54.352 03:22:19 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:10:54.610 03:22:19 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:10:54.610 03:22:19 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:10:54.610 03:22:19 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:10:55.175 Malloc2 00:10:55.175 03:22:19 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:10:55.175 03:22:20 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:10:55.433 03:22:20 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:10:55.690 03:22:20 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:10:55.690 03:22:20 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1405747 00:10:55.691 03:22:20 -- common/autotest_common.sh@936 -- # '[' -z 1405747 ']' 00:10:55.691 03:22:20 -- common/autotest_common.sh@940 -- # kill -0 1405747 00:10:55.691 03:22:20 -- common/autotest_common.sh@941 -- # uname 00:10:55.691 03:22:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:55.691 03:22:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1405747 00:10:55.948 03:22:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:10:55.948 03:22:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:10:55.948 03:22:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1405747' 00:10:55.948 killing process with pid 1405747 00:10:55.948 03:22:20 -- common/autotest_common.sh@955 -- # kill 1405747 00:10:55.948 03:22:20 -- common/autotest_common.sh@960 -- # wait 1405747 00:10:56.207 03:22:21 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:10:56.207 03:22:21 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:10:56.207 00:10:56.207 real 0m53.817s 00:10:56.207 user 3m31.834s 00:10:56.207 sys 0m4.677s 00:10:56.207 03:22:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:56.207 03:22:21 -- common/autotest_common.sh@10 -- # set +x 00:10:56.207 ************************************ 00:10:56.207 END TEST nvmf_vfio_user 00:10:56.207 ************************************ 00:10:56.207 03:22:21 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:10:56.207 03:22:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:56.207 03:22:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:56.207 03:22:21 -- common/autotest_common.sh@10 -- # set +x 00:10:56.207 ************************************ 00:10:56.207 START TEST nvmf_vfio_user_nvme_compliance 00:10:56.207 ************************************ 00:10:56.207 03:22:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:10:56.466 * Looking for test storage... 00:10:56.466 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:10:56.466 03:22:21 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:10:56.466 03:22:21 -- nvmf/common.sh@7 -- # uname -s 00:10:56.466 03:22:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:56.466 03:22:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:56.466 03:22:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:56.466 03:22:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:56.466 03:22:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:56.466 03:22:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:56.466 03:22:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:56.466 03:22:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:56.466 03:22:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:56.466 03:22:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:56.466 03:22:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:10:56.466 03:22:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:10:56.466 03:22:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:56.466 03:22:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:56.466 03:22:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:56.466 03:22:21 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:56.466 03:22:21 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:10:56.466 03:22:21 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:56.466 03:22:21 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:56.466 03:22:21 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:56.466 03:22:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:56.466 03:22:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:56.466 03:22:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:56.466 03:22:21 -- paths/export.sh@5 -- # export PATH 00:10:56.466 03:22:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:56.466 03:22:21 -- nvmf/common.sh@47 -- # : 0 00:10:56.466 03:22:21 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:56.466 03:22:21 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:56.466 03:22:21 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:56.466 03:22:21 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:56.466 03:22:21 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:56.466 03:22:21 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:56.466 03:22:21 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:56.466 03:22:21 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:56.466 03:22:21 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:56.466 03:22:21 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:10:56.466 03:22:21 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:10:56.466 03:22:21 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:10:56.466 03:22:21 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:10:56.466 03:22:21 -- compliance/compliance.sh@20 -- # nvmfpid=1406362 00:10:56.466 03:22:21 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:10:56.466 03:22:21 -- compliance/compliance.sh@21 -- # echo 'Process pid: 1406362' 00:10:56.466 Process pid: 1406362 00:10:56.466 03:22:21 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:10:56.466 03:22:21 -- compliance/compliance.sh@24 -- # waitforlisten 1406362 00:10:56.466 03:22:21 -- common/autotest_common.sh@817 -- # '[' -z 1406362 ']' 00:10:56.466 03:22:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:56.466 03:22:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:56.466 03:22:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:56.466 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:56.466 03:22:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:56.466 03:22:21 -- common/autotest_common.sh@10 -- # set +x 00:10:56.466 [2024-04-27 03:22:21.274037] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:10:56.466 [2024-04-27 03:22:21.274133] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:56.466 EAL: No free 2048 kB hugepages reported on node 1 00:10:56.466 [2024-04-27 03:22:21.330957] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:10:56.466 [2024-04-27 03:22:21.431626] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:56.466 [2024-04-27 03:22:21.431685] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:56.466 [2024-04-27 03:22:21.431709] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:56.466 [2024-04-27 03:22:21.431720] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:56.466 [2024-04-27 03:22:21.431730] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:56.466 [2024-04-27 03:22:21.431790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:56.466 [2024-04-27 03:22:21.431849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:56.466 [2024-04-27 03:22:21.431851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:56.724 03:22:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:56.724 03:22:21 -- common/autotest_common.sh@850 -- # return 0 00:10:56.724 03:22:21 -- compliance/compliance.sh@26 -- # sleep 1 00:10:57.658 03:22:22 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:10:57.658 03:22:22 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:10:57.658 03:22:22 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:10:57.658 03:22:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.658 03:22:22 -- common/autotest_common.sh@10 -- # set +x 00:10:57.658 03:22:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.658 03:22:22 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:10:57.658 03:22:22 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:10:57.658 03:22:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.658 03:22:22 -- common/autotest_common.sh@10 -- # set +x 00:10:57.658 malloc0 00:10:57.658 03:22:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.658 03:22:22 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:10:57.658 03:22:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.658 03:22:22 -- common/autotest_common.sh@10 -- # set +x 00:10:57.659 03:22:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.659 03:22:22 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:10:57.659 03:22:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.659 03:22:22 -- common/autotest_common.sh@10 -- # set +x 00:10:57.659 03:22:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.659 03:22:22 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:10:57.659 03:22:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.659 03:22:22 -- common/autotest_common.sh@10 -- # set +x 00:10:57.659 03:22:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.659 03:22:22 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:10:57.916 EAL: No free 2048 kB hugepages reported on node 1 00:10:57.916 00:10:57.916 00:10:57.916 CUnit - A unit testing framework for C - Version 2.1-3 00:10:57.916 http://cunit.sourceforge.net/ 00:10:57.916 00:10:57.916 00:10:57.916 Suite: nvme_compliance 00:10:57.916 Test: admin_identify_ctrlr_verify_dptr ...[2024-04-27 03:22:22.767837] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:57.916 [2024-04-27 03:22:22.769271] vfio_user.c: 804:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:10:57.917 [2024-04-27 03:22:22.769296] vfio_user.c:5514:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:10:57.917 [2024-04-27 03:22:22.769313] vfio_user.c:5607:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:10:57.917 [2024-04-27 03:22:22.772868] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:57.917 passed 00:10:57.917 Test: admin_identify_ctrlr_verify_fused ...[2024-04-27 03:22:22.858510] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:57.917 [2024-04-27 03:22:22.861546] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:58.173 passed 00:10:58.173 Test: admin_identify_ns ...[2024-04-27 03:22:22.948749] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:58.173 [2024-04-27 03:22:23.009263] ctrlr.c:2656:_nvmf_ctrlr_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:10:58.173 [2024-04-27 03:22:23.017292] ctrlr.c:2656:_nvmf_ctrlr_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:10:58.173 [2024-04-27 03:22:23.038391] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:58.173 passed 00:10:58.173 Test: admin_get_features_mandatory_features ...[2024-04-27 03:22:23.121031] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:58.173 [2024-04-27 03:22:23.124054] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:58.431 passed 00:10:58.431 Test: admin_get_features_optional_features ...[2024-04-27 03:22:23.209628] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:58.431 [2024-04-27 03:22:23.212652] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:58.431 passed 00:10:58.431 Test: admin_set_features_number_of_queues ...[2024-04-27 03:22:23.296780] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:58.431 [2024-04-27 03:22:23.401366] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:58.689 passed 00:10:58.689 Test: admin_get_log_page_mandatory_logs ...[2024-04-27 03:22:23.484523] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:58.689 [2024-04-27 03:22:23.487561] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:58.689 passed 00:10:58.689 Test: admin_get_log_page_with_lpo ...[2024-04-27 03:22:23.569706] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:58.689 [2024-04-27 03:22:23.641277] ctrlr.c:2604:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:10:58.689 [2024-04-27 03:22:23.654334] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:58.947 passed 00:10:58.947 Test: fabric_property_get ...[2024-04-27 03:22:23.735138] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:58.947 [2024-04-27 03:22:23.736437] vfio_user.c:5607:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x7f failed 00:10:58.947 [2024-04-27 03:22:23.740169] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:58.947 passed 00:10:58.947 Test: admin_delete_io_sq_use_admin_qid ...[2024-04-27 03:22:23.821718] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:58.947 [2024-04-27 03:22:23.823008] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:10:58.947 [2024-04-27 03:22:23.826745] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:58.947 passed 00:10:58.947 Test: admin_delete_io_sq_delete_sq_twice ...[2024-04-27 03:22:23.907770] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:59.204 [2024-04-27 03:22:23.992262] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:10:59.204 [2024-04-27 03:22:24.008278] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:10:59.204 [2024-04-27 03:22:24.013376] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:59.204 passed 00:10:59.204 Test: admin_delete_io_cq_use_admin_qid ...[2024-04-27 03:22:24.095559] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:59.204 [2024-04-27 03:22:24.096848] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:10:59.204 [2024-04-27 03:22:24.098579] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:59.204 passed 00:10:59.462 Test: admin_delete_io_cq_delete_cq_first ...[2024-04-27 03:22:24.181821] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:59.462 [2024-04-27 03:22:24.257259] vfio_user.c:2319:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:10:59.462 [2024-04-27 03:22:24.281272] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:10:59.462 [2024-04-27 03:22:24.286365] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:59.462 passed 00:10:59.462 Test: admin_create_io_cq_verify_iv_pc ...[2024-04-27 03:22:24.371675] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:59.462 [2024-04-27 03:22:24.372967] vfio_user.c:2158:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:10:59.462 [2024-04-27 03:22:24.373003] vfio_user.c:2152:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:10:59.462 [2024-04-27 03:22:24.374694] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:59.462 passed 00:10:59.722 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-04-27 03:22:24.458145] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:10:59.722 [2024-04-27 03:22:24.547260] vfio_user.c:2240:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:10:59.722 [2024-04-27 03:22:24.555270] vfio_user.c:2240:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:10:59.722 [2024-04-27 03:22:24.563270] vfio_user.c:2038:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:10:59.722 [2024-04-27 03:22:24.571258] vfio_user.c:2038:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:10:59.722 [2024-04-27 03:22:24.600368] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:10:59.722 passed 00:10:59.722 Test: admin_create_io_sq_verify_pc ...[2024-04-27 03:22:24.684630] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:11:00.002 [2024-04-27 03:22:24.702279] vfio_user.c:2051:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:11:00.002 [2024-04-27 03:22:24.719948] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:11:00.002 passed 00:11:00.002 Test: admin_create_io_qp_max_qps ...[2024-04-27 03:22:24.802470] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:11:00.943 [2024-04-27 03:22:25.898263] nvme_ctrlr.c:5329:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:11:01.510 [2024-04-27 03:22:26.289973] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:11:01.510 passed 00:11:01.510 Test: admin_create_io_sq_shared_cq ...[2024-04-27 03:22:26.372817] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:11:01.768 [2024-04-27 03:22:26.504277] vfio_user.c:2319:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:11:01.768 [2024-04-27 03:22:26.541338] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:11:01.768 passed 00:11:01.768 00:11:01.768 Run Summary: Type Total Ran Passed Failed Inactive 00:11:01.768 suites 1 1 n/a 0 0 00:11:01.768 tests 18 18 18 0 0 00:11:01.768 asserts 360 360 360 0 n/a 00:11:01.768 00:11:01.768 Elapsed time = 1.567 seconds 00:11:01.768 03:22:26 -- compliance/compliance.sh@42 -- # killprocess 1406362 00:11:01.768 03:22:26 -- common/autotest_common.sh@936 -- # '[' -z 1406362 ']' 00:11:01.768 03:22:26 -- common/autotest_common.sh@940 -- # kill -0 1406362 00:11:01.768 03:22:26 -- common/autotest_common.sh@941 -- # uname 00:11:01.768 03:22:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:01.768 03:22:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1406362 00:11:01.768 03:22:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:01.768 03:22:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:01.768 03:22:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1406362' 00:11:01.768 killing process with pid 1406362 00:11:01.768 03:22:26 -- common/autotest_common.sh@955 -- # kill 1406362 00:11:01.768 03:22:26 -- common/autotest_common.sh@960 -- # wait 1406362 00:11:02.026 03:22:26 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:11:02.026 03:22:26 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:11:02.026 00:11:02.026 real 0m5.746s 00:11:02.026 user 0m16.108s 00:11:02.026 sys 0m0.537s 00:11:02.026 03:22:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:02.026 03:22:26 -- common/autotest_common.sh@10 -- # set +x 00:11:02.026 ************************************ 00:11:02.026 END TEST nvmf_vfio_user_nvme_compliance 00:11:02.026 ************************************ 00:11:02.026 03:22:26 -- nvmf/nvmf.sh@43 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:11:02.026 03:22:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:02.026 03:22:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:02.026 03:22:26 -- common/autotest_common.sh@10 -- # set +x 00:11:02.285 ************************************ 00:11:02.285 START TEST nvmf_vfio_user_fuzz 00:11:02.285 ************************************ 00:11:02.285 03:22:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:11:02.285 * Looking for test storage... 00:11:02.285 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:02.285 03:22:27 -- nvmf/common.sh@7 -- # uname -s 00:11:02.285 03:22:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:02.285 03:22:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:02.285 03:22:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:02.285 03:22:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:02.285 03:22:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:02.285 03:22:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:02.285 03:22:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:02.285 03:22:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:02.285 03:22:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:02.285 03:22:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:02.285 03:22:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:11:02.285 03:22:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:11:02.285 03:22:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:02.285 03:22:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:02.285 03:22:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:02.285 03:22:27 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:02.285 03:22:27 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:02.285 03:22:27 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:02.285 03:22:27 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:02.285 03:22:27 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:02.285 03:22:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.285 03:22:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.285 03:22:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.285 03:22:27 -- paths/export.sh@5 -- # export PATH 00:11:02.285 03:22:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.285 03:22:27 -- nvmf/common.sh@47 -- # : 0 00:11:02.285 03:22:27 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:02.285 03:22:27 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:02.285 03:22:27 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:02.285 03:22:27 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:02.285 03:22:27 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:02.285 03:22:27 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:02.285 03:22:27 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:02.285 03:22:27 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=1407099 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 1407099' 00:11:02.285 Process pid: 1407099 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:11:02.285 03:22:27 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 1407099 00:11:02.285 03:22:27 -- common/autotest_common.sh@817 -- # '[' -z 1407099 ']' 00:11:02.285 03:22:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:02.285 03:22:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:02.285 03:22:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:02.285 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:02.285 03:22:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:02.285 03:22:27 -- common/autotest_common.sh@10 -- # set +x 00:11:02.543 03:22:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:02.543 03:22:27 -- common/autotest_common.sh@850 -- # return 0 00:11:02.543 03:22:27 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:11:03.478 03:22:28 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:11:03.478 03:22:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:03.478 03:22:28 -- common/autotest_common.sh@10 -- # set +x 00:11:03.736 03:22:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:03.736 03:22:28 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:11:03.736 03:22:28 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:11:03.736 03:22:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:03.736 03:22:28 -- common/autotest_common.sh@10 -- # set +x 00:11:03.736 malloc0 00:11:03.736 03:22:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:03.736 03:22:28 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:11:03.736 03:22:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:03.736 03:22:28 -- common/autotest_common.sh@10 -- # set +x 00:11:03.736 03:22:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:03.736 03:22:28 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:11:03.736 03:22:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:03.736 03:22:28 -- common/autotest_common.sh@10 -- # set +x 00:11:03.736 03:22:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:03.736 03:22:28 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:11:03.736 03:22:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:03.736 03:22:28 -- common/autotest_common.sh@10 -- # set +x 00:11:03.736 03:22:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:03.736 03:22:28 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:11:03.736 03:22:28 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:11:35.802 Fuzzing completed. Shutting down the fuzz application 00:11:35.802 00:11:35.802 Dumping successful admin opcodes: 00:11:35.802 8, 9, 10, 24, 00:11:35.802 Dumping successful io opcodes: 00:11:35.802 0, 00:11:35.802 NS: 0x200003a1ef00 I/O qp, Total commands completed: 550743, total successful commands: 2119, random_seed: 1116176896 00:11:35.802 NS: 0x200003a1ef00 admin qp, Total commands completed: 123854, total successful commands: 1019, random_seed: 2975580416 00:11:35.802 03:22:59 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:11:35.802 03:22:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:35.802 03:22:59 -- common/autotest_common.sh@10 -- # set +x 00:11:35.802 03:22:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:35.802 03:22:59 -- target/vfio_user_fuzz.sh@46 -- # killprocess 1407099 00:11:35.802 03:22:59 -- common/autotest_common.sh@936 -- # '[' -z 1407099 ']' 00:11:35.802 03:22:59 -- common/autotest_common.sh@940 -- # kill -0 1407099 00:11:35.802 03:22:59 -- common/autotest_common.sh@941 -- # uname 00:11:35.802 03:22:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:35.802 03:22:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1407099 00:11:35.802 03:22:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:35.802 03:22:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:35.802 03:22:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1407099' 00:11:35.802 killing process with pid 1407099 00:11:35.802 03:22:59 -- common/autotest_common.sh@955 -- # kill 1407099 00:11:35.802 03:22:59 -- common/autotest_common.sh@960 -- # wait 1407099 00:11:35.802 03:22:59 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:11:35.802 03:22:59 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:11:35.802 00:11:35.802 real 0m32.403s 00:11:35.802 user 0m30.495s 00:11:35.802 sys 0m27.174s 00:11:35.802 03:22:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:35.802 03:22:59 -- common/autotest_common.sh@10 -- # set +x 00:11:35.802 ************************************ 00:11:35.802 END TEST nvmf_vfio_user_fuzz 00:11:35.802 ************************************ 00:11:35.802 03:22:59 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:11:35.802 03:22:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:35.802 03:22:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:35.802 03:22:59 -- common/autotest_common.sh@10 -- # set +x 00:11:35.802 ************************************ 00:11:35.802 START TEST nvmf_host_management 00:11:35.802 ************************************ 00:11:35.802 03:22:59 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:11:35.802 * Looking for test storage... 00:11:35.802 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:35.802 03:22:59 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:35.802 03:22:59 -- nvmf/common.sh@7 -- # uname -s 00:11:35.802 03:22:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:35.802 03:22:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:35.802 03:22:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:35.802 03:22:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:35.802 03:22:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:35.802 03:22:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:35.802 03:22:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:35.802 03:22:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:35.802 03:22:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:35.802 03:22:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:35.802 03:22:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:11:35.802 03:22:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:11:35.802 03:22:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:35.802 03:22:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:35.802 03:22:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:35.802 03:22:59 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:35.802 03:22:59 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:35.802 03:22:59 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:35.802 03:22:59 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:35.802 03:22:59 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:35.802 03:22:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:35.803 03:22:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:35.803 03:22:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:35.803 03:22:59 -- paths/export.sh@5 -- # export PATH 00:11:35.803 03:22:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:35.803 03:22:59 -- nvmf/common.sh@47 -- # : 0 00:11:35.803 03:22:59 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:35.803 03:22:59 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:35.803 03:22:59 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:35.803 03:22:59 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:35.803 03:22:59 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:35.803 03:22:59 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:35.803 03:22:59 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:35.803 03:22:59 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:35.803 03:22:59 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:35.803 03:22:59 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:35.803 03:22:59 -- target/host_management.sh@105 -- # nvmftestinit 00:11:35.803 03:22:59 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:11:35.803 03:22:59 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:35.803 03:22:59 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:35.803 03:22:59 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:35.803 03:22:59 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:35.803 03:22:59 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:35.803 03:22:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:35.803 03:22:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:35.803 03:22:59 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:35.803 03:22:59 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:35.803 03:22:59 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:35.803 03:22:59 -- common/autotest_common.sh@10 -- # set +x 00:11:36.738 03:23:01 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:36.738 03:23:01 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:36.738 03:23:01 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:36.738 03:23:01 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:36.738 03:23:01 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:36.738 03:23:01 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:36.738 03:23:01 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:36.738 03:23:01 -- nvmf/common.sh@295 -- # net_devs=() 00:11:36.738 03:23:01 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:36.738 03:23:01 -- nvmf/common.sh@296 -- # e810=() 00:11:36.738 03:23:01 -- nvmf/common.sh@296 -- # local -ga e810 00:11:36.738 03:23:01 -- nvmf/common.sh@297 -- # x722=() 00:11:36.738 03:23:01 -- nvmf/common.sh@297 -- # local -ga x722 00:11:36.738 03:23:01 -- nvmf/common.sh@298 -- # mlx=() 00:11:36.738 03:23:01 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:36.738 03:23:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:36.738 03:23:01 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:36.738 03:23:01 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:11:36.738 03:23:01 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:36.738 03:23:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:36.738 03:23:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:11:36.738 Found 0000:09:00.0 (0x8086 - 0x159b) 00:11:36.738 03:23:01 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:36.738 03:23:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:11:36.738 Found 0000:09:00.1 (0x8086 - 0x159b) 00:11:36.738 03:23:01 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:36.738 03:23:01 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:36.738 03:23:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:36.738 03:23:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:36.738 03:23:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:36.738 03:23:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:11:36.738 Found net devices under 0000:09:00.0: cvl_0_0 00:11:36.738 03:23:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:36.738 03:23:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:36.738 03:23:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:36.738 03:23:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:36.738 03:23:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:36.738 03:23:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:11:36.738 Found net devices under 0000:09:00.1: cvl_0_1 00:11:36.738 03:23:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:36.738 03:23:01 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:36.738 03:23:01 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:36.738 03:23:01 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:11:36.738 03:23:01 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:11:36.738 03:23:01 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:36.738 03:23:01 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:36.738 03:23:01 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:36.738 03:23:01 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:11:36.738 03:23:01 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:36.738 03:23:01 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:36.738 03:23:01 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:11:36.738 03:23:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:36.738 03:23:01 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:36.738 03:23:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:11:36.738 03:23:01 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:11:36.738 03:23:01 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:11:36.738 03:23:01 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:36.738 03:23:01 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:36.738 03:23:01 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:36.738 03:23:01 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:11:36.738 03:23:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:36.738 03:23:01 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:36.738 03:23:01 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:36.738 03:23:01 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:11:36.738 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:36.738 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:11:36.738 00:11:36.738 --- 10.0.0.2 ping statistics --- 00:11:36.738 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:36.738 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:11:36.738 03:23:01 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:36.997 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:36.997 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.064 ms 00:11:36.997 00:11:36.997 --- 10.0.0.1 ping statistics --- 00:11:36.997 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:36.997 rtt min/avg/max/mdev = 0.064/0.064/0.064/0.000 ms 00:11:36.997 03:23:01 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:36.997 03:23:01 -- nvmf/common.sh@411 -- # return 0 00:11:36.997 03:23:01 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:36.997 03:23:01 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:36.997 03:23:01 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:11:36.997 03:23:01 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:11:36.997 03:23:01 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:36.997 03:23:01 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:11:36.997 03:23:01 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:11:36.997 03:23:01 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:11:36.997 03:23:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:11:36.997 03:23:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:36.997 03:23:01 -- common/autotest_common.sh@10 -- # set +x 00:11:36.997 ************************************ 00:11:36.997 START TEST nvmf_host_management 00:11:36.997 ************************************ 00:11:36.997 03:23:01 -- common/autotest_common.sh@1111 -- # nvmf_host_management 00:11:36.997 03:23:01 -- target/host_management.sh@69 -- # starttarget 00:11:36.997 03:23:01 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:11:36.997 03:23:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:36.997 03:23:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:36.997 03:23:01 -- common/autotest_common.sh@10 -- # set +x 00:11:36.997 03:23:01 -- nvmf/common.sh@470 -- # nvmfpid=1412667 00:11:36.997 03:23:01 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:11:36.997 03:23:01 -- nvmf/common.sh@471 -- # waitforlisten 1412667 00:11:36.997 03:23:01 -- common/autotest_common.sh@817 -- # '[' -z 1412667 ']' 00:11:36.997 03:23:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:36.997 03:23:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:36.997 03:23:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:36.997 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:36.997 03:23:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:36.997 03:23:01 -- common/autotest_common.sh@10 -- # set +x 00:11:36.997 [2024-04-27 03:23:01.887806] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:11:36.997 [2024-04-27 03:23:01.887889] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:36.997 EAL: No free 2048 kB hugepages reported on node 1 00:11:36.997 [2024-04-27 03:23:01.959254] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:37.255 [2024-04-27 03:23:02.078784] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:37.255 [2024-04-27 03:23:02.078853] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:37.255 [2024-04-27 03:23:02.078870] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:37.255 [2024-04-27 03:23:02.078883] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:37.255 [2024-04-27 03:23:02.078895] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:37.255 [2024-04-27 03:23:02.078979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:37.255 [2024-04-27 03:23:02.082265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:37.255 [2024-04-27 03:23:02.082339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:11:37.255 [2024-04-27 03:23:02.082343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:37.255 03:23:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:37.255 03:23:02 -- common/autotest_common.sh@850 -- # return 0 00:11:37.255 03:23:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:37.255 03:23:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:37.256 03:23:02 -- common/autotest_common.sh@10 -- # set +x 00:11:37.256 03:23:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:37.256 03:23:02 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:37.256 03:23:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:37.256 03:23:02 -- common/autotest_common.sh@10 -- # set +x 00:11:37.256 [2024-04-27 03:23:02.230806] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:37.514 03:23:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:37.514 03:23:02 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:11:37.514 03:23:02 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:37.514 03:23:02 -- common/autotest_common.sh@10 -- # set +x 00:11:37.514 03:23:02 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:11:37.514 03:23:02 -- target/host_management.sh@23 -- # cat 00:11:37.514 03:23:02 -- target/host_management.sh@30 -- # rpc_cmd 00:11:37.514 03:23:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:37.514 03:23:02 -- common/autotest_common.sh@10 -- # set +x 00:11:37.514 Malloc0 00:11:37.514 [2024-04-27 03:23:02.289404] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:37.514 03:23:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:37.514 03:23:02 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:11:37.514 03:23:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:37.514 03:23:02 -- common/autotest_common.sh@10 -- # set +x 00:11:37.514 03:23:02 -- target/host_management.sh@73 -- # perfpid=1412737 00:11:37.514 03:23:02 -- target/host_management.sh@74 -- # waitforlisten 1412737 /var/tmp/bdevperf.sock 00:11:37.514 03:23:02 -- common/autotest_common.sh@817 -- # '[' -z 1412737 ']' 00:11:37.514 03:23:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:11:37.514 03:23:02 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:11:37.514 03:23:02 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:11:37.514 03:23:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:37.514 03:23:02 -- nvmf/common.sh@521 -- # config=() 00:11:37.514 03:23:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:11:37.514 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:11:37.514 03:23:02 -- nvmf/common.sh@521 -- # local subsystem config 00:11:37.514 03:23:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:37.514 03:23:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:11:37.514 03:23:02 -- common/autotest_common.sh@10 -- # set +x 00:11:37.514 03:23:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:11:37.514 { 00:11:37.514 "params": { 00:11:37.514 "name": "Nvme$subsystem", 00:11:37.514 "trtype": "$TEST_TRANSPORT", 00:11:37.514 "traddr": "$NVMF_FIRST_TARGET_IP", 00:11:37.514 "adrfam": "ipv4", 00:11:37.514 "trsvcid": "$NVMF_PORT", 00:11:37.514 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:11:37.514 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:11:37.514 "hdgst": ${hdgst:-false}, 00:11:37.514 "ddgst": ${ddgst:-false} 00:11:37.514 }, 00:11:37.514 "method": "bdev_nvme_attach_controller" 00:11:37.514 } 00:11:37.514 EOF 00:11:37.514 )") 00:11:37.514 03:23:02 -- nvmf/common.sh@543 -- # cat 00:11:37.514 03:23:02 -- nvmf/common.sh@545 -- # jq . 00:11:37.514 03:23:02 -- nvmf/common.sh@546 -- # IFS=, 00:11:37.514 03:23:02 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:11:37.514 "params": { 00:11:37.514 "name": "Nvme0", 00:11:37.514 "trtype": "tcp", 00:11:37.514 "traddr": "10.0.0.2", 00:11:37.514 "adrfam": "ipv4", 00:11:37.514 "trsvcid": "4420", 00:11:37.514 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:37.514 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:11:37.514 "hdgst": false, 00:11:37.514 "ddgst": false 00:11:37.514 }, 00:11:37.514 "method": "bdev_nvme_attach_controller" 00:11:37.514 }' 00:11:37.514 [2024-04-27 03:23:02.359762] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:11:37.514 [2024-04-27 03:23:02.359852] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1412737 ] 00:11:37.514 EAL: No free 2048 kB hugepages reported on node 1 00:11:37.514 [2024-04-27 03:23:02.421182] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:37.773 [2024-04-27 03:23:02.527827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:38.031 Running I/O for 10 seconds... 00:11:38.031 03:23:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:38.031 03:23:02 -- common/autotest_common.sh@850 -- # return 0 00:11:38.031 03:23:02 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:11:38.031 03:23:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:38.031 03:23:02 -- common/autotest_common.sh@10 -- # set +x 00:11:38.031 03:23:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:38.031 03:23:02 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:11:38.031 03:23:02 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:11:38.031 03:23:02 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:11:38.031 03:23:02 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:11:38.031 03:23:02 -- target/host_management.sh@52 -- # local ret=1 00:11:38.031 03:23:02 -- target/host_management.sh@53 -- # local i 00:11:38.031 03:23:02 -- target/host_management.sh@54 -- # (( i = 10 )) 00:11:38.031 03:23:02 -- target/host_management.sh@54 -- # (( i != 0 )) 00:11:38.031 03:23:02 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:11:38.031 03:23:02 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:11:38.031 03:23:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:38.031 03:23:02 -- common/autotest_common.sh@10 -- # set +x 00:11:38.031 03:23:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:38.031 03:23:02 -- target/host_management.sh@55 -- # read_io_count=67 00:11:38.031 03:23:02 -- target/host_management.sh@58 -- # '[' 67 -ge 100 ']' 00:11:38.031 03:23:02 -- target/host_management.sh@62 -- # sleep 0.25 00:11:38.290 03:23:03 -- target/host_management.sh@54 -- # (( i-- )) 00:11:38.290 03:23:03 -- target/host_management.sh@54 -- # (( i != 0 )) 00:11:38.290 03:23:03 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:11:38.290 03:23:03 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:11:38.290 03:23:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:38.290 03:23:03 -- common/autotest_common.sh@10 -- # set +x 00:11:38.290 03:23:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:38.290 03:23:03 -- target/host_management.sh@55 -- # read_io_count=515 00:11:38.290 03:23:03 -- target/host_management.sh@58 -- # '[' 515 -ge 100 ']' 00:11:38.290 03:23:03 -- target/host_management.sh@59 -- # ret=0 00:11:38.290 03:23:03 -- target/host_management.sh@60 -- # break 00:11:38.290 03:23:03 -- target/host_management.sh@64 -- # return 0 00:11:38.290 03:23:03 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:11:38.290 03:23:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:38.290 03:23:03 -- common/autotest_common.sh@10 -- # set +x 00:11:38.290 [2024-04-27 03:23:03.152427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:75776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:75904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:76032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:76160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:76288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:76416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:76544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:76672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:76800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:76928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:77312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.152974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.152991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.153006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.153023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:77824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.153039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.153072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:77952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.153087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.153104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:78080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.153119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.153135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:78208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.153151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.153171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:78336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.153187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.290 [2024-04-27 03:23:03.153204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:78464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.290 [2024-04-27 03:23:03.153220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:78592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:78720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:78848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:78976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:79104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:79232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:79360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:79488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:79616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:79744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:79872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:80000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:80128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:80256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:80384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:80512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:80640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:80768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:80896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:81024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:81152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.153983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:81280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.153999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:81408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:81536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:81664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:81792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:74112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:74496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:74752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:75008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.291 [2024-04-27 03:23:03.154594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.291 [2024-04-27 03:23:03.154611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.292 [2024-04-27 03:23:03.154626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.292 [2024-04-27 03:23:03.154643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:75392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.292 [2024-04-27 03:23:03.154658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.292 [2024-04-27 03:23:03.154675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:75520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.292 [2024-04-27 03:23:03.154691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.292 [2024-04-27 03:23:03.154707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:75648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:38.292 [2024-04-27 03:23:03.154722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:38.292 [2024-04-27 03:23:03.154817] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x10127f0 was disconnected and freed. reset controller. 00:11:38.292 [2024-04-27 03:23:03.155945] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:11:38.292 03:23:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:38.292 03:23:03 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:11:38.292 03:23:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:38.292 03:23:03 -- common/autotest_common.sh@10 -- # set +x 00:11:38.292 task offset: 75776 on job bdev=Nvme0n1 fails 00:11:38.292 00:11:38.292 Latency(us) 00:11:38.292 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:38.292 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:11:38.292 Job: Nvme0n1 ended in about 0.40 seconds with error 00:11:38.292 Verification LBA range: start 0x0 length 0x400 00:11:38.292 Nvme0n1 : 0.40 1433.75 89.61 159.31 0.00 39039.69 2936.98 35340.89 00:11:38.292 =================================================================================================================== 00:11:38.292 Total : 1433.75 89.61 159.31 0.00 39039.69 2936.98 35340.89 00:11:38.292 [2024-04-27 03:23:03.157856] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:11:38.292 [2024-04-27 03:23:03.157886] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc02260 (9): Bad file descriptor 00:11:38.292 03:23:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:38.292 03:23:03 -- target/host_management.sh@87 -- # sleep 1 00:11:38.292 [2024-04-27 03:23:03.250404] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:11:39.224 03:23:04 -- target/host_management.sh@91 -- # kill -9 1412737 00:11:39.224 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1412737) - No such process 00:11:39.224 03:23:04 -- target/host_management.sh@91 -- # true 00:11:39.224 03:23:04 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:11:39.224 03:23:04 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:11:39.224 03:23:04 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:11:39.224 03:23:04 -- nvmf/common.sh@521 -- # config=() 00:11:39.224 03:23:04 -- nvmf/common.sh@521 -- # local subsystem config 00:11:39.224 03:23:04 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:11:39.224 03:23:04 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:11:39.224 { 00:11:39.224 "params": { 00:11:39.224 "name": "Nvme$subsystem", 00:11:39.224 "trtype": "$TEST_TRANSPORT", 00:11:39.224 "traddr": "$NVMF_FIRST_TARGET_IP", 00:11:39.224 "adrfam": "ipv4", 00:11:39.224 "trsvcid": "$NVMF_PORT", 00:11:39.224 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:11:39.224 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:11:39.224 "hdgst": ${hdgst:-false}, 00:11:39.224 "ddgst": ${ddgst:-false} 00:11:39.224 }, 00:11:39.224 "method": "bdev_nvme_attach_controller" 00:11:39.224 } 00:11:39.224 EOF 00:11:39.224 )") 00:11:39.224 03:23:04 -- nvmf/common.sh@543 -- # cat 00:11:39.224 03:23:04 -- nvmf/common.sh@545 -- # jq . 00:11:39.224 03:23:04 -- nvmf/common.sh@546 -- # IFS=, 00:11:39.224 03:23:04 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:11:39.224 "params": { 00:11:39.224 "name": "Nvme0", 00:11:39.224 "trtype": "tcp", 00:11:39.224 "traddr": "10.0.0.2", 00:11:39.224 "adrfam": "ipv4", 00:11:39.224 "trsvcid": "4420", 00:11:39.224 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:39.224 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:11:39.224 "hdgst": false, 00:11:39.224 "ddgst": false 00:11:39.224 }, 00:11:39.224 "method": "bdev_nvme_attach_controller" 00:11:39.224 }' 00:11:39.482 [2024-04-27 03:23:04.211733] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:11:39.482 [2024-04-27 03:23:04.211819] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1413007 ] 00:11:39.482 EAL: No free 2048 kB hugepages reported on node 1 00:11:39.482 [2024-04-27 03:23:04.272168] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:39.482 [2024-04-27 03:23:04.379590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:39.740 Running I/O for 1 seconds... 00:11:40.673 00:11:40.673 Latency(us) 00:11:40.673 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:40.673 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:11:40.673 Verification LBA range: start 0x0 length 0x400 00:11:40.673 Nvme0n1 : 1.03 1613.90 100.87 0.00 0.00 39028.81 6844.87 32622.36 00:11:40.673 =================================================================================================================== 00:11:40.673 Total : 1613.90 100.87 0.00 0.00 39028.81 6844.87 32622.36 00:11:41.240 03:23:05 -- target/host_management.sh@102 -- # stoptarget 00:11:41.240 03:23:05 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:11:41.240 03:23:05 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:11:41.240 03:23:05 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:11:41.240 03:23:05 -- target/host_management.sh@40 -- # nvmftestfini 00:11:41.240 03:23:05 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:41.240 03:23:05 -- nvmf/common.sh@117 -- # sync 00:11:41.240 03:23:05 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:11:41.240 03:23:05 -- nvmf/common.sh@120 -- # set +e 00:11:41.240 03:23:05 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:41.240 03:23:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:11:41.240 rmmod nvme_tcp 00:11:41.240 rmmod nvme_fabrics 00:11:41.240 rmmod nvme_keyring 00:11:41.240 03:23:05 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:41.240 03:23:05 -- nvmf/common.sh@124 -- # set -e 00:11:41.240 03:23:05 -- nvmf/common.sh@125 -- # return 0 00:11:41.240 03:23:05 -- nvmf/common.sh@478 -- # '[' -n 1412667 ']' 00:11:41.240 03:23:05 -- nvmf/common.sh@479 -- # killprocess 1412667 00:11:41.240 03:23:05 -- common/autotest_common.sh@936 -- # '[' -z 1412667 ']' 00:11:41.240 03:23:05 -- common/autotest_common.sh@940 -- # kill -0 1412667 00:11:41.240 03:23:05 -- common/autotest_common.sh@941 -- # uname 00:11:41.240 03:23:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:41.240 03:23:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1412667 00:11:41.240 03:23:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:11:41.240 03:23:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:11:41.240 03:23:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1412667' 00:11:41.240 killing process with pid 1412667 00:11:41.240 03:23:05 -- common/autotest_common.sh@955 -- # kill 1412667 00:11:41.240 03:23:05 -- common/autotest_common.sh@960 -- # wait 1412667 00:11:41.499 [2024-04-27 03:23:06.265822] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:11:41.499 03:23:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:41.499 03:23:06 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:11:41.499 03:23:06 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:11:41.499 03:23:06 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:41.499 03:23:06 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:11:41.499 03:23:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:41.499 03:23:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:41.499 03:23:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:43.403 03:23:08 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:11:43.403 00:11:43.403 real 0m6.501s 00:11:43.403 user 0m18.645s 00:11:43.403 sys 0m1.265s 00:11:43.403 03:23:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:43.403 03:23:08 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 ************************************ 00:11:43.403 END TEST nvmf_host_management 00:11:43.403 ************************************ 00:11:43.403 03:23:08 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:11:43.403 00:11:43.403 real 0m8.825s 00:11:43.403 user 0m19.494s 00:11:43.403 sys 0m2.759s 00:11:43.403 03:23:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:43.403 03:23:08 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 ************************************ 00:11:43.403 END TEST nvmf_host_management 00:11:43.403 ************************************ 00:11:43.663 03:23:08 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:11:43.663 03:23:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:43.663 03:23:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:43.663 03:23:08 -- common/autotest_common.sh@10 -- # set +x 00:11:43.663 ************************************ 00:11:43.663 START TEST nvmf_lvol 00:11:43.663 ************************************ 00:11:43.663 03:23:08 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:11:43.663 * Looking for test storage... 00:11:43.663 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:43.663 03:23:08 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:43.663 03:23:08 -- nvmf/common.sh@7 -- # uname -s 00:11:43.663 03:23:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:43.663 03:23:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:43.663 03:23:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:43.663 03:23:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:43.663 03:23:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:43.663 03:23:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:43.663 03:23:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:43.663 03:23:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:43.663 03:23:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:43.663 03:23:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:43.663 03:23:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:11:43.663 03:23:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:11:43.663 03:23:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:43.663 03:23:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:43.663 03:23:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:43.663 03:23:08 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:43.663 03:23:08 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:43.663 03:23:08 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:43.663 03:23:08 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:43.663 03:23:08 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:43.663 03:23:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.663 03:23:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.663 03:23:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.663 03:23:08 -- paths/export.sh@5 -- # export PATH 00:11:43.663 03:23:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.663 03:23:08 -- nvmf/common.sh@47 -- # : 0 00:11:43.663 03:23:08 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:43.663 03:23:08 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:43.663 03:23:08 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:43.663 03:23:08 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:43.663 03:23:08 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:43.663 03:23:08 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:43.663 03:23:08 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:43.663 03:23:08 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:43.663 03:23:08 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:43.663 03:23:08 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:43.663 03:23:08 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:11:43.663 03:23:08 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:11:43.663 03:23:08 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:11:43.663 03:23:08 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:11:43.663 03:23:08 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:11:43.663 03:23:08 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:43.663 03:23:08 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:43.663 03:23:08 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:43.663 03:23:08 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:43.663 03:23:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:43.663 03:23:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:43.663 03:23:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:43.663 03:23:08 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:43.664 03:23:08 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:43.664 03:23:08 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:43.664 03:23:08 -- common/autotest_common.sh@10 -- # set +x 00:11:45.603 03:23:10 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:45.603 03:23:10 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:45.603 03:23:10 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:45.603 03:23:10 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:45.603 03:23:10 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:45.603 03:23:10 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:45.603 03:23:10 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:45.603 03:23:10 -- nvmf/common.sh@295 -- # net_devs=() 00:11:45.603 03:23:10 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:45.603 03:23:10 -- nvmf/common.sh@296 -- # e810=() 00:11:45.603 03:23:10 -- nvmf/common.sh@296 -- # local -ga e810 00:11:45.603 03:23:10 -- nvmf/common.sh@297 -- # x722=() 00:11:45.603 03:23:10 -- nvmf/common.sh@297 -- # local -ga x722 00:11:45.603 03:23:10 -- nvmf/common.sh@298 -- # mlx=() 00:11:45.603 03:23:10 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:45.603 03:23:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:45.603 03:23:10 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:45.603 03:23:10 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:11:45.603 03:23:10 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:11:45.603 03:23:10 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:11:45.603 03:23:10 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:11:45.603 03:23:10 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:45.603 03:23:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:45.603 03:23:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:11:45.603 Found 0000:09:00.0 (0x8086 - 0x159b) 00:11:45.603 03:23:10 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:11:45.603 03:23:10 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:11:45.603 03:23:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:45.603 03:23:10 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:45.603 03:23:10 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:11:45.604 03:23:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:45.604 03:23:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:11:45.604 Found 0000:09:00.1 (0x8086 - 0x159b) 00:11:45.604 03:23:10 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:11:45.604 03:23:10 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:11:45.604 03:23:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:45.604 03:23:10 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:45.604 03:23:10 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:11:45.604 03:23:10 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:45.604 03:23:10 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:11:45.604 03:23:10 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:11:45.604 03:23:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:45.604 03:23:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:45.604 03:23:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:45.604 03:23:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:45.604 03:23:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:11:45.604 Found net devices under 0000:09:00.0: cvl_0_0 00:11:45.604 03:23:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:45.604 03:23:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:45.604 03:23:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:45.604 03:23:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:45.604 03:23:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:45.604 03:23:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:11:45.604 Found net devices under 0000:09:00.1: cvl_0_1 00:11:45.604 03:23:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:45.604 03:23:10 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:45.604 03:23:10 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:45.604 03:23:10 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:45.604 03:23:10 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:11:45.604 03:23:10 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:11:45.604 03:23:10 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:45.604 03:23:10 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:45.604 03:23:10 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:45.604 03:23:10 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:11:45.604 03:23:10 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:45.604 03:23:10 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:45.604 03:23:10 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:11:45.604 03:23:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:45.604 03:23:10 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:45.604 03:23:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:11:45.604 03:23:10 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:11:45.604 03:23:10 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:11:45.604 03:23:10 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:45.604 03:23:10 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:45.604 03:23:10 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:45.604 03:23:10 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:11:45.604 03:23:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:45.604 03:23:10 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:45.604 03:23:10 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:45.604 03:23:10 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:11:45.604 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:45.604 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:11:45.604 00:11:45.604 --- 10.0.0.2 ping statistics --- 00:11:45.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:45.604 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:11:45.604 03:23:10 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:45.863 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:45.863 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:11:45.863 00:11:45.863 --- 10.0.0.1 ping statistics --- 00:11:45.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:45.863 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:11:45.863 03:23:10 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:45.863 03:23:10 -- nvmf/common.sh@411 -- # return 0 00:11:45.863 03:23:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:45.863 03:23:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:45.863 03:23:10 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:11:45.863 03:23:10 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:11:45.863 03:23:10 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:45.863 03:23:10 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:11:45.863 03:23:10 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:11:45.863 03:23:10 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:11:45.863 03:23:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:45.863 03:23:10 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:45.863 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:11:45.863 03:23:10 -- nvmf/common.sh@470 -- # nvmfpid=1415116 00:11:45.863 03:23:10 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:11:45.863 03:23:10 -- nvmf/common.sh@471 -- # waitforlisten 1415116 00:11:45.863 03:23:10 -- common/autotest_common.sh@817 -- # '[' -z 1415116 ']' 00:11:45.863 03:23:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:45.863 03:23:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:45.863 03:23:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:45.863 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:45.863 03:23:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:45.863 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:11:45.863 [2024-04-27 03:23:10.658464] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:11:45.863 [2024-04-27 03:23:10.658552] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:45.863 EAL: No free 2048 kB hugepages reported on node 1 00:11:45.863 [2024-04-27 03:23:10.723628] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:45.863 [2024-04-27 03:23:10.828760] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:45.863 [2024-04-27 03:23:10.828812] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:45.863 [2024-04-27 03:23:10.828826] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:45.863 [2024-04-27 03:23:10.828837] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:45.863 [2024-04-27 03:23:10.828848] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:45.863 [2024-04-27 03:23:10.828910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:45.863 [2024-04-27 03:23:10.828938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:45.863 [2024-04-27 03:23:10.828943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:46.121 03:23:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:46.121 03:23:10 -- common/autotest_common.sh@850 -- # return 0 00:11:46.121 03:23:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:46.121 03:23:10 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:46.121 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:11:46.121 03:23:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:46.121 03:23:10 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:11:46.378 [2024-04-27 03:23:11.188997] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:46.378 03:23:11 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:46.636 03:23:11 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:11:46.636 03:23:11 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:46.894 03:23:11 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:11:46.894 03:23:11 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:11:47.151 03:23:12 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:11:47.409 03:23:12 -- target/nvmf_lvol.sh@29 -- # lvs=a3d72e28-9fe9-4f3e-9336-3d2bd146934c 00:11:47.409 03:23:12 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u a3d72e28-9fe9-4f3e-9336-3d2bd146934c lvol 20 00:11:47.665 03:23:12 -- target/nvmf_lvol.sh@32 -- # lvol=d9395f18-7ec1-4c44-8edd-48a78b789a2b 00:11:47.665 03:23:12 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:47.922 03:23:12 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 d9395f18-7ec1-4c44-8edd-48a78b789a2b 00:11:48.179 03:23:13 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:11:48.436 [2024-04-27 03:23:13.298223] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.436 03:23:13 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:11:48.694 03:23:13 -- target/nvmf_lvol.sh@42 -- # perf_pid=1415541 00:11:48.694 03:23:13 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:11:48.694 03:23:13 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:11:48.694 EAL: No free 2048 kB hugepages reported on node 1 00:11:49.631 03:23:14 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot d9395f18-7ec1-4c44-8edd-48a78b789a2b MY_SNAPSHOT 00:11:50.196 03:23:14 -- target/nvmf_lvol.sh@47 -- # snapshot=af79a6d3-e98a-464d-a363-498df9489a58 00:11:50.196 03:23:14 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize d9395f18-7ec1-4c44-8edd-48a78b789a2b 30 00:11:50.454 03:23:15 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone af79a6d3-e98a-464d-a363-498df9489a58 MY_CLONE 00:11:50.712 03:23:15 -- target/nvmf_lvol.sh@49 -- # clone=ca95c292-3ca7-48d3-94b9-2969bf9eb905 00:11:50.712 03:23:15 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate ca95c292-3ca7-48d3-94b9-2969bf9eb905 00:11:51.277 03:23:16 -- target/nvmf_lvol.sh@53 -- # wait 1415541 00:11:59.389 Initializing NVMe Controllers 00:11:59.389 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:11:59.389 Controller IO queue size 128, less than required. 00:11:59.389 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:59.389 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:11:59.389 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:11:59.389 Initialization complete. Launching workers. 00:11:59.389 ======================================================== 00:11:59.389 Latency(us) 00:11:59.389 Device Information : IOPS MiB/s Average min max 00:11:59.389 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10565.00 41.27 12121.63 1999.47 80365.66 00:11:59.389 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10473.10 40.91 12232.60 2111.84 75637.54 00:11:59.389 ======================================================== 00:11:59.389 Total : 21038.10 82.18 12176.88 1999.47 80365.66 00:11:59.389 00:11:59.389 03:23:23 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:11:59.389 03:23:24 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete d9395f18-7ec1-4c44-8edd-48a78b789a2b 00:11:59.647 03:23:24 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u a3d72e28-9fe9-4f3e-9336-3d2bd146934c 00:11:59.906 03:23:24 -- target/nvmf_lvol.sh@60 -- # rm -f 00:11:59.906 03:23:24 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:11:59.906 03:23:24 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:11:59.906 03:23:24 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:59.906 03:23:24 -- nvmf/common.sh@117 -- # sync 00:11:59.906 03:23:24 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:11:59.906 03:23:24 -- nvmf/common.sh@120 -- # set +e 00:11:59.906 03:23:24 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:59.906 03:23:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:11:59.906 rmmod nvme_tcp 00:11:59.906 rmmod nvme_fabrics 00:11:59.906 rmmod nvme_keyring 00:11:59.906 03:23:24 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:59.906 03:23:24 -- nvmf/common.sh@124 -- # set -e 00:11:59.906 03:23:24 -- nvmf/common.sh@125 -- # return 0 00:11:59.906 03:23:24 -- nvmf/common.sh@478 -- # '[' -n 1415116 ']' 00:11:59.906 03:23:24 -- nvmf/common.sh@479 -- # killprocess 1415116 00:11:59.906 03:23:24 -- common/autotest_common.sh@936 -- # '[' -z 1415116 ']' 00:11:59.906 03:23:24 -- common/autotest_common.sh@940 -- # kill -0 1415116 00:11:59.906 03:23:24 -- common/autotest_common.sh@941 -- # uname 00:11:59.906 03:23:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:59.906 03:23:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1415116 00:11:59.906 03:23:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:59.906 03:23:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:59.906 03:23:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1415116' 00:11:59.906 killing process with pid 1415116 00:11:59.906 03:23:24 -- common/autotest_common.sh@955 -- # kill 1415116 00:11:59.906 03:23:24 -- common/autotest_common.sh@960 -- # wait 1415116 00:12:00.474 03:23:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:00.474 03:23:25 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:12:00.474 03:23:25 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:12:00.474 03:23:25 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:00.474 03:23:25 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:12:00.474 03:23:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:00.474 03:23:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:00.474 03:23:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:02.376 03:23:27 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:12:02.376 00:12:02.376 real 0m18.765s 00:12:02.376 user 1m3.658s 00:12:02.376 sys 0m5.782s 00:12:02.376 03:23:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:02.376 03:23:27 -- common/autotest_common.sh@10 -- # set +x 00:12:02.376 ************************************ 00:12:02.376 END TEST nvmf_lvol 00:12:02.376 ************************************ 00:12:02.376 03:23:27 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:12:02.376 03:23:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:02.376 03:23:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:02.376 03:23:27 -- common/autotest_common.sh@10 -- # set +x 00:12:02.634 ************************************ 00:12:02.634 START TEST nvmf_lvs_grow 00:12:02.634 ************************************ 00:12:02.634 03:23:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:12:02.634 * Looking for test storage... 00:12:02.634 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:02.634 03:23:27 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:02.634 03:23:27 -- nvmf/common.sh@7 -- # uname -s 00:12:02.634 03:23:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:02.634 03:23:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:02.634 03:23:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:02.634 03:23:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:02.634 03:23:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:02.634 03:23:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:02.634 03:23:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:02.634 03:23:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:02.634 03:23:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:02.634 03:23:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:02.634 03:23:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:12:02.634 03:23:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:12:02.634 03:23:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:02.634 03:23:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:02.634 03:23:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:02.634 03:23:27 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:02.634 03:23:27 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:02.634 03:23:27 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:02.634 03:23:27 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:02.634 03:23:27 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:02.634 03:23:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:02.634 03:23:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:02.634 03:23:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:02.634 03:23:27 -- paths/export.sh@5 -- # export PATH 00:12:02.634 03:23:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:02.634 03:23:27 -- nvmf/common.sh@47 -- # : 0 00:12:02.634 03:23:27 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:02.634 03:23:27 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:02.634 03:23:27 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:02.634 03:23:27 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:02.634 03:23:27 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:02.634 03:23:27 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:02.634 03:23:27 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:02.634 03:23:27 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:02.634 03:23:27 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:02.634 03:23:27 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:12:02.634 03:23:27 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:12:02.634 03:23:27 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:12:02.634 03:23:27 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:02.634 03:23:27 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:02.634 03:23:27 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:02.634 03:23:27 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:02.634 03:23:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:02.634 03:23:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:02.634 03:23:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:02.634 03:23:27 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:02.634 03:23:27 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:02.634 03:23:27 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:02.634 03:23:27 -- common/autotest_common.sh@10 -- # set +x 00:12:04.534 03:23:29 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:04.534 03:23:29 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:04.534 03:23:29 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:04.534 03:23:29 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:04.534 03:23:29 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:04.534 03:23:29 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:04.534 03:23:29 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:04.534 03:23:29 -- nvmf/common.sh@295 -- # net_devs=() 00:12:04.534 03:23:29 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:04.534 03:23:29 -- nvmf/common.sh@296 -- # e810=() 00:12:04.534 03:23:29 -- nvmf/common.sh@296 -- # local -ga e810 00:12:04.534 03:23:29 -- nvmf/common.sh@297 -- # x722=() 00:12:04.534 03:23:29 -- nvmf/common.sh@297 -- # local -ga x722 00:12:04.534 03:23:29 -- nvmf/common.sh@298 -- # mlx=() 00:12:04.534 03:23:29 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:04.534 03:23:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:04.534 03:23:29 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:04.534 03:23:29 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:12:04.534 03:23:29 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:04.534 03:23:29 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:04.534 03:23:29 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:12:04.534 Found 0000:09:00.0 (0x8086 - 0x159b) 00:12:04.534 03:23:29 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:04.534 03:23:29 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:12:04.534 Found 0000:09:00.1 (0x8086 - 0x159b) 00:12:04.534 03:23:29 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:04.534 03:23:29 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:04.534 03:23:29 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:04.534 03:23:29 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:04.534 03:23:29 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:04.534 03:23:29 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:12:04.534 Found net devices under 0000:09:00.0: cvl_0_0 00:12:04.534 03:23:29 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:04.534 03:23:29 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:04.534 03:23:29 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:04.534 03:23:29 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:04.534 03:23:29 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:04.534 03:23:29 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:12:04.534 Found net devices under 0000:09:00.1: cvl_0_1 00:12:04.534 03:23:29 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:04.534 03:23:29 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:04.534 03:23:29 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:04.534 03:23:29 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:12:04.534 03:23:29 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:12:04.534 03:23:29 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:04.534 03:23:29 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:04.534 03:23:29 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:04.534 03:23:29 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:12:04.534 03:23:29 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:04.534 03:23:29 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:04.534 03:23:29 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:12:04.534 03:23:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:04.534 03:23:29 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:04.534 03:23:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:12:04.534 03:23:29 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:12:04.534 03:23:29 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:12:04.535 03:23:29 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:04.793 03:23:29 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:04.793 03:23:29 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:04.793 03:23:29 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:12:04.793 03:23:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:04.793 03:23:29 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:04.793 03:23:29 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:04.793 03:23:29 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:12:04.793 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:04.793 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:12:04.793 00:12:04.793 --- 10.0.0.2 ping statistics --- 00:12:04.793 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:04.793 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:12:04.793 03:23:29 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:04.793 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:04.793 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:12:04.793 00:12:04.793 --- 10.0.0.1 ping statistics --- 00:12:04.793 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:04.793 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:12:04.793 03:23:29 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:04.793 03:23:29 -- nvmf/common.sh@411 -- # return 0 00:12:04.793 03:23:29 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:04.793 03:23:29 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:04.793 03:23:29 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:12:04.793 03:23:29 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:12:04.793 03:23:29 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:04.794 03:23:29 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:12:04.794 03:23:29 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:12:04.794 03:23:29 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:12:04.794 03:23:29 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:04.794 03:23:29 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:04.794 03:23:29 -- common/autotest_common.sh@10 -- # set +x 00:12:04.794 03:23:29 -- nvmf/common.sh@470 -- # nvmfpid=1418811 00:12:04.794 03:23:29 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:12:04.794 03:23:29 -- nvmf/common.sh@471 -- # waitforlisten 1418811 00:12:04.794 03:23:29 -- common/autotest_common.sh@817 -- # '[' -z 1418811 ']' 00:12:04.794 03:23:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:04.794 03:23:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:04.794 03:23:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:04.794 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:04.794 03:23:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:04.794 03:23:29 -- common/autotest_common.sh@10 -- # set +x 00:12:04.794 [2024-04-27 03:23:29.692735] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:04.794 [2024-04-27 03:23:29.692815] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:04.794 EAL: No free 2048 kB hugepages reported on node 1 00:12:04.794 [2024-04-27 03:23:29.760437] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:05.052 [2024-04-27 03:23:29.871620] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:05.052 [2024-04-27 03:23:29.871686] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:05.052 [2024-04-27 03:23:29.871702] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:05.052 [2024-04-27 03:23:29.871715] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:05.052 [2024-04-27 03:23:29.871726] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:05.052 [2024-04-27 03:23:29.871765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:06.072 03:23:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:06.072 03:23:30 -- common/autotest_common.sh@850 -- # return 0 00:12:06.072 03:23:30 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:06.072 03:23:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:06.072 03:23:30 -- common/autotest_common.sh@10 -- # set +x 00:12:06.072 03:23:30 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:06.072 [2024-04-27 03:23:30.866636] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:12:06.072 03:23:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:12:06.072 03:23:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:06.072 03:23:30 -- common/autotest_common.sh@10 -- # set +x 00:12:06.072 ************************************ 00:12:06.072 START TEST lvs_grow_clean 00:12:06.072 ************************************ 00:12:06.072 03:23:30 -- common/autotest_common.sh@1111 -- # lvs_grow 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:06.072 03:23:30 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:06.331 03:23:31 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:12:06.331 03:23:31 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:12:06.589 03:23:31 -- target/nvmf_lvs_grow.sh@28 -- # lvs=f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:06.589 03:23:31 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:06.589 03:23:31 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:12:06.847 03:23:31 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:12:06.847 03:23:31 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:12:06.847 03:23:31 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 lvol 150 00:12:07.105 03:23:31 -- target/nvmf_lvs_grow.sh@33 -- # lvol=1efd6506-6a2c-4fea-8056-e0d6fddc0c5c 00:12:07.105 03:23:31 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:07.105 03:23:31 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:12:07.363 [2024-04-27 03:23:32.228461] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:12:07.363 [2024-04-27 03:23:32.228581] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:12:07.363 true 00:12:07.363 03:23:32 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:07.363 03:23:32 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:12:07.621 03:23:32 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:12:07.621 03:23:32 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:07.879 03:23:32 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 1efd6506-6a2c-4fea-8056-e0d6fddc0c5c 00:12:08.145 03:23:32 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:08.414 [2024-04-27 03:23:33.207543] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.414 03:23:33 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:08.672 03:23:33 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1419374 00:12:08.672 03:23:33 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:12:08.672 03:23:33 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:12:08.672 03:23:33 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1419374 /var/tmp/bdevperf.sock 00:12:08.672 03:23:33 -- common/autotest_common.sh@817 -- # '[' -z 1419374 ']' 00:12:08.672 03:23:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:12:08.672 03:23:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:08.672 03:23:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:12:08.672 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:12:08.672 03:23:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:08.672 03:23:33 -- common/autotest_common.sh@10 -- # set +x 00:12:08.672 [2024-04-27 03:23:33.521625] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:08.672 [2024-04-27 03:23:33.521713] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1419374 ] 00:12:08.672 EAL: No free 2048 kB hugepages reported on node 1 00:12:08.672 [2024-04-27 03:23:33.587442] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:08.930 [2024-04-27 03:23:33.697284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:08.930 03:23:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:08.930 03:23:33 -- common/autotest_common.sh@850 -- # return 0 00:12:08.930 03:23:33 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:12:09.494 Nvme0n1 00:12:09.494 03:23:34 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:12:09.752 [ 00:12:09.752 { 00:12:09.752 "name": "Nvme0n1", 00:12:09.752 "aliases": [ 00:12:09.752 "1efd6506-6a2c-4fea-8056-e0d6fddc0c5c" 00:12:09.752 ], 00:12:09.752 "product_name": "NVMe disk", 00:12:09.752 "block_size": 4096, 00:12:09.752 "num_blocks": 38912, 00:12:09.752 "uuid": "1efd6506-6a2c-4fea-8056-e0d6fddc0c5c", 00:12:09.752 "assigned_rate_limits": { 00:12:09.752 "rw_ios_per_sec": 0, 00:12:09.752 "rw_mbytes_per_sec": 0, 00:12:09.752 "r_mbytes_per_sec": 0, 00:12:09.752 "w_mbytes_per_sec": 0 00:12:09.752 }, 00:12:09.752 "claimed": false, 00:12:09.752 "zoned": false, 00:12:09.752 "supported_io_types": { 00:12:09.752 "read": true, 00:12:09.752 "write": true, 00:12:09.752 "unmap": true, 00:12:09.752 "write_zeroes": true, 00:12:09.752 "flush": true, 00:12:09.752 "reset": true, 00:12:09.752 "compare": true, 00:12:09.752 "compare_and_write": true, 00:12:09.752 "abort": true, 00:12:09.752 "nvme_admin": true, 00:12:09.752 "nvme_io": true 00:12:09.752 }, 00:12:09.753 "memory_domains": [ 00:12:09.753 { 00:12:09.753 "dma_device_id": "system", 00:12:09.753 "dma_device_type": 1 00:12:09.753 } 00:12:09.753 ], 00:12:09.753 "driver_specific": { 00:12:09.753 "nvme": [ 00:12:09.753 { 00:12:09.753 "trid": { 00:12:09.753 "trtype": "TCP", 00:12:09.753 "adrfam": "IPv4", 00:12:09.753 "traddr": "10.0.0.2", 00:12:09.753 "trsvcid": "4420", 00:12:09.753 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:12:09.753 }, 00:12:09.753 "ctrlr_data": { 00:12:09.753 "cntlid": 1, 00:12:09.753 "vendor_id": "0x8086", 00:12:09.753 "model_number": "SPDK bdev Controller", 00:12:09.753 "serial_number": "SPDK0", 00:12:09.753 "firmware_revision": "24.05", 00:12:09.753 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:12:09.753 "oacs": { 00:12:09.753 "security": 0, 00:12:09.753 "format": 0, 00:12:09.753 "firmware": 0, 00:12:09.753 "ns_manage": 0 00:12:09.753 }, 00:12:09.753 "multi_ctrlr": true, 00:12:09.753 "ana_reporting": false 00:12:09.753 }, 00:12:09.753 "vs": { 00:12:09.753 "nvme_version": "1.3" 00:12:09.753 }, 00:12:09.753 "ns_data": { 00:12:09.753 "id": 1, 00:12:09.753 "can_share": true 00:12:09.753 } 00:12:09.753 } 00:12:09.753 ], 00:12:09.753 "mp_policy": "active_passive" 00:12:09.753 } 00:12:09.753 } 00:12:09.753 ] 00:12:09.753 03:23:34 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1419458 00:12:09.753 03:23:34 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:12:09.753 03:23:34 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:12:09.753 Running I/O for 10 seconds... 00:12:11.126 Latency(us) 00:12:11.126 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:11.126 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:11.126 Nvme0n1 : 1.00 14355.00 56.07 0.00 0.00 0.00 0.00 0.00 00:12:11.126 =================================================================================================================== 00:12:11.126 Total : 14355.00 56.07 0.00 0.00 0.00 0.00 0.00 00:12:11.126 00:12:11.692 03:23:36 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:11.692 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:11.692 Nvme0n1 : 2.00 14581.00 56.96 0.00 0.00 0.00 0.00 0.00 00:12:11.692 =================================================================================================================== 00:12:11.692 Total : 14581.00 56.96 0.00 0.00 0.00 0.00 0.00 00:12:11.692 00:12:11.950 true 00:12:11.950 03:23:36 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:11.950 03:23:36 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:12:12.208 03:23:37 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:12:12.208 03:23:37 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:12:12.208 03:23:37 -- target/nvmf_lvs_grow.sh@65 -- # wait 1419458 00:12:12.774 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:12.774 Nvme0n1 : 3.00 14592.00 57.00 0.00 0.00 0.00 0.00 0.00 00:12:12.774 =================================================================================================================== 00:12:12.774 Total : 14592.00 57.00 0.00 0.00 0.00 0.00 0.00 00:12:12.774 00:12:13.709 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:13.709 Nvme0n1 : 4.00 14661.00 57.27 0.00 0.00 0.00 0.00 0.00 00:12:13.709 =================================================================================================================== 00:12:13.709 Total : 14661.00 57.27 0.00 0.00 0.00 0.00 0.00 00:12:13.709 00:12:15.083 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:15.083 Nvme0n1 : 5.00 14751.40 57.62 0.00 0.00 0.00 0.00 0.00 00:12:15.083 =================================================================================================================== 00:12:15.083 Total : 14751.40 57.62 0.00 0.00 0.00 0.00 0.00 00:12:15.083 00:12:16.015 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:16.015 Nvme0n1 : 6.00 14769.33 57.69 0.00 0.00 0.00 0.00 0.00 00:12:16.015 =================================================================================================================== 00:12:16.015 Total : 14769.33 57.69 0.00 0.00 0.00 0.00 0.00 00:12:16.015 00:12:16.947 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:16.947 Nvme0n1 : 7.00 14793.71 57.79 0.00 0.00 0.00 0.00 0.00 00:12:16.947 =================================================================================================================== 00:12:16.947 Total : 14793.71 57.79 0.00 0.00 0.00 0.00 0.00 00:12:16.947 00:12:17.880 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:17.880 Nvme0n1 : 8.00 14822.00 57.90 0.00 0.00 0.00 0.00 0.00 00:12:17.880 =================================================================================================================== 00:12:17.880 Total : 14822.00 57.90 0.00 0.00 0.00 0.00 0.00 00:12:17.880 00:12:18.813 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:18.813 Nvme0n1 : 9.00 14842.89 57.98 0.00 0.00 0.00 0.00 0.00 00:12:18.813 =================================================================================================================== 00:12:18.813 Total : 14842.89 57.98 0.00 0.00 0.00 0.00 0.00 00:12:18.813 00:12:19.745 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:19.745 Nvme0n1 : 10.00 14846.70 57.99 0.00 0.00 0.00 0.00 0.00 00:12:19.745 =================================================================================================================== 00:12:19.745 Total : 14846.70 57.99 0.00 0.00 0.00 0.00 0.00 00:12:19.745 00:12:19.745 00:12:19.745 Latency(us) 00:12:19.745 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:19.745 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:19.745 Nvme0n1 : 10.01 14850.78 58.01 0.00 0.00 8614.16 4927.34 17379.18 00:12:19.746 =================================================================================================================== 00:12:19.746 Total : 14850.78 58.01 0.00 0.00 8614.16 4927.34 17379.18 00:12:19.746 0 00:12:19.746 03:23:44 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1419374 00:12:19.746 03:23:44 -- common/autotest_common.sh@936 -- # '[' -z 1419374 ']' 00:12:19.746 03:23:44 -- common/autotest_common.sh@940 -- # kill -0 1419374 00:12:19.746 03:23:44 -- common/autotest_common.sh@941 -- # uname 00:12:19.746 03:23:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:19.746 03:23:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1419374 00:12:20.003 03:23:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:20.003 03:23:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:20.003 03:23:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1419374' 00:12:20.003 killing process with pid 1419374 00:12:20.003 03:23:44 -- common/autotest_common.sh@955 -- # kill 1419374 00:12:20.003 Received shutdown signal, test time was about 10.000000 seconds 00:12:20.003 00:12:20.003 Latency(us) 00:12:20.003 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:20.003 =================================================================================================================== 00:12:20.003 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:12:20.003 03:23:44 -- common/autotest_common.sh@960 -- # wait 1419374 00:12:20.261 03:23:44 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:20.519 03:23:45 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:20.519 03:23:45 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:12:20.776 03:23:45 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:12:20.776 03:23:45 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:12:20.776 03:23:45 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:20.777 [2024-04-27 03:23:45.734023] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:12:21.035 03:23:45 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:21.035 03:23:45 -- common/autotest_common.sh@638 -- # local es=0 00:12:21.035 03:23:45 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:21.035 03:23:45 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:21.035 03:23:45 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:21.035 03:23:45 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:21.035 03:23:45 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:21.035 03:23:45 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:21.035 03:23:45 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:21.035 03:23:45 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:21.035 03:23:45 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:12:21.035 03:23:45 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:21.035 request: 00:12:21.035 { 00:12:21.035 "uuid": "f4137cb1-4b54-4181-91ad-aafcd232b4c9", 00:12:21.035 "method": "bdev_lvol_get_lvstores", 00:12:21.035 "req_id": 1 00:12:21.035 } 00:12:21.035 Got JSON-RPC error response 00:12:21.035 response: 00:12:21.035 { 00:12:21.035 "code": -19, 00:12:21.035 "message": "No such device" 00:12:21.035 } 00:12:21.035 03:23:46 -- common/autotest_common.sh@641 -- # es=1 00:12:21.035 03:23:46 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:12:21.035 03:23:46 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:12:21.035 03:23:46 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:12:21.035 03:23:46 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:21.293 aio_bdev 00:12:21.293 03:23:46 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 1efd6506-6a2c-4fea-8056-e0d6fddc0c5c 00:12:21.293 03:23:46 -- common/autotest_common.sh@885 -- # local bdev_name=1efd6506-6a2c-4fea-8056-e0d6fddc0c5c 00:12:21.293 03:23:46 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:12:21.293 03:23:46 -- common/autotest_common.sh@887 -- # local i 00:12:21.293 03:23:46 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:12:21.293 03:23:46 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:12:21.293 03:23:46 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:12:21.859 03:23:46 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 1efd6506-6a2c-4fea-8056-e0d6fddc0c5c -t 2000 00:12:21.859 [ 00:12:21.859 { 00:12:21.859 "name": "1efd6506-6a2c-4fea-8056-e0d6fddc0c5c", 00:12:21.859 "aliases": [ 00:12:21.859 "lvs/lvol" 00:12:21.859 ], 00:12:21.859 "product_name": "Logical Volume", 00:12:21.859 "block_size": 4096, 00:12:21.859 "num_blocks": 38912, 00:12:21.859 "uuid": "1efd6506-6a2c-4fea-8056-e0d6fddc0c5c", 00:12:21.859 "assigned_rate_limits": { 00:12:21.859 "rw_ios_per_sec": 0, 00:12:21.859 "rw_mbytes_per_sec": 0, 00:12:21.859 "r_mbytes_per_sec": 0, 00:12:21.859 "w_mbytes_per_sec": 0 00:12:21.859 }, 00:12:21.859 "claimed": false, 00:12:21.859 "zoned": false, 00:12:21.859 "supported_io_types": { 00:12:21.859 "read": true, 00:12:21.859 "write": true, 00:12:21.859 "unmap": true, 00:12:21.859 "write_zeroes": true, 00:12:21.859 "flush": false, 00:12:21.859 "reset": true, 00:12:21.859 "compare": false, 00:12:21.859 "compare_and_write": false, 00:12:21.859 "abort": false, 00:12:21.859 "nvme_admin": false, 00:12:21.859 "nvme_io": false 00:12:21.859 }, 00:12:21.859 "driver_specific": { 00:12:21.859 "lvol": { 00:12:21.859 "lvol_store_uuid": "f4137cb1-4b54-4181-91ad-aafcd232b4c9", 00:12:21.859 "base_bdev": "aio_bdev", 00:12:21.859 "thin_provision": false, 00:12:21.859 "snapshot": false, 00:12:21.859 "clone": false, 00:12:21.859 "esnap_clone": false 00:12:21.859 } 00:12:21.859 } 00:12:21.859 } 00:12:21.859 ] 00:12:21.859 03:23:46 -- common/autotest_common.sh@893 -- # return 0 00:12:21.859 03:23:46 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:21.859 03:23:46 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:12:22.117 03:23:47 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:12:22.117 03:23:47 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:22.117 03:23:47 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:12:22.375 03:23:47 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:12:22.375 03:23:47 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 1efd6506-6a2c-4fea-8056-e0d6fddc0c5c 00:12:22.633 03:23:47 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u f4137cb1-4b54-4181-91ad-aafcd232b4c9 00:12:22.892 03:23:47 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:23.151 03:23:48 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:23.151 00:12:23.151 real 0m17.083s 00:12:23.151 user 0m16.625s 00:12:23.151 sys 0m1.891s 00:12:23.151 03:23:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:23.151 03:23:48 -- common/autotest_common.sh@10 -- # set +x 00:12:23.151 ************************************ 00:12:23.151 END TEST lvs_grow_clean 00:12:23.151 ************************************ 00:12:23.151 03:23:48 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:12:23.151 03:23:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:23.151 03:23:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:23.151 03:23:48 -- common/autotest_common.sh@10 -- # set +x 00:12:23.409 ************************************ 00:12:23.409 START TEST lvs_grow_dirty 00:12:23.409 ************************************ 00:12:23.409 03:23:48 -- common/autotest_common.sh@1111 -- # lvs_grow dirty 00:12:23.409 03:23:48 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:12:23.409 03:23:48 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:12:23.409 03:23:48 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:12:23.409 03:23:48 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:12:23.409 03:23:48 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:12:23.409 03:23:48 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:12:23.409 03:23:48 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:23.409 03:23:48 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:23.409 03:23:48 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:23.668 03:23:48 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:12:23.668 03:23:48 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:12:23.926 03:23:48 -- target/nvmf_lvs_grow.sh@28 -- # lvs=614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:23.926 03:23:48 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:23.926 03:23:48 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:12:24.184 03:23:49 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:12:24.184 03:23:49 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:12:24.184 03:23:49 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 614ea917-9d6c-4b6f-90c3-417019c3d94e lvol 150 00:12:24.443 03:23:49 -- target/nvmf_lvs_grow.sh@33 -- # lvol=19be7146-2a7e-4fa6-a430-48b11556377f 00:12:24.443 03:23:49 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:24.443 03:23:49 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:12:24.701 [2024-04-27 03:23:49.484451] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:12:24.701 [2024-04-27 03:23:49.484531] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:12:24.701 true 00:12:24.701 03:23:49 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:24.701 03:23:49 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:12:24.960 03:23:49 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:12:24.960 03:23:49 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:25.219 03:23:49 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 19be7146-2a7e-4fa6-a430-48b11556377f 00:12:25.478 03:23:50 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:25.736 03:23:50 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:25.999 03:23:50 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1421434 00:12:25.999 03:23:50 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:12:25.999 03:23:50 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:12:25.999 03:23:50 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1421434 /var/tmp/bdevperf.sock 00:12:25.999 03:23:50 -- common/autotest_common.sh@817 -- # '[' -z 1421434 ']' 00:12:25.999 03:23:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:12:25.999 03:23:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:25.999 03:23:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:12:25.999 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:12:25.999 03:23:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:25.999 03:23:50 -- common/autotest_common.sh@10 -- # set +x 00:12:25.999 [2024-04-27 03:23:50.794001] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:25.999 [2024-04-27 03:23:50.794093] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1421434 ] 00:12:25.999 EAL: No free 2048 kB hugepages reported on node 1 00:12:25.999 [2024-04-27 03:23:50.856719] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:25.999 [2024-04-27 03:23:50.968653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:26.302 03:23:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:26.302 03:23:51 -- common/autotest_common.sh@850 -- # return 0 00:12:26.302 03:23:51 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:12:26.585 Nvme0n1 00:12:26.585 03:23:51 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:12:26.843 [ 00:12:26.843 { 00:12:26.843 "name": "Nvme0n1", 00:12:26.843 "aliases": [ 00:12:26.843 "19be7146-2a7e-4fa6-a430-48b11556377f" 00:12:26.843 ], 00:12:26.843 "product_name": "NVMe disk", 00:12:26.843 "block_size": 4096, 00:12:26.843 "num_blocks": 38912, 00:12:26.843 "uuid": "19be7146-2a7e-4fa6-a430-48b11556377f", 00:12:26.843 "assigned_rate_limits": { 00:12:26.843 "rw_ios_per_sec": 0, 00:12:26.843 "rw_mbytes_per_sec": 0, 00:12:26.843 "r_mbytes_per_sec": 0, 00:12:26.843 "w_mbytes_per_sec": 0 00:12:26.843 }, 00:12:26.843 "claimed": false, 00:12:26.843 "zoned": false, 00:12:26.843 "supported_io_types": { 00:12:26.843 "read": true, 00:12:26.843 "write": true, 00:12:26.843 "unmap": true, 00:12:26.843 "write_zeroes": true, 00:12:26.843 "flush": true, 00:12:26.843 "reset": true, 00:12:26.843 "compare": true, 00:12:26.843 "compare_and_write": true, 00:12:26.843 "abort": true, 00:12:26.843 "nvme_admin": true, 00:12:26.843 "nvme_io": true 00:12:26.843 }, 00:12:26.843 "memory_domains": [ 00:12:26.843 { 00:12:26.843 "dma_device_id": "system", 00:12:26.843 "dma_device_type": 1 00:12:26.843 } 00:12:26.843 ], 00:12:26.843 "driver_specific": { 00:12:26.843 "nvme": [ 00:12:26.843 { 00:12:26.843 "trid": { 00:12:26.843 "trtype": "TCP", 00:12:26.843 "adrfam": "IPv4", 00:12:26.843 "traddr": "10.0.0.2", 00:12:26.843 "trsvcid": "4420", 00:12:26.843 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:12:26.843 }, 00:12:26.843 "ctrlr_data": { 00:12:26.843 "cntlid": 1, 00:12:26.843 "vendor_id": "0x8086", 00:12:26.843 "model_number": "SPDK bdev Controller", 00:12:26.843 "serial_number": "SPDK0", 00:12:26.843 "firmware_revision": "24.05", 00:12:26.843 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:12:26.843 "oacs": { 00:12:26.843 "security": 0, 00:12:26.843 "format": 0, 00:12:26.843 "firmware": 0, 00:12:26.843 "ns_manage": 0 00:12:26.843 }, 00:12:26.843 "multi_ctrlr": true, 00:12:26.843 "ana_reporting": false 00:12:26.843 }, 00:12:26.843 "vs": { 00:12:26.843 "nvme_version": "1.3" 00:12:26.843 }, 00:12:26.843 "ns_data": { 00:12:26.843 "id": 1, 00:12:26.843 "can_share": true 00:12:26.843 } 00:12:26.843 } 00:12:26.843 ], 00:12:26.843 "mp_policy": "active_passive" 00:12:26.843 } 00:12:26.843 } 00:12:26.843 ] 00:12:26.843 03:23:51 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1421570 00:12:26.843 03:23:51 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:12:26.843 03:23:51 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:12:27.101 Running I/O for 10 seconds... 00:12:28.032 Latency(us) 00:12:28.032 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:28.032 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:28.032 Nvme0n1 : 1.00 13971.00 54.57 0.00 0.00 0.00 0.00 0.00 00:12:28.032 =================================================================================================================== 00:12:28.032 Total : 13971.00 54.57 0.00 0.00 0.00 0.00 0.00 00:12:28.032 00:12:28.965 03:23:53 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:28.965 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:28.965 Nvme0n1 : 2.00 14288.00 55.81 0.00 0.00 0.00 0.00 0.00 00:12:28.965 =================================================================================================================== 00:12:28.965 Total : 14288.00 55.81 0.00 0.00 0.00 0.00 0.00 00:12:28.965 00:12:29.223 true 00:12:29.223 03:23:54 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:29.223 03:23:54 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:12:29.481 03:23:54 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:12:29.481 03:23:54 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:12:29.481 03:23:54 -- target/nvmf_lvs_grow.sh@65 -- # wait 1421570 00:12:30.048 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:30.048 Nvme0n1 : 3.00 14309.00 55.89 0.00 0.00 0.00 0.00 0.00 00:12:30.048 =================================================================================================================== 00:12:30.048 Total : 14309.00 55.89 0.00 0.00 0.00 0.00 0.00 00:12:30.048 00:12:30.982 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:30.982 Nvme0n1 : 4.00 14351.25 56.06 0.00 0.00 0.00 0.00 0.00 00:12:30.982 =================================================================================================================== 00:12:30.982 Total : 14351.25 56.06 0.00 0.00 0.00 0.00 0.00 00:12:30.982 00:12:31.916 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:31.916 Nvme0n1 : 5.00 14453.60 56.46 0.00 0.00 0.00 0.00 0.00 00:12:31.916 =================================================================================================================== 00:12:31.916 Total : 14453.60 56.46 0.00 0.00 0.00 0.00 0.00 00:12:31.916 00:12:33.292 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:33.292 Nvme0n1 : 6.00 14469.00 56.52 0.00 0.00 0.00 0.00 0.00 00:12:33.292 =================================================================================================================== 00:12:33.292 Total : 14469.00 56.52 0.00 0.00 0.00 0.00 0.00 00:12:33.292 00:12:34.225 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:34.225 Nvme0n1 : 7.00 14480.00 56.56 0.00 0.00 0.00 0.00 0.00 00:12:34.225 =================================================================================================================== 00:12:34.225 Total : 14480.00 56.56 0.00 0.00 0.00 0.00 0.00 00:12:34.225 00:12:35.159 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:35.159 Nvme0n1 : 8.00 14496.00 56.62 0.00 0.00 0.00 0.00 0.00 00:12:35.159 =================================================================================================================== 00:12:35.159 Total : 14496.00 56.62 0.00 0.00 0.00 0.00 0.00 00:12:35.159 00:12:36.091 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:36.091 Nvme0n1 : 9.00 14494.00 56.62 0.00 0.00 0.00 0.00 0.00 00:12:36.091 =================================================================================================================== 00:12:36.091 Total : 14494.00 56.62 0.00 0.00 0.00 0.00 0.00 00:12:36.091 00:12:37.025 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:37.025 Nvme0n1 : 10.00 14506.30 56.67 0.00 0.00 0.00 0.00 0.00 00:12:37.025 =================================================================================================================== 00:12:37.025 Total : 14506.30 56.67 0.00 0.00 0.00 0.00 0.00 00:12:37.025 00:12:37.025 00:12:37.025 Latency(us) 00:12:37.025 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:37.025 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:37.025 Nvme0n1 : 10.01 14506.91 56.67 0.00 0.00 8818.73 5291.43 17379.18 00:12:37.025 =================================================================================================================== 00:12:37.025 Total : 14506.91 56.67 0.00 0.00 8818.73 5291.43 17379.18 00:12:37.025 0 00:12:37.025 03:24:01 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1421434 00:12:37.025 03:24:01 -- common/autotest_common.sh@936 -- # '[' -z 1421434 ']' 00:12:37.025 03:24:01 -- common/autotest_common.sh@940 -- # kill -0 1421434 00:12:37.025 03:24:01 -- common/autotest_common.sh@941 -- # uname 00:12:37.025 03:24:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:37.025 03:24:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1421434 00:12:37.025 03:24:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:37.025 03:24:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:37.025 03:24:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1421434' 00:12:37.025 killing process with pid 1421434 00:12:37.025 03:24:01 -- common/autotest_common.sh@955 -- # kill 1421434 00:12:37.025 Received shutdown signal, test time was about 10.000000 seconds 00:12:37.025 00:12:37.025 Latency(us) 00:12:37.025 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:37.025 =================================================================================================================== 00:12:37.025 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:12:37.025 03:24:01 -- common/autotest_common.sh@960 -- # wait 1421434 00:12:37.283 03:24:02 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:37.542 03:24:02 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:37.542 03:24:02 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:12:37.800 03:24:02 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:12:37.800 03:24:02 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:12:37.800 03:24:02 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1418811 00:12:37.800 03:24:02 -- target/nvmf_lvs_grow.sh@74 -- # wait 1418811 00:12:37.800 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1418811 Killed "${NVMF_APP[@]}" "$@" 00:12:37.800 03:24:02 -- target/nvmf_lvs_grow.sh@74 -- # true 00:12:37.800 03:24:02 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:12:37.800 03:24:02 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:37.800 03:24:02 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:37.800 03:24:02 -- common/autotest_common.sh@10 -- # set +x 00:12:37.800 03:24:02 -- nvmf/common.sh@470 -- # nvmfpid=1422893 00:12:37.800 03:24:02 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:12:37.800 03:24:02 -- nvmf/common.sh@471 -- # waitforlisten 1422893 00:12:37.800 03:24:02 -- common/autotest_common.sh@817 -- # '[' -z 1422893 ']' 00:12:37.800 03:24:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:37.800 03:24:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:37.800 03:24:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:37.800 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:37.800 03:24:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:37.800 03:24:02 -- common/autotest_common.sh@10 -- # set +x 00:12:38.058 [2024-04-27 03:24:02.799116] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:38.058 [2024-04-27 03:24:02.799205] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:38.058 EAL: No free 2048 kB hugepages reported on node 1 00:12:38.058 [2024-04-27 03:24:02.866461] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:38.058 [2024-04-27 03:24:02.971830] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:38.058 [2024-04-27 03:24:02.971890] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:38.058 [2024-04-27 03:24:02.971903] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:38.058 [2024-04-27 03:24:02.971914] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:38.058 [2024-04-27 03:24:02.971923] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:38.058 [2024-04-27 03:24:02.971962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:38.314 03:24:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:38.314 03:24:03 -- common/autotest_common.sh@850 -- # return 0 00:12:38.315 03:24:03 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:38.315 03:24:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:38.315 03:24:03 -- common/autotest_common.sh@10 -- # set +x 00:12:38.315 03:24:03 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:38.315 03:24:03 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:38.572 [2024-04-27 03:24:03.336410] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:12:38.572 [2024-04-27 03:24:03.336540] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:12:38.572 [2024-04-27 03:24:03.336600] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:12:38.572 03:24:03 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:12:38.572 03:24:03 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 19be7146-2a7e-4fa6-a430-48b11556377f 00:12:38.572 03:24:03 -- common/autotest_common.sh@885 -- # local bdev_name=19be7146-2a7e-4fa6-a430-48b11556377f 00:12:38.572 03:24:03 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:12:38.572 03:24:03 -- common/autotest_common.sh@887 -- # local i 00:12:38.572 03:24:03 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:12:38.572 03:24:03 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:12:38.572 03:24:03 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:12:38.829 03:24:03 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 19be7146-2a7e-4fa6-a430-48b11556377f -t 2000 00:12:39.086 [ 00:12:39.086 { 00:12:39.086 "name": "19be7146-2a7e-4fa6-a430-48b11556377f", 00:12:39.086 "aliases": [ 00:12:39.086 "lvs/lvol" 00:12:39.086 ], 00:12:39.086 "product_name": "Logical Volume", 00:12:39.086 "block_size": 4096, 00:12:39.086 "num_blocks": 38912, 00:12:39.086 "uuid": "19be7146-2a7e-4fa6-a430-48b11556377f", 00:12:39.086 "assigned_rate_limits": { 00:12:39.086 "rw_ios_per_sec": 0, 00:12:39.086 "rw_mbytes_per_sec": 0, 00:12:39.086 "r_mbytes_per_sec": 0, 00:12:39.086 "w_mbytes_per_sec": 0 00:12:39.086 }, 00:12:39.086 "claimed": false, 00:12:39.086 "zoned": false, 00:12:39.086 "supported_io_types": { 00:12:39.086 "read": true, 00:12:39.086 "write": true, 00:12:39.086 "unmap": true, 00:12:39.086 "write_zeroes": true, 00:12:39.086 "flush": false, 00:12:39.086 "reset": true, 00:12:39.086 "compare": false, 00:12:39.086 "compare_and_write": false, 00:12:39.087 "abort": false, 00:12:39.087 "nvme_admin": false, 00:12:39.087 "nvme_io": false 00:12:39.087 }, 00:12:39.087 "driver_specific": { 00:12:39.087 "lvol": { 00:12:39.087 "lvol_store_uuid": "614ea917-9d6c-4b6f-90c3-417019c3d94e", 00:12:39.087 "base_bdev": "aio_bdev", 00:12:39.087 "thin_provision": false, 00:12:39.087 "snapshot": false, 00:12:39.087 "clone": false, 00:12:39.087 "esnap_clone": false 00:12:39.087 } 00:12:39.087 } 00:12:39.087 } 00:12:39.087 ] 00:12:39.087 03:24:03 -- common/autotest_common.sh@893 -- # return 0 00:12:39.087 03:24:03 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:39.087 03:24:03 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:12:39.344 03:24:04 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:12:39.344 03:24:04 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:39.344 03:24:04 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:12:39.602 03:24:04 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:12:39.602 03:24:04 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:39.859 [2024-04-27 03:24:04.593398] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:12:39.859 03:24:04 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:39.859 03:24:04 -- common/autotest_common.sh@638 -- # local es=0 00:12:39.859 03:24:04 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:39.859 03:24:04 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:39.859 03:24:04 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:39.859 03:24:04 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:39.859 03:24:04 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:39.859 03:24:04 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:39.859 03:24:04 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:39.859 03:24:04 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:39.859 03:24:04 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:12:39.859 03:24:04 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:40.117 request: 00:12:40.117 { 00:12:40.117 "uuid": "614ea917-9d6c-4b6f-90c3-417019c3d94e", 00:12:40.117 "method": "bdev_lvol_get_lvstores", 00:12:40.117 "req_id": 1 00:12:40.117 } 00:12:40.117 Got JSON-RPC error response 00:12:40.117 response: 00:12:40.117 { 00:12:40.117 "code": -19, 00:12:40.117 "message": "No such device" 00:12:40.117 } 00:12:40.117 03:24:04 -- common/autotest_common.sh@641 -- # es=1 00:12:40.117 03:24:04 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:12:40.117 03:24:04 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:12:40.117 03:24:04 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:12:40.117 03:24:04 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:40.375 aio_bdev 00:12:40.375 03:24:05 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 19be7146-2a7e-4fa6-a430-48b11556377f 00:12:40.375 03:24:05 -- common/autotest_common.sh@885 -- # local bdev_name=19be7146-2a7e-4fa6-a430-48b11556377f 00:12:40.375 03:24:05 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:12:40.375 03:24:05 -- common/autotest_common.sh@887 -- # local i 00:12:40.375 03:24:05 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:12:40.375 03:24:05 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:12:40.375 03:24:05 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:12:40.633 03:24:05 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 19be7146-2a7e-4fa6-a430-48b11556377f -t 2000 00:12:40.633 [ 00:12:40.633 { 00:12:40.633 "name": "19be7146-2a7e-4fa6-a430-48b11556377f", 00:12:40.633 "aliases": [ 00:12:40.633 "lvs/lvol" 00:12:40.633 ], 00:12:40.633 "product_name": "Logical Volume", 00:12:40.633 "block_size": 4096, 00:12:40.633 "num_blocks": 38912, 00:12:40.633 "uuid": "19be7146-2a7e-4fa6-a430-48b11556377f", 00:12:40.633 "assigned_rate_limits": { 00:12:40.633 "rw_ios_per_sec": 0, 00:12:40.633 "rw_mbytes_per_sec": 0, 00:12:40.633 "r_mbytes_per_sec": 0, 00:12:40.633 "w_mbytes_per_sec": 0 00:12:40.633 }, 00:12:40.633 "claimed": false, 00:12:40.633 "zoned": false, 00:12:40.633 "supported_io_types": { 00:12:40.633 "read": true, 00:12:40.633 "write": true, 00:12:40.633 "unmap": true, 00:12:40.633 "write_zeroes": true, 00:12:40.633 "flush": false, 00:12:40.633 "reset": true, 00:12:40.633 "compare": false, 00:12:40.633 "compare_and_write": false, 00:12:40.633 "abort": false, 00:12:40.633 "nvme_admin": false, 00:12:40.633 "nvme_io": false 00:12:40.633 }, 00:12:40.633 "driver_specific": { 00:12:40.633 "lvol": { 00:12:40.633 "lvol_store_uuid": "614ea917-9d6c-4b6f-90c3-417019c3d94e", 00:12:40.633 "base_bdev": "aio_bdev", 00:12:40.633 "thin_provision": false, 00:12:40.633 "snapshot": false, 00:12:40.633 "clone": false, 00:12:40.633 "esnap_clone": false 00:12:40.633 } 00:12:40.633 } 00:12:40.633 } 00:12:40.633 ] 00:12:40.633 03:24:05 -- common/autotest_common.sh@893 -- # return 0 00:12:40.891 03:24:05 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:40.891 03:24:05 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:12:40.891 03:24:05 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:12:40.891 03:24:05 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:40.891 03:24:05 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:12:41.149 03:24:06 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:12:41.149 03:24:06 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 19be7146-2a7e-4fa6-a430-48b11556377f 00:12:41.713 03:24:06 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 614ea917-9d6c-4b6f-90c3-417019c3d94e 00:12:41.713 03:24:06 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:42.279 03:24:06 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:42.279 00:12:42.279 real 0m18.782s 00:12:42.279 user 0m48.287s 00:12:42.279 sys 0m4.503s 00:12:42.279 03:24:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:42.279 03:24:06 -- common/autotest_common.sh@10 -- # set +x 00:12:42.279 ************************************ 00:12:42.279 END TEST lvs_grow_dirty 00:12:42.279 ************************************ 00:12:42.279 03:24:07 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:12:42.279 03:24:07 -- common/autotest_common.sh@794 -- # type=--id 00:12:42.279 03:24:07 -- common/autotest_common.sh@795 -- # id=0 00:12:42.279 03:24:07 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:12:42.279 03:24:07 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:12:42.279 03:24:07 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:12:42.279 03:24:07 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:12:42.279 03:24:07 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:12:42.279 03:24:07 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:12:42.279 nvmf_trace.0 00:12:42.279 03:24:07 -- common/autotest_common.sh@809 -- # return 0 00:12:42.279 03:24:07 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:12:42.279 03:24:07 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:42.279 03:24:07 -- nvmf/common.sh@117 -- # sync 00:12:42.279 03:24:07 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:12:42.279 03:24:07 -- nvmf/common.sh@120 -- # set +e 00:12:42.279 03:24:07 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:42.279 03:24:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:12:42.279 rmmod nvme_tcp 00:12:42.279 rmmod nvme_fabrics 00:12:42.279 rmmod nvme_keyring 00:12:42.279 03:24:07 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:42.279 03:24:07 -- nvmf/common.sh@124 -- # set -e 00:12:42.279 03:24:07 -- nvmf/common.sh@125 -- # return 0 00:12:42.279 03:24:07 -- nvmf/common.sh@478 -- # '[' -n 1422893 ']' 00:12:42.279 03:24:07 -- nvmf/common.sh@479 -- # killprocess 1422893 00:12:42.279 03:24:07 -- common/autotest_common.sh@936 -- # '[' -z 1422893 ']' 00:12:42.279 03:24:07 -- common/autotest_common.sh@940 -- # kill -0 1422893 00:12:42.279 03:24:07 -- common/autotest_common.sh@941 -- # uname 00:12:42.279 03:24:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:42.279 03:24:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1422893 00:12:42.279 03:24:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:42.279 03:24:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:42.279 03:24:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1422893' 00:12:42.279 killing process with pid 1422893 00:12:42.279 03:24:07 -- common/autotest_common.sh@955 -- # kill 1422893 00:12:42.279 03:24:07 -- common/autotest_common.sh@960 -- # wait 1422893 00:12:42.538 03:24:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:42.538 03:24:07 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:12:42.538 03:24:07 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:12:42.538 03:24:07 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:42.538 03:24:07 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:12:42.538 03:24:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:42.538 03:24:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:42.538 03:24:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:44.472 03:24:09 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:12:44.472 00:12:44.472 real 0m42.044s 00:12:44.472 user 1m10.831s 00:12:44.472 sys 0m8.417s 00:12:44.472 03:24:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:44.472 03:24:09 -- common/autotest_common.sh@10 -- # set +x 00:12:44.472 ************************************ 00:12:44.472 END TEST nvmf_lvs_grow 00:12:44.472 ************************************ 00:12:44.730 03:24:09 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:12:44.730 03:24:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:44.730 03:24:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:44.730 03:24:09 -- common/autotest_common.sh@10 -- # set +x 00:12:44.730 ************************************ 00:12:44.730 START TEST nvmf_bdev_io_wait 00:12:44.730 ************************************ 00:12:44.730 03:24:09 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:12:44.730 * Looking for test storage... 00:12:44.730 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:44.730 03:24:09 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:44.730 03:24:09 -- nvmf/common.sh@7 -- # uname -s 00:12:44.730 03:24:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:44.730 03:24:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:44.730 03:24:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:44.730 03:24:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:44.730 03:24:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:44.730 03:24:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:44.730 03:24:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:44.730 03:24:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:44.730 03:24:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:44.730 03:24:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:44.730 03:24:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:12:44.730 03:24:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:12:44.730 03:24:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:44.730 03:24:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:44.730 03:24:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:44.730 03:24:09 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:44.730 03:24:09 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:44.730 03:24:09 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:44.730 03:24:09 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:44.730 03:24:09 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:44.730 03:24:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:44.730 03:24:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:44.730 03:24:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:44.730 03:24:09 -- paths/export.sh@5 -- # export PATH 00:12:44.730 03:24:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:44.730 03:24:09 -- nvmf/common.sh@47 -- # : 0 00:12:44.730 03:24:09 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:44.730 03:24:09 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:44.730 03:24:09 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:44.730 03:24:09 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:44.730 03:24:09 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:44.730 03:24:09 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:44.730 03:24:09 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:44.730 03:24:09 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:44.730 03:24:09 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:44.730 03:24:09 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:44.730 03:24:09 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:12:44.730 03:24:09 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:12:44.730 03:24:09 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:44.730 03:24:09 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:44.730 03:24:09 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:44.730 03:24:09 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:44.730 03:24:09 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:44.730 03:24:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:44.730 03:24:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:44.730 03:24:09 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:44.730 03:24:09 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:44.730 03:24:09 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:44.730 03:24:09 -- common/autotest_common.sh@10 -- # set +x 00:12:46.631 03:24:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:46.631 03:24:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:46.631 03:24:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:46.631 03:24:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:46.631 03:24:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:46.631 03:24:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:46.631 03:24:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:46.631 03:24:11 -- nvmf/common.sh@295 -- # net_devs=() 00:12:46.631 03:24:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:46.631 03:24:11 -- nvmf/common.sh@296 -- # e810=() 00:12:46.631 03:24:11 -- nvmf/common.sh@296 -- # local -ga e810 00:12:46.631 03:24:11 -- nvmf/common.sh@297 -- # x722=() 00:12:46.631 03:24:11 -- nvmf/common.sh@297 -- # local -ga x722 00:12:46.632 03:24:11 -- nvmf/common.sh@298 -- # mlx=() 00:12:46.632 03:24:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:46.632 03:24:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:46.632 03:24:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:46.632 03:24:11 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:12:46.632 03:24:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:46.632 03:24:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:46.632 03:24:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:12:46.632 Found 0000:09:00.0 (0x8086 - 0x159b) 00:12:46.632 03:24:11 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:46.632 03:24:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:12:46.632 Found 0000:09:00.1 (0x8086 - 0x159b) 00:12:46.632 03:24:11 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:46.632 03:24:11 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:46.632 03:24:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:46.632 03:24:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:46.632 03:24:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:46.632 03:24:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:12:46.632 Found net devices under 0000:09:00.0: cvl_0_0 00:12:46.632 03:24:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:46.632 03:24:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:46.632 03:24:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:46.632 03:24:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:46.632 03:24:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:46.632 03:24:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:12:46.632 Found net devices under 0000:09:00.1: cvl_0_1 00:12:46.632 03:24:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:46.632 03:24:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:46.632 03:24:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:46.632 03:24:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:12:46.632 03:24:11 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:12:46.632 03:24:11 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:46.632 03:24:11 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:46.632 03:24:11 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:46.632 03:24:11 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:12:46.632 03:24:11 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:46.632 03:24:11 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:46.632 03:24:11 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:12:46.632 03:24:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:46.632 03:24:11 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:46.632 03:24:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:12:46.632 03:24:11 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:12:46.632 03:24:11 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:12:46.632 03:24:11 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:46.890 03:24:11 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:46.890 03:24:11 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:46.890 03:24:11 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:12:46.890 03:24:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:46.890 03:24:11 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:46.890 03:24:11 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:46.890 03:24:11 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:12:46.890 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:46.891 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:12:46.891 00:12:46.891 --- 10.0.0.2 ping statistics --- 00:12:46.891 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:46.891 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:12:46.891 03:24:11 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:46.891 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:46.891 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:12:46.891 00:12:46.891 --- 10.0.0.1 ping statistics --- 00:12:46.891 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:46.891 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:12:46.891 03:24:11 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:46.891 03:24:11 -- nvmf/common.sh@411 -- # return 0 00:12:46.891 03:24:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:46.891 03:24:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:46.891 03:24:11 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:12:46.891 03:24:11 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:12:46.891 03:24:11 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:46.891 03:24:11 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:12:46.891 03:24:11 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:12:46.891 03:24:11 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:12:46.891 03:24:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:46.891 03:24:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:46.891 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:12:46.891 03:24:11 -- nvmf/common.sh@470 -- # nvmfpid=1425928 00:12:46.891 03:24:11 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:12:46.891 03:24:11 -- nvmf/common.sh@471 -- # waitforlisten 1425928 00:12:46.891 03:24:11 -- common/autotest_common.sh@817 -- # '[' -z 1425928 ']' 00:12:46.891 03:24:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:46.891 03:24:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:46.891 03:24:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:46.891 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:46.891 03:24:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:46.891 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:12:46.891 [2024-04-27 03:24:11.780713] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:46.891 [2024-04-27 03:24:11.780796] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:46.891 EAL: No free 2048 kB hugepages reported on node 1 00:12:46.891 [2024-04-27 03:24:11.849890] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:47.150 [2024-04-27 03:24:11.967005] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:47.150 [2024-04-27 03:24:11.967067] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:47.150 [2024-04-27 03:24:11.967083] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:47.150 [2024-04-27 03:24:11.967095] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:47.150 [2024-04-27 03:24:11.967107] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:47.150 [2024-04-27 03:24:11.967165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:47.150 [2024-04-27 03:24:11.967240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:47.150 [2024-04-27 03:24:11.967294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:47.150 [2024-04-27 03:24:11.967298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:47.150 03:24:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:47.150 03:24:11 -- common/autotest_common.sh@850 -- # return 0 00:12:47.150 03:24:11 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:47.150 03:24:11 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:47.150 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:12:47.150 03:24:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:47.150 03:24:12 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:12:47.150 03:24:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:47.150 03:24:12 -- common/autotest_common.sh@10 -- # set +x 00:12:47.150 03:24:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:47.150 03:24:12 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:12:47.150 03:24:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:47.150 03:24:12 -- common/autotest_common.sh@10 -- # set +x 00:12:47.150 03:24:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:47.150 03:24:12 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:47.150 03:24:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:47.150 03:24:12 -- common/autotest_common.sh@10 -- # set +x 00:12:47.150 [2024-04-27 03:24:12.103899] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:47.150 03:24:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:47.150 03:24:12 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:12:47.150 03:24:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:47.150 03:24:12 -- common/autotest_common.sh@10 -- # set +x 00:12:47.409 Malloc0 00:12:47.409 03:24:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:47.409 03:24:12 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:12:47.409 03:24:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:47.409 03:24:12 -- common/autotest_common.sh@10 -- # set +x 00:12:47.409 03:24:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:47.409 03:24:12 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:47.409 03:24:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:47.409 03:24:12 -- common/autotest_common.sh@10 -- # set +x 00:12:47.409 03:24:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:47.409 03:24:12 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:47.409 03:24:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:47.409 03:24:12 -- common/autotest_common.sh@10 -- # set +x 00:12:47.409 [2024-04-27 03:24:12.176943] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:47.409 03:24:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:47.409 03:24:12 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1426071 00:12:47.409 03:24:12 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:12:47.409 03:24:12 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:12:47.409 03:24:12 -- target/bdev_io_wait.sh@30 -- # READ_PID=1426073 00:12:47.409 03:24:12 -- nvmf/common.sh@521 -- # config=() 00:12:47.409 03:24:12 -- nvmf/common.sh@521 -- # local subsystem config 00:12:47.409 03:24:12 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:12:47.409 03:24:12 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:12:47.409 { 00:12:47.409 "params": { 00:12:47.409 "name": "Nvme$subsystem", 00:12:47.409 "trtype": "$TEST_TRANSPORT", 00:12:47.409 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:47.409 "adrfam": "ipv4", 00:12:47.409 "trsvcid": "$NVMF_PORT", 00:12:47.409 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:47.409 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:47.409 "hdgst": ${hdgst:-false}, 00:12:47.409 "ddgst": ${ddgst:-false} 00:12:47.409 }, 00:12:47.409 "method": "bdev_nvme_attach_controller" 00:12:47.409 } 00:12:47.409 EOF 00:12:47.409 )") 00:12:47.410 03:24:12 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:12:47.410 03:24:12 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:12:47.410 03:24:12 -- nvmf/common.sh@521 -- # config=() 00:12:47.410 03:24:12 -- nvmf/common.sh@521 -- # local subsystem config 00:12:47.410 03:24:12 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1426075 00:12:47.410 03:24:12 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:12:47.410 03:24:12 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:12:47.410 { 00:12:47.410 "params": { 00:12:47.410 "name": "Nvme$subsystem", 00:12:47.410 "trtype": "$TEST_TRANSPORT", 00:12:47.410 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:47.410 "adrfam": "ipv4", 00:12:47.410 "trsvcid": "$NVMF_PORT", 00:12:47.410 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:47.410 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:47.410 "hdgst": ${hdgst:-false}, 00:12:47.410 "ddgst": ${ddgst:-false} 00:12:47.410 }, 00:12:47.410 "method": "bdev_nvme_attach_controller" 00:12:47.410 } 00:12:47.410 EOF 00:12:47.410 )") 00:12:47.410 03:24:12 -- nvmf/common.sh@543 -- # cat 00:12:47.410 03:24:12 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:12:47.410 03:24:12 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:12:47.410 03:24:12 -- nvmf/common.sh@521 -- # config=() 00:12:47.410 03:24:12 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1426078 00:12:47.410 03:24:12 -- nvmf/common.sh@521 -- # local subsystem config 00:12:47.410 03:24:12 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:12:47.410 03:24:12 -- target/bdev_io_wait.sh@35 -- # sync 00:12:47.410 03:24:12 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:12:47.410 { 00:12:47.410 "params": { 00:12:47.410 "name": "Nvme$subsystem", 00:12:47.410 "trtype": "$TEST_TRANSPORT", 00:12:47.410 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:47.410 "adrfam": "ipv4", 00:12:47.410 "trsvcid": "$NVMF_PORT", 00:12:47.410 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:47.410 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:47.410 "hdgst": ${hdgst:-false}, 00:12:47.410 "ddgst": ${ddgst:-false} 00:12:47.410 }, 00:12:47.410 "method": "bdev_nvme_attach_controller" 00:12:47.410 } 00:12:47.410 EOF 00:12:47.410 )") 00:12:47.410 03:24:12 -- nvmf/common.sh@543 -- # cat 00:12:47.410 03:24:12 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:12:47.410 03:24:12 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:12:47.410 03:24:12 -- nvmf/common.sh@521 -- # config=() 00:12:47.410 03:24:12 -- nvmf/common.sh@521 -- # local subsystem config 00:12:47.410 03:24:12 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:12:47.410 03:24:12 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:12:47.410 { 00:12:47.410 "params": { 00:12:47.410 "name": "Nvme$subsystem", 00:12:47.410 "trtype": "$TEST_TRANSPORT", 00:12:47.410 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:47.410 "adrfam": "ipv4", 00:12:47.410 "trsvcid": "$NVMF_PORT", 00:12:47.410 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:47.410 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:47.410 "hdgst": ${hdgst:-false}, 00:12:47.410 "ddgst": ${ddgst:-false} 00:12:47.410 }, 00:12:47.410 "method": "bdev_nvme_attach_controller" 00:12:47.410 } 00:12:47.410 EOF 00:12:47.410 )") 00:12:47.410 03:24:12 -- nvmf/common.sh@543 -- # cat 00:12:47.410 03:24:12 -- nvmf/common.sh@543 -- # cat 00:12:47.410 03:24:12 -- nvmf/common.sh@545 -- # jq . 00:12:47.410 03:24:12 -- target/bdev_io_wait.sh@37 -- # wait 1426071 00:12:47.410 03:24:12 -- nvmf/common.sh@545 -- # jq . 00:12:47.410 03:24:12 -- nvmf/common.sh@546 -- # IFS=, 00:12:47.410 03:24:12 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:12:47.410 "params": { 00:12:47.410 "name": "Nvme1", 00:12:47.410 "trtype": "tcp", 00:12:47.410 "traddr": "10.0.0.2", 00:12:47.410 "adrfam": "ipv4", 00:12:47.410 "trsvcid": "4420", 00:12:47.410 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:47.410 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:47.410 "hdgst": false, 00:12:47.410 "ddgst": false 00:12:47.410 }, 00:12:47.410 "method": "bdev_nvme_attach_controller" 00:12:47.410 }' 00:12:47.410 03:24:12 -- nvmf/common.sh@545 -- # jq . 00:12:47.410 03:24:12 -- nvmf/common.sh@546 -- # IFS=, 00:12:47.410 03:24:12 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:12:47.410 "params": { 00:12:47.410 "name": "Nvme1", 00:12:47.410 "trtype": "tcp", 00:12:47.410 "traddr": "10.0.0.2", 00:12:47.410 "adrfam": "ipv4", 00:12:47.410 "trsvcid": "4420", 00:12:47.410 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:47.410 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:47.410 "hdgst": false, 00:12:47.410 "ddgst": false 00:12:47.410 }, 00:12:47.410 "method": "bdev_nvme_attach_controller" 00:12:47.410 }' 00:12:47.410 03:24:12 -- nvmf/common.sh@545 -- # jq . 00:12:47.410 03:24:12 -- nvmf/common.sh@546 -- # IFS=, 00:12:47.410 03:24:12 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:12:47.410 "params": { 00:12:47.410 "name": "Nvme1", 00:12:47.410 "trtype": "tcp", 00:12:47.410 "traddr": "10.0.0.2", 00:12:47.410 "adrfam": "ipv4", 00:12:47.410 "trsvcid": "4420", 00:12:47.410 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:47.410 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:47.410 "hdgst": false, 00:12:47.410 "ddgst": false 00:12:47.410 }, 00:12:47.410 "method": "bdev_nvme_attach_controller" 00:12:47.410 }' 00:12:47.410 03:24:12 -- nvmf/common.sh@546 -- # IFS=, 00:12:47.410 03:24:12 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:12:47.410 "params": { 00:12:47.410 "name": "Nvme1", 00:12:47.410 "trtype": "tcp", 00:12:47.410 "traddr": "10.0.0.2", 00:12:47.410 "adrfam": "ipv4", 00:12:47.410 "trsvcid": "4420", 00:12:47.410 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:47.410 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:47.410 "hdgst": false, 00:12:47.410 "ddgst": false 00:12:47.410 }, 00:12:47.410 "method": "bdev_nvme_attach_controller" 00:12:47.410 }' 00:12:47.410 [2024-04-27 03:24:12.225961] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:47.410 [2024-04-27 03:24:12.225961] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:47.410 [2024-04-27 03:24:12.225961] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:47.410 [2024-04-27 03:24:12.225967] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:47.410 [2024-04-27 03:24:12.226050] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-04-27 03:24:12.226051] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-04-27 03:24:12.226051] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-04-27 03:24:12.226052] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:12:47.410 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:12:47.410 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:12:47.410 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:12:47.410 EAL: No free 2048 kB hugepages reported on node 1 00:12:47.410 EAL: No free 2048 kB hugepages reported on node 1 00:12:47.668 [2024-04-27 03:24:12.400649] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:47.668 EAL: No free 2048 kB hugepages reported on node 1 00:12:47.668 [2024-04-27 03:24:12.497340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:12:47.668 [2024-04-27 03:24:12.504352] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:47.668 EAL: No free 2048 kB hugepages reported on node 1 00:12:47.668 [2024-04-27 03:24:12.599639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:12:47.668 [2024-04-27 03:24:12.623645] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:47.926 [2024-04-27 03:24:12.678101] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:47.926 [2024-04-27 03:24:12.722259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:12:47.926 [2024-04-27 03:24:12.766212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:12:47.926 Running I/O for 1 seconds... 00:12:48.184 Running I/O for 1 seconds... 00:12:48.184 Running I/O for 1 seconds... 00:12:48.184 Running I/O for 1 seconds... 00:12:49.119 00:12:49.119 Latency(us) 00:12:49.119 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:49.119 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:12:49.119 Nvme1n1 : 1.06 6081.98 23.76 0.00 0.00 20091.81 9126.49 60972.75 00:12:49.119 =================================================================================================================== 00:12:49.119 Total : 6081.98 23.76 0.00 0.00 20091.81 9126.49 60972.75 00:12:49.119 00:12:49.119 Latency(us) 00:12:49.119 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:49.119 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:12:49.119 Nvme1n1 : 1.01 6103.57 23.84 0.00 0.00 20892.86 6796.33 42137.22 00:12:49.119 =================================================================================================================== 00:12:49.119 Total : 6103.57 23.84 0.00 0.00 20892.86 6796.33 42137.22 00:12:49.119 00:12:49.119 Latency(us) 00:12:49.119 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:49.119 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:12:49.119 Nvme1n1 : 1.01 9438.70 36.87 0.00 0.00 13509.32 6407.96 26796.94 00:12:49.119 =================================================================================================================== 00:12:49.119 Total : 9438.70 36.87 0.00 0.00 13509.32 6407.96 26796.94 00:12:49.119 00:12:49.119 Latency(us) 00:12:49.119 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:49.119 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:12:49.119 Nvme1n1 : 1.00 200965.92 785.02 0.00 0.00 634.52 248.79 843.47 00:12:49.119 =================================================================================================================== 00:12:49.119 Total : 200965.92 785.02 0.00 0.00 634.52 248.79 843.47 00:12:49.377 03:24:14 -- target/bdev_io_wait.sh@38 -- # wait 1426073 00:12:49.377 03:24:14 -- target/bdev_io_wait.sh@39 -- # wait 1426075 00:12:49.377 03:24:14 -- target/bdev_io_wait.sh@40 -- # wait 1426078 00:12:49.377 03:24:14 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:49.377 03:24:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:49.377 03:24:14 -- common/autotest_common.sh@10 -- # set +x 00:12:49.377 03:24:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:49.377 03:24:14 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:12:49.378 03:24:14 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:12:49.378 03:24:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:49.378 03:24:14 -- nvmf/common.sh@117 -- # sync 00:12:49.378 03:24:14 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:12:49.378 03:24:14 -- nvmf/common.sh@120 -- # set +e 00:12:49.378 03:24:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:49.378 03:24:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:12:49.378 rmmod nvme_tcp 00:12:49.635 rmmod nvme_fabrics 00:12:49.635 rmmod nvme_keyring 00:12:49.635 03:24:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:49.635 03:24:14 -- nvmf/common.sh@124 -- # set -e 00:12:49.635 03:24:14 -- nvmf/common.sh@125 -- # return 0 00:12:49.635 03:24:14 -- nvmf/common.sh@478 -- # '[' -n 1425928 ']' 00:12:49.635 03:24:14 -- nvmf/common.sh@479 -- # killprocess 1425928 00:12:49.635 03:24:14 -- common/autotest_common.sh@936 -- # '[' -z 1425928 ']' 00:12:49.635 03:24:14 -- common/autotest_common.sh@940 -- # kill -0 1425928 00:12:49.635 03:24:14 -- common/autotest_common.sh@941 -- # uname 00:12:49.635 03:24:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:49.636 03:24:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1425928 00:12:49.636 03:24:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:49.636 03:24:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:49.636 03:24:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1425928' 00:12:49.636 killing process with pid 1425928 00:12:49.636 03:24:14 -- common/autotest_common.sh@955 -- # kill 1425928 00:12:49.636 03:24:14 -- common/autotest_common.sh@960 -- # wait 1425928 00:12:49.895 03:24:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:49.895 03:24:14 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:12:49.895 03:24:14 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:12:49.895 03:24:14 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:49.895 03:24:14 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:12:49.895 03:24:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:49.895 03:24:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:49.895 03:24:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:51.799 03:24:16 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:12:51.799 00:12:51.799 real 0m7.202s 00:12:51.799 user 0m16.949s 00:12:51.799 sys 0m3.345s 00:12:51.799 03:24:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:51.799 03:24:16 -- common/autotest_common.sh@10 -- # set +x 00:12:51.799 ************************************ 00:12:51.799 END TEST nvmf_bdev_io_wait 00:12:51.799 ************************************ 00:12:51.799 03:24:16 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:12:51.799 03:24:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:51.799 03:24:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:51.799 03:24:16 -- common/autotest_common.sh@10 -- # set +x 00:12:52.057 ************************************ 00:12:52.057 START TEST nvmf_queue_depth 00:12:52.057 ************************************ 00:12:52.057 03:24:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:12:52.057 * Looking for test storage... 00:12:52.057 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:52.057 03:24:16 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:52.057 03:24:16 -- nvmf/common.sh@7 -- # uname -s 00:12:52.057 03:24:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:52.057 03:24:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:52.057 03:24:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:52.057 03:24:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:52.057 03:24:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:52.057 03:24:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:52.057 03:24:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:52.057 03:24:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:52.057 03:24:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:52.057 03:24:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:52.057 03:24:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:12:52.057 03:24:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:12:52.057 03:24:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:52.057 03:24:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:52.057 03:24:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:52.057 03:24:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:52.058 03:24:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:52.058 03:24:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:52.058 03:24:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:52.058 03:24:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:52.058 03:24:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.058 03:24:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.058 03:24:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.058 03:24:16 -- paths/export.sh@5 -- # export PATH 00:12:52.058 03:24:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.058 03:24:16 -- nvmf/common.sh@47 -- # : 0 00:12:52.058 03:24:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:52.058 03:24:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:52.058 03:24:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:52.058 03:24:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:52.058 03:24:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:52.058 03:24:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:52.058 03:24:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:52.058 03:24:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:52.058 03:24:16 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:12:52.058 03:24:16 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:12:52.058 03:24:16 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:12:52.058 03:24:16 -- target/queue_depth.sh@19 -- # nvmftestinit 00:12:52.058 03:24:16 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:12:52.058 03:24:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:52.058 03:24:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:52.058 03:24:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:52.058 03:24:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:52.058 03:24:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:52.058 03:24:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:52.058 03:24:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:52.058 03:24:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:52.058 03:24:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:52.058 03:24:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:52.058 03:24:16 -- common/autotest_common.sh@10 -- # set +x 00:12:53.960 03:24:18 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:53.960 03:24:18 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:53.960 03:24:18 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:53.960 03:24:18 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:53.960 03:24:18 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:53.960 03:24:18 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:53.960 03:24:18 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:53.960 03:24:18 -- nvmf/common.sh@295 -- # net_devs=() 00:12:53.960 03:24:18 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:53.960 03:24:18 -- nvmf/common.sh@296 -- # e810=() 00:12:53.960 03:24:18 -- nvmf/common.sh@296 -- # local -ga e810 00:12:53.960 03:24:18 -- nvmf/common.sh@297 -- # x722=() 00:12:53.960 03:24:18 -- nvmf/common.sh@297 -- # local -ga x722 00:12:53.960 03:24:18 -- nvmf/common.sh@298 -- # mlx=() 00:12:53.960 03:24:18 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:53.960 03:24:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:53.960 03:24:18 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:53.960 03:24:18 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:53.960 03:24:18 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:53.960 03:24:18 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:53.960 03:24:18 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:53.960 03:24:18 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:53.960 03:24:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:53.961 03:24:18 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:53.961 03:24:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:53.961 03:24:18 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:53.961 03:24:18 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:53.961 03:24:18 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:12:53.961 03:24:18 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:53.961 03:24:18 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:53.961 03:24:18 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:12:53.961 Found 0000:09:00.0 (0x8086 - 0x159b) 00:12:53.961 03:24:18 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:53.961 03:24:18 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:12:53.961 Found 0000:09:00.1 (0x8086 - 0x159b) 00:12:53.961 03:24:18 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:53.961 03:24:18 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:53.961 03:24:18 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:53.961 03:24:18 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:53.961 03:24:18 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:53.961 03:24:18 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:12:53.961 Found net devices under 0000:09:00.0: cvl_0_0 00:12:53.961 03:24:18 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:53.961 03:24:18 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:53.961 03:24:18 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:53.961 03:24:18 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:53.961 03:24:18 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:53.961 03:24:18 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:12:53.961 Found net devices under 0000:09:00.1: cvl_0_1 00:12:53.961 03:24:18 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:53.961 03:24:18 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:53.961 03:24:18 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:53.961 03:24:18 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:12:53.961 03:24:18 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:12:53.961 03:24:18 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:53.961 03:24:18 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:53.961 03:24:18 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:53.961 03:24:18 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:12:53.961 03:24:18 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:53.961 03:24:18 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:53.961 03:24:18 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:12:53.961 03:24:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:53.961 03:24:18 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:53.961 03:24:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:12:53.961 03:24:18 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:12:53.961 03:24:18 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:12:53.961 03:24:18 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:54.220 03:24:18 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:54.220 03:24:18 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:54.220 03:24:18 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:12:54.220 03:24:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:54.220 03:24:19 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:54.220 03:24:19 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:54.220 03:24:19 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:12:54.220 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:54.220 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.265 ms 00:12:54.220 00:12:54.220 --- 10.0.0.2 ping statistics --- 00:12:54.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:54.220 rtt min/avg/max/mdev = 0.265/0.265/0.265/0.000 ms 00:12:54.220 03:24:19 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:54.220 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:54.220 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:12:54.220 00:12:54.220 --- 10.0.0.1 ping statistics --- 00:12:54.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:54.220 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:12:54.220 03:24:19 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:54.220 03:24:19 -- nvmf/common.sh@411 -- # return 0 00:12:54.220 03:24:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:54.220 03:24:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:54.220 03:24:19 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:12:54.220 03:24:19 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:12:54.220 03:24:19 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:54.220 03:24:19 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:12:54.220 03:24:19 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:12:54.220 03:24:19 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:12:54.220 03:24:19 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:54.220 03:24:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:54.220 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:12:54.220 03:24:19 -- nvmf/common.sh@470 -- # nvmfpid=1428297 00:12:54.220 03:24:19 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:12:54.220 03:24:19 -- nvmf/common.sh@471 -- # waitforlisten 1428297 00:12:54.220 03:24:19 -- common/autotest_common.sh@817 -- # '[' -z 1428297 ']' 00:12:54.220 03:24:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:54.220 03:24:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:54.220 03:24:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:54.220 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:54.220 03:24:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:54.220 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:12:54.220 [2024-04-27 03:24:19.098114] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:54.220 [2024-04-27 03:24:19.098195] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:54.220 EAL: No free 2048 kB hugepages reported on node 1 00:12:54.220 [2024-04-27 03:24:19.162613] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:54.478 [2024-04-27 03:24:19.270497] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:54.478 [2024-04-27 03:24:19.270554] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:54.478 [2024-04-27 03:24:19.270568] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:54.478 [2024-04-27 03:24:19.270579] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:54.478 [2024-04-27 03:24:19.270590] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:54.478 [2024-04-27 03:24:19.270617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:54.478 03:24:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:54.478 03:24:19 -- common/autotest_common.sh@850 -- # return 0 00:12:54.478 03:24:19 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:54.478 03:24:19 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:54.478 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:12:54.478 03:24:19 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:54.478 03:24:19 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:54.478 03:24:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.478 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:12:54.478 [2024-04-27 03:24:19.418316] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:54.478 03:24:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.478 03:24:19 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:12:54.478 03:24:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.478 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:12:54.737 Malloc0 00:12:54.737 03:24:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.737 03:24:19 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:12:54.737 03:24:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.737 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:12:54.737 03:24:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.737 03:24:19 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:54.737 03:24:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.737 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:12:54.737 03:24:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.737 03:24:19 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:54.737 03:24:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.737 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:12:54.737 [2024-04-27 03:24:19.479936] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:54.737 03:24:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.737 03:24:19 -- target/queue_depth.sh@30 -- # bdevperf_pid=1428328 00:12:54.737 03:24:19 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:12:54.737 03:24:19 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:12:54.737 03:24:19 -- target/queue_depth.sh@33 -- # waitforlisten 1428328 /var/tmp/bdevperf.sock 00:12:54.737 03:24:19 -- common/autotest_common.sh@817 -- # '[' -z 1428328 ']' 00:12:54.737 03:24:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:12:54.737 03:24:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:54.737 03:24:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:12:54.737 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:12:54.737 03:24:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:54.737 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:12:54.737 [2024-04-27 03:24:19.524465] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:12:54.737 [2024-04-27 03:24:19.524534] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1428328 ] 00:12:54.737 EAL: No free 2048 kB hugepages reported on node 1 00:12:54.737 [2024-04-27 03:24:19.586197] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:54.737 [2024-04-27 03:24:19.698435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:54.996 03:24:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:54.996 03:24:19 -- common/autotest_common.sh@850 -- # return 0 00:12:54.996 03:24:19 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:12:54.996 03:24:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.996 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:12:55.254 NVMe0n1 00:12:55.254 03:24:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:55.254 03:24:20 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:12:55.254 Running I/O for 10 seconds... 00:13:07.453 00:13:07.453 Latency(us) 00:13:07.453 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:07.453 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:13:07.453 Verification LBA range: start 0x0 length 0x4000 00:13:07.453 NVMe0n1 : 10.09 8310.69 32.46 0.00 0.00 122701.67 24758.04 75342.13 00:13:07.453 =================================================================================================================== 00:13:07.453 Total : 8310.69 32.46 0.00 0.00 122701.67 24758.04 75342.13 00:13:07.453 0 00:13:07.453 03:24:30 -- target/queue_depth.sh@39 -- # killprocess 1428328 00:13:07.453 03:24:30 -- common/autotest_common.sh@936 -- # '[' -z 1428328 ']' 00:13:07.453 03:24:30 -- common/autotest_common.sh@940 -- # kill -0 1428328 00:13:07.453 03:24:30 -- common/autotest_common.sh@941 -- # uname 00:13:07.453 03:24:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:07.453 03:24:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1428328 00:13:07.453 03:24:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:07.453 03:24:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:07.453 03:24:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1428328' 00:13:07.453 killing process with pid 1428328 00:13:07.453 03:24:30 -- common/autotest_common.sh@955 -- # kill 1428328 00:13:07.453 Received shutdown signal, test time was about 10.000000 seconds 00:13:07.453 00:13:07.453 Latency(us) 00:13:07.453 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:07.453 =================================================================================================================== 00:13:07.453 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:13:07.453 03:24:30 -- common/autotest_common.sh@960 -- # wait 1428328 00:13:07.453 03:24:30 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:07.453 03:24:30 -- target/queue_depth.sh@43 -- # nvmftestfini 00:13:07.453 03:24:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:07.453 03:24:30 -- nvmf/common.sh@117 -- # sync 00:13:07.453 03:24:30 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:13:07.453 03:24:30 -- nvmf/common.sh@120 -- # set +e 00:13:07.453 03:24:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:07.453 03:24:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:13:07.453 rmmod nvme_tcp 00:13:07.453 rmmod nvme_fabrics 00:13:07.453 rmmod nvme_keyring 00:13:07.453 03:24:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:07.453 03:24:30 -- nvmf/common.sh@124 -- # set -e 00:13:07.453 03:24:30 -- nvmf/common.sh@125 -- # return 0 00:13:07.453 03:24:30 -- nvmf/common.sh@478 -- # '[' -n 1428297 ']' 00:13:07.453 03:24:30 -- nvmf/common.sh@479 -- # killprocess 1428297 00:13:07.453 03:24:30 -- common/autotest_common.sh@936 -- # '[' -z 1428297 ']' 00:13:07.453 03:24:30 -- common/autotest_common.sh@940 -- # kill -0 1428297 00:13:07.453 03:24:30 -- common/autotest_common.sh@941 -- # uname 00:13:07.453 03:24:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:07.453 03:24:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1428297 00:13:07.453 03:24:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:07.453 03:24:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:07.453 03:24:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1428297' 00:13:07.453 killing process with pid 1428297 00:13:07.453 03:24:30 -- common/autotest_common.sh@955 -- # kill 1428297 00:13:07.453 03:24:30 -- common/autotest_common.sh@960 -- # wait 1428297 00:13:07.453 03:24:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:07.453 03:24:31 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:13:07.453 03:24:31 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:13:07.453 03:24:31 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:07.453 03:24:31 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:13:07.453 03:24:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:07.453 03:24:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:07.453 03:24:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:08.389 03:24:33 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:13:08.389 00:13:08.389 real 0m16.174s 00:13:08.389 user 0m22.854s 00:13:08.389 sys 0m2.979s 00:13:08.389 03:24:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:08.389 03:24:33 -- common/autotest_common.sh@10 -- # set +x 00:13:08.389 ************************************ 00:13:08.389 END TEST nvmf_queue_depth 00:13:08.389 ************************************ 00:13:08.389 03:24:33 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:13:08.389 03:24:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:08.389 03:24:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:08.389 03:24:33 -- common/autotest_common.sh@10 -- # set +x 00:13:08.389 ************************************ 00:13:08.389 START TEST nvmf_multipath 00:13:08.389 ************************************ 00:13:08.389 03:24:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:13:08.389 * Looking for test storage... 00:13:08.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:08.389 03:24:33 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:08.389 03:24:33 -- nvmf/common.sh@7 -- # uname -s 00:13:08.389 03:24:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:08.389 03:24:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:08.389 03:24:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:08.389 03:24:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:08.389 03:24:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:08.389 03:24:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:08.389 03:24:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:08.389 03:24:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:08.389 03:24:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:08.389 03:24:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:08.389 03:24:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:13:08.389 03:24:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:13:08.389 03:24:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:08.389 03:24:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:08.389 03:24:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:08.389 03:24:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:08.389 03:24:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:08.389 03:24:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:08.389 03:24:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:08.389 03:24:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:08.389 03:24:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.389 03:24:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.389 03:24:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.389 03:24:33 -- paths/export.sh@5 -- # export PATH 00:13:08.390 03:24:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.390 03:24:33 -- nvmf/common.sh@47 -- # : 0 00:13:08.390 03:24:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:08.390 03:24:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:08.390 03:24:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:08.390 03:24:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:08.390 03:24:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:08.390 03:24:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:08.390 03:24:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:08.390 03:24:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:08.390 03:24:33 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:08.390 03:24:33 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:08.390 03:24:33 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:13:08.390 03:24:33 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:08.390 03:24:33 -- target/multipath.sh@43 -- # nvmftestinit 00:13:08.390 03:24:33 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:13:08.390 03:24:33 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:08.390 03:24:33 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:08.390 03:24:33 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:08.390 03:24:33 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:08.390 03:24:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:08.390 03:24:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:08.390 03:24:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:08.390 03:24:33 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:08.390 03:24:33 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:08.390 03:24:33 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:08.390 03:24:33 -- common/autotest_common.sh@10 -- # set +x 00:13:10.292 03:24:35 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:10.292 03:24:35 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:10.292 03:24:35 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:10.292 03:24:35 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:10.292 03:24:35 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:10.292 03:24:35 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:10.292 03:24:35 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:10.292 03:24:35 -- nvmf/common.sh@295 -- # net_devs=() 00:13:10.292 03:24:35 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:10.292 03:24:35 -- nvmf/common.sh@296 -- # e810=() 00:13:10.292 03:24:35 -- nvmf/common.sh@296 -- # local -ga e810 00:13:10.292 03:24:35 -- nvmf/common.sh@297 -- # x722=() 00:13:10.292 03:24:35 -- nvmf/common.sh@297 -- # local -ga x722 00:13:10.292 03:24:35 -- nvmf/common.sh@298 -- # mlx=() 00:13:10.292 03:24:35 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:10.292 03:24:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:10.292 03:24:35 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:10.292 03:24:35 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:10.292 03:24:35 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:10.292 03:24:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:10.292 03:24:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:13:10.292 Found 0000:09:00.0 (0x8086 - 0x159b) 00:13:10.292 03:24:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:10.292 03:24:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:13:10.292 Found 0000:09:00.1 (0x8086 - 0x159b) 00:13:10.292 03:24:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:10.292 03:24:35 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:10.292 03:24:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:10.292 03:24:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:10.292 03:24:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:10.292 03:24:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:13:10.292 Found net devices under 0000:09:00.0: cvl_0_0 00:13:10.292 03:24:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:10.292 03:24:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:10.292 03:24:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:10.292 03:24:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:10.292 03:24:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:10.292 03:24:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:13:10.292 Found net devices under 0000:09:00.1: cvl_0_1 00:13:10.292 03:24:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:10.292 03:24:35 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:10.292 03:24:35 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:10.292 03:24:35 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:13:10.292 03:24:35 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:13:10.292 03:24:35 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:10.292 03:24:35 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:10.292 03:24:35 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:10.292 03:24:35 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:13:10.292 03:24:35 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:10.292 03:24:35 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:10.292 03:24:35 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:13:10.292 03:24:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:10.292 03:24:35 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:10.292 03:24:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:13:10.292 03:24:35 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:13:10.292 03:24:35 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:13:10.292 03:24:35 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:10.292 03:24:35 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:10.292 03:24:35 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:10.292 03:24:35 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:13:10.292 03:24:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:10.551 03:24:35 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:10.551 03:24:35 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:10.551 03:24:35 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:13:10.551 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:10.551 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.141 ms 00:13:10.551 00:13:10.551 --- 10.0.0.2 ping statistics --- 00:13:10.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:10.551 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:13:10.551 03:24:35 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:10.551 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:10.551 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.187 ms 00:13:10.551 00:13:10.551 --- 10.0.0.1 ping statistics --- 00:13:10.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:10.551 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:13:10.551 03:24:35 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:10.551 03:24:35 -- nvmf/common.sh@411 -- # return 0 00:13:10.551 03:24:35 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:10.551 03:24:35 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:10.551 03:24:35 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:13:10.551 03:24:35 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:13:10.551 03:24:35 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:10.551 03:24:35 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:13:10.551 03:24:35 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:13:10.551 03:24:35 -- target/multipath.sh@45 -- # '[' -z ']' 00:13:10.551 03:24:35 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:13:10.551 only one NIC for nvmf test 00:13:10.551 03:24:35 -- target/multipath.sh@47 -- # nvmftestfini 00:13:10.551 03:24:35 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:10.551 03:24:35 -- nvmf/common.sh@117 -- # sync 00:13:10.551 03:24:35 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:13:10.551 03:24:35 -- nvmf/common.sh@120 -- # set +e 00:13:10.551 03:24:35 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:10.551 03:24:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:13:10.551 rmmod nvme_tcp 00:13:10.551 rmmod nvme_fabrics 00:13:10.551 rmmod nvme_keyring 00:13:10.551 03:24:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:10.551 03:24:35 -- nvmf/common.sh@124 -- # set -e 00:13:10.551 03:24:35 -- nvmf/common.sh@125 -- # return 0 00:13:10.551 03:24:35 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:13:10.551 03:24:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:10.551 03:24:35 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:13:10.551 03:24:35 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:13:10.551 03:24:35 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:10.551 03:24:35 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:13:10.551 03:24:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:10.551 03:24:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:10.551 03:24:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:12.494 03:24:37 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:13:12.494 03:24:37 -- target/multipath.sh@48 -- # exit 0 00:13:12.494 03:24:37 -- target/multipath.sh@1 -- # nvmftestfini 00:13:12.494 03:24:37 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:12.494 03:24:37 -- nvmf/common.sh@117 -- # sync 00:13:12.494 03:24:37 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:13:12.494 03:24:37 -- nvmf/common.sh@120 -- # set +e 00:13:12.494 03:24:37 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:12.494 03:24:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:13:12.494 03:24:37 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:12.494 03:24:37 -- nvmf/common.sh@124 -- # set -e 00:13:12.494 03:24:37 -- nvmf/common.sh@125 -- # return 0 00:13:12.494 03:24:37 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:13:12.494 03:24:37 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:12.494 03:24:37 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:13:12.494 03:24:37 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:13:12.494 03:24:37 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:12.494 03:24:37 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:13:12.494 03:24:37 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:12.494 03:24:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:12.494 03:24:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:12.494 03:24:37 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:13:12.494 00:13:12.494 real 0m4.254s 00:13:12.494 user 0m0.814s 00:13:12.494 sys 0m1.440s 00:13:12.494 03:24:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:12.494 03:24:37 -- common/autotest_common.sh@10 -- # set +x 00:13:12.494 ************************************ 00:13:12.494 END TEST nvmf_multipath 00:13:12.494 ************************************ 00:13:12.494 03:24:37 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:13:12.494 03:24:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:12.494 03:24:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:12.494 03:24:37 -- common/autotest_common.sh@10 -- # set +x 00:13:12.753 ************************************ 00:13:12.753 START TEST nvmf_zcopy 00:13:12.753 ************************************ 00:13:12.753 03:24:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:13:12.753 * Looking for test storage... 00:13:12.753 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:12.753 03:24:37 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:12.753 03:24:37 -- nvmf/common.sh@7 -- # uname -s 00:13:12.753 03:24:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:12.753 03:24:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:12.753 03:24:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:12.753 03:24:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:12.753 03:24:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:12.753 03:24:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:12.753 03:24:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:12.753 03:24:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:12.753 03:24:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:12.753 03:24:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:12.753 03:24:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:13:12.753 03:24:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:13:12.753 03:24:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:12.753 03:24:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:12.753 03:24:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:12.753 03:24:37 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:12.753 03:24:37 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:12.753 03:24:37 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:12.753 03:24:37 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:12.753 03:24:37 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:12.753 03:24:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:12.753 03:24:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:12.753 03:24:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:12.753 03:24:37 -- paths/export.sh@5 -- # export PATH 00:13:12.753 03:24:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:12.753 03:24:37 -- nvmf/common.sh@47 -- # : 0 00:13:12.753 03:24:37 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:12.753 03:24:37 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:12.753 03:24:37 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:12.753 03:24:37 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:12.753 03:24:37 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:12.753 03:24:37 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:12.753 03:24:37 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:12.753 03:24:37 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:12.753 03:24:37 -- target/zcopy.sh@12 -- # nvmftestinit 00:13:12.753 03:24:37 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:13:12.753 03:24:37 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:12.753 03:24:37 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:12.753 03:24:37 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:12.753 03:24:37 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:12.753 03:24:37 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:12.753 03:24:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:12.753 03:24:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:12.753 03:24:37 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:12.753 03:24:37 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:12.753 03:24:37 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:12.753 03:24:37 -- common/autotest_common.sh@10 -- # set +x 00:13:14.654 03:24:39 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:14.654 03:24:39 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:14.654 03:24:39 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:14.654 03:24:39 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:14.654 03:24:39 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:14.654 03:24:39 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:14.654 03:24:39 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:14.654 03:24:39 -- nvmf/common.sh@295 -- # net_devs=() 00:13:14.654 03:24:39 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:14.654 03:24:39 -- nvmf/common.sh@296 -- # e810=() 00:13:14.654 03:24:39 -- nvmf/common.sh@296 -- # local -ga e810 00:13:14.654 03:24:39 -- nvmf/common.sh@297 -- # x722=() 00:13:14.654 03:24:39 -- nvmf/common.sh@297 -- # local -ga x722 00:13:14.654 03:24:39 -- nvmf/common.sh@298 -- # mlx=() 00:13:14.654 03:24:39 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:14.654 03:24:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:14.654 03:24:39 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:14.654 03:24:39 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:14.654 03:24:39 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:14.654 03:24:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:14.654 03:24:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:13:14.654 Found 0000:09:00.0 (0x8086 - 0x159b) 00:13:14.654 03:24:39 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:14.654 03:24:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:13:14.654 Found 0000:09:00.1 (0x8086 - 0x159b) 00:13:14.654 03:24:39 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:14.654 03:24:39 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:13:14.654 03:24:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:14.654 03:24:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:14.654 03:24:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:14.654 03:24:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:14.654 03:24:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:13:14.654 Found net devices under 0000:09:00.0: cvl_0_0 00:13:14.654 03:24:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:14.654 03:24:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:14.654 03:24:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:14.654 03:24:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:14.654 03:24:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:14.654 03:24:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:13:14.654 Found net devices under 0000:09:00.1: cvl_0_1 00:13:14.655 03:24:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:14.655 03:24:39 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:14.655 03:24:39 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:14.655 03:24:39 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:14.655 03:24:39 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:13:14.655 03:24:39 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:13:14.655 03:24:39 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:14.655 03:24:39 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:14.655 03:24:39 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:14.655 03:24:39 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:13:14.655 03:24:39 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:14.655 03:24:39 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:14.655 03:24:39 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:13:14.655 03:24:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:14.655 03:24:39 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:14.655 03:24:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:13:14.655 03:24:39 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:13:14.655 03:24:39 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:13:14.655 03:24:39 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:14.655 03:24:39 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:14.655 03:24:39 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:14.655 03:24:39 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:13:14.655 03:24:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:14.913 03:24:39 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:14.914 03:24:39 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:14.914 03:24:39 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:13:14.914 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:14.914 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:13:14.914 00:13:14.914 --- 10.0.0.2 ping statistics --- 00:13:14.914 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:14.914 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:13:14.914 03:24:39 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:14.914 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:14.914 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:13:14.914 00:13:14.914 --- 10.0.0.1 ping statistics --- 00:13:14.914 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:14.914 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:13:14.914 03:24:39 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:14.914 03:24:39 -- nvmf/common.sh@411 -- # return 0 00:13:14.914 03:24:39 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:14.914 03:24:39 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:14.914 03:24:39 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:13:14.914 03:24:39 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:13:14.914 03:24:39 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:14.914 03:24:39 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:13:14.914 03:24:39 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:13:14.914 03:24:39 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:13:14.914 03:24:39 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:14.914 03:24:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:14.914 03:24:39 -- common/autotest_common.sh@10 -- # set +x 00:13:14.914 03:24:39 -- nvmf/common.sh@470 -- # nvmfpid=1433518 00:13:14.914 03:24:39 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:14.914 03:24:39 -- nvmf/common.sh@471 -- # waitforlisten 1433518 00:13:14.914 03:24:39 -- common/autotest_common.sh@817 -- # '[' -z 1433518 ']' 00:13:14.914 03:24:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:14.914 03:24:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:14.914 03:24:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:14.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:14.914 03:24:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:14.914 03:24:39 -- common/autotest_common.sh@10 -- # set +x 00:13:14.914 [2024-04-27 03:24:39.759817] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:13:14.914 [2024-04-27 03:24:39.759913] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:14.914 EAL: No free 2048 kB hugepages reported on node 1 00:13:14.914 [2024-04-27 03:24:39.828057] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:15.173 [2024-04-27 03:24:39.945421] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:15.173 [2024-04-27 03:24:39.945482] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:15.173 [2024-04-27 03:24:39.945498] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:15.173 [2024-04-27 03:24:39.945512] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:15.173 [2024-04-27 03:24:39.945534] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:15.173 [2024-04-27 03:24:39.945569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:16.112 03:24:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:16.112 03:24:40 -- common/autotest_common.sh@850 -- # return 0 00:13:16.112 03:24:40 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:16.112 03:24:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:16.112 03:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:16.112 03:24:40 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:16.112 03:24:40 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:13:16.112 03:24:40 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:13:16.112 03:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:16.112 03:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:16.112 [2024-04-27 03:24:40.772086] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:16.112 03:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:16.112 03:24:40 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:16.112 03:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:16.112 03:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:16.112 03:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:16.112 03:24:40 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.112 03:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:16.112 03:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:16.112 [2024-04-27 03:24:40.788285] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.112 03:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:16.112 03:24:40 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:16.112 03:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:16.112 03:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:16.112 03:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:16.112 03:24:40 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:13:16.112 03:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:16.112 03:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:16.112 malloc0 00:13:16.112 03:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:16.112 03:24:40 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:13:16.112 03:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:16.112 03:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:16.112 03:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:16.112 03:24:40 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:13:16.112 03:24:40 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:13:16.112 03:24:40 -- nvmf/common.sh@521 -- # config=() 00:13:16.112 03:24:40 -- nvmf/common.sh@521 -- # local subsystem config 00:13:16.113 03:24:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:16.113 03:24:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:16.113 { 00:13:16.113 "params": { 00:13:16.113 "name": "Nvme$subsystem", 00:13:16.113 "trtype": "$TEST_TRANSPORT", 00:13:16.113 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:16.113 "adrfam": "ipv4", 00:13:16.113 "trsvcid": "$NVMF_PORT", 00:13:16.113 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:16.113 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:16.113 "hdgst": ${hdgst:-false}, 00:13:16.113 "ddgst": ${ddgst:-false} 00:13:16.113 }, 00:13:16.113 "method": "bdev_nvme_attach_controller" 00:13:16.113 } 00:13:16.113 EOF 00:13:16.113 )") 00:13:16.113 03:24:40 -- nvmf/common.sh@543 -- # cat 00:13:16.113 03:24:40 -- nvmf/common.sh@545 -- # jq . 00:13:16.113 03:24:40 -- nvmf/common.sh@546 -- # IFS=, 00:13:16.113 03:24:40 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:16.113 "params": { 00:13:16.113 "name": "Nvme1", 00:13:16.113 "trtype": "tcp", 00:13:16.113 "traddr": "10.0.0.2", 00:13:16.113 "adrfam": "ipv4", 00:13:16.113 "trsvcid": "4420", 00:13:16.113 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:16.113 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:16.113 "hdgst": false, 00:13:16.113 "ddgst": false 00:13:16.113 }, 00:13:16.113 "method": "bdev_nvme_attach_controller" 00:13:16.113 }' 00:13:16.113 [2024-04-27 03:24:40.868902] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:13:16.113 [2024-04-27 03:24:40.868973] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1433670 ] 00:13:16.113 EAL: No free 2048 kB hugepages reported on node 1 00:13:16.113 [2024-04-27 03:24:40.932908] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:16.113 [2024-04-27 03:24:41.054868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:16.373 Running I/O for 10 seconds... 00:13:26.363 00:13:26.363 Latency(us) 00:13:26.363 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:26.363 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:13:26.363 Verification LBA range: start 0x0 length 0x1000 00:13:26.363 Nvme1n1 : 10.02 5574.78 43.55 0.00 0.00 22897.60 3398.16 32816.55 00:13:26.363 =================================================================================================================== 00:13:26.363 Total : 5574.78 43.55 0.00 0.00 22897.60 3398.16 32816.55 00:13:26.622 03:24:51 -- target/zcopy.sh@39 -- # perfpid=1434911 00:13:26.622 03:24:51 -- target/zcopy.sh@41 -- # xtrace_disable 00:13:26.622 03:24:51 -- common/autotest_common.sh@10 -- # set +x 00:13:26.622 03:24:51 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:13:26.622 03:24:51 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:13:26.622 03:24:51 -- nvmf/common.sh@521 -- # config=() 00:13:26.622 03:24:51 -- nvmf/common.sh@521 -- # local subsystem config 00:13:26.622 03:24:51 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:26.622 03:24:51 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:26.622 { 00:13:26.622 "params": { 00:13:26.622 "name": "Nvme$subsystem", 00:13:26.622 "trtype": "$TEST_TRANSPORT", 00:13:26.622 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:26.622 "adrfam": "ipv4", 00:13:26.622 "trsvcid": "$NVMF_PORT", 00:13:26.622 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:26.622 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:26.622 "hdgst": ${hdgst:-false}, 00:13:26.622 "ddgst": ${ddgst:-false} 00:13:26.622 }, 00:13:26.622 "method": "bdev_nvme_attach_controller" 00:13:26.622 } 00:13:26.622 EOF 00:13:26.622 )") 00:13:26.622 03:24:51 -- nvmf/common.sh@543 -- # cat 00:13:26.622 [2024-04-27 03:24:51.587548] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.622 [2024-04-27 03:24:51.587598] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.622 03:24:51 -- nvmf/common.sh@545 -- # jq . 00:13:26.622 03:24:51 -- nvmf/common.sh@546 -- # IFS=, 00:13:26.622 03:24:51 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:26.622 "params": { 00:13:26.622 "name": "Nvme1", 00:13:26.622 "trtype": "tcp", 00:13:26.622 "traddr": "10.0.0.2", 00:13:26.622 "adrfam": "ipv4", 00:13:26.622 "trsvcid": "4420", 00:13:26.622 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:26.622 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:26.622 "hdgst": false, 00:13:26.622 "ddgst": false 00:13:26.622 }, 00:13:26.622 "method": "bdev_nvme_attach_controller" 00:13:26.622 }' 00:13:26.622 [2024-04-27 03:24:51.595504] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.622 [2024-04-27 03:24:51.595541] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.882 [2024-04-27 03:24:51.603523] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.882 [2024-04-27 03:24:51.603557] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.882 [2024-04-27 03:24:51.611545] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.882 [2024-04-27 03:24:51.611569] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.882 [2024-04-27 03:24:51.619567] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.882 [2024-04-27 03:24:51.619592] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.882 [2024-04-27 03:24:51.627571] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:13:26.882 [2024-04-27 03:24:51.627608] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.882 [2024-04-27 03:24:51.627628] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.882 [2024-04-27 03:24:51.627642] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1434911 ] 00:13:26.882 [2024-04-27 03:24:51.635621] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.882 [2024-04-27 03:24:51.635641] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.882 [2024-04-27 03:24:51.643642] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.882 [2024-04-27 03:24:51.643662] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.882 [2024-04-27 03:24:51.651662] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.882 [2024-04-27 03:24:51.651682] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.882 EAL: No free 2048 kB hugepages reported on node 1 00:13:26.882 [2024-04-27 03:24:51.659685] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.882 [2024-04-27 03:24:51.659705] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.667725] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.667749] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.675746] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.675770] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.683766] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.683791] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.691115] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:26.883 [2024-04-27 03:24:51.691792] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.691817] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.699847] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.699888] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.707864] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.707903] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.715860] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.715885] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.723879] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.723903] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.731902] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.731927] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.739926] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.739950] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.747947] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.747971] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.755984] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.756019] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.764023] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.764065] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.772018] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.772044] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.780037] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.780062] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.788060] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.788087] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.796088] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.796113] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.804107] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.804132] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.810163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:26.883 [2024-04-27 03:24:51.812125] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.812149] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.820149] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.820175] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.828195] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.828231] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.836222] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.836270] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.844238] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.844285] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:26.883 [2024-04-27 03:24:51.852276] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:26.883 [2024-04-27 03:24:51.852319] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.860293] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.860336] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.868315] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.868356] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.876339] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.876395] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.884328] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.884353] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.892372] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.892413] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.900396] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.900436] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.908391] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.908418] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.916410] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.916434] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.924438] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.924464] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.932469] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.932498] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.940494] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.940524] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.948511] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.948538] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.956535] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.956563] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.964556] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.964584] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.972578] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.972603] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.980599] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.980624] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.988621] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.988646] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:51.996646] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:51.996671] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.004675] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.004705] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.012697] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.012726] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.020716] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.020742] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.028737] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.028771] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.036759] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.036785] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.044785] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.044810] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.052811] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.052837] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.060833] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.060860] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.068854] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.068879] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.076876] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.076901] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.084900] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.084925] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.092924] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.092949] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.100954] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.100983] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.144 [2024-04-27 03:24:52.108970] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.144 [2024-04-27 03:24:52.108996] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.145 [2024-04-27 03:24:52.116993] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.145 [2024-04-27 03:24:52.117018] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.125018] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.125043] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.133042] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.133066] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.141069] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.141096] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.149087] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.149111] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.157118] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.157148] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.165133] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.165159] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 Running I/O for 5 seconds... 00:13:27.406 [2024-04-27 03:24:52.176640] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.176672] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.186824] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.186857] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.199531] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.199562] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.211676] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.211707] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.223633] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.223665] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.235278] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.235309] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.246693] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.246724] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.260355] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.260387] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.271377] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.271408] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.282955] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.282986] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.296684] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.296715] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.307439] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.307470] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.318925] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.318957] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.329849] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.329879] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.341405] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.341437] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.353172] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.353203] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.364869] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.364900] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.406 [2024-04-27 03:24:52.376555] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.406 [2024-04-27 03:24:52.376585] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.665 [2024-04-27 03:24:52.388841] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.665 [2024-04-27 03:24:52.388873] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.665 [2024-04-27 03:24:52.400016] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.665 [2024-04-27 03:24:52.400047] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.665 [2024-04-27 03:24:52.411431] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.665 [2024-04-27 03:24:52.411462] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.665 [2024-04-27 03:24:52.423253] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.665 [2024-04-27 03:24:52.423284] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.665 [2024-04-27 03:24:52.435163] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.665 [2024-04-27 03:24:52.435193] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.665 [2024-04-27 03:24:52.446808] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.665 [2024-04-27 03:24:52.446838] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.665 [2024-04-27 03:24:52.458902] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.665 [2024-04-27 03:24:52.458933] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.665 [2024-04-27 03:24:52.469776] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.665 [2024-04-27 03:24:52.469807] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.665 [2024-04-27 03:24:52.481203] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.481233] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.492490] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.492521] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.503727] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.503759] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.515311] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.515343] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.526691] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.526722] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.538733] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.538764] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.552164] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.552195] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.562443] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.562476] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.574441] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.574472] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.585606] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.585637] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.597066] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.597098] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.608507] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.608538] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.621996] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.622026] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.666 [2024-04-27 03:24:52.633044] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.666 [2024-04-27 03:24:52.633074] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.923 [2024-04-27 03:24:52.644552] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.923 [2024-04-27 03:24:52.644584] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.923 [2024-04-27 03:24:52.656092] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.923 [2024-04-27 03:24:52.656124] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.923 [2024-04-27 03:24:52.667833] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.923 [2024-04-27 03:24:52.667865] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.923 [2024-04-27 03:24:52.679539] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.923 [2024-04-27 03:24:52.679570] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.923 [2024-04-27 03:24:52.692778] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.692810] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.703037] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.703067] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.715427] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.715458] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.727457] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.727488] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.738924] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.738954] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.750557] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.750595] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.764550] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.764588] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.775439] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.775470] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.787126] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.787159] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.798778] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.798808] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.810235] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.810275] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.821828] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.821858] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.833378] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.833408] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.845152] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.845182] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.856602] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.856632] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.868441] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.868471] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.880177] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.880206] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:27.924 [2024-04-27 03:24:52.891733] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:27.924 [2024-04-27 03:24:52.891762] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:52.903242] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:52.903280] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:52.915033] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:52.915063] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:52.928621] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:52.928651] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:52.939952] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:52.939982] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:52.951543] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:52.951573] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:52.962685] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:52.962714] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:52.974720] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:52.974750] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:52.986206] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:52.986236] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:52.998129] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:52.998160] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.010184] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.010214] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.023674] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.023704] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.034852] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.034882] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.046592] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.046623] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.058007] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.058037] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.070032] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.070073] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.081584] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.081613] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.092769] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.092799] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.104664] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.104694] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.116178] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.116208] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.127688] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.127718] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.139261] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.139291] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.183 [2024-04-27 03:24:53.150421] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.183 [2024-04-27 03:24:53.150451] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.161505] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.161536] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.173268] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.173298] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.184664] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.184694] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.196414] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.196444] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.207972] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.208003] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.221095] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.221124] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.232049] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.232078] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.243285] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.243315] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.254739] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.254769] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.266351] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.266381] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.278061] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.278091] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.289565] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.289606] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.301239] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.301277] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.312842] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.312873] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.326339] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.326369] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.337290] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.337319] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.348617] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.348648] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.360467] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.360497] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.371873] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.371902] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.385094] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.385124] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.396627] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.396656] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.407884] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.407914] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.443 [2024-04-27 03:24:53.419863] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.443 [2024-04-27 03:24:53.419893] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.431186] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.431216] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.442892] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.442921] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.454428] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.454458] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.465797] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.465827] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.477440] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.477471] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.489216] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.489254] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.501280] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.501309] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.512996] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.513037] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.524481] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.524512] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.535916] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.535946] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.549496] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.549526] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.560713] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.560744] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.572288] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.572319] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.584313] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.584344] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.595525] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.595555] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.608899] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.608929] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.619325] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.619356] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.630928] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.630957] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.641992] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.642021] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.653199] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.653228] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.664348] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.664378] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.703 [2024-04-27 03:24:53.675458] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.703 [2024-04-27 03:24:53.675489] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.686971] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.687001] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.698806] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.698835] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.710265] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.710295] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.721722] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.721752] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.733654] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.733694] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.745093] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.745123] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.756712] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.756742] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.768634] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.768664] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.780286] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.780317] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.792274] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.792304] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.804098] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.804128] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.815494] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.815524] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.828840] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.828870] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.840000] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.840034] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.851231] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.851272] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.863067] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.863097] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.874937] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.874967] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.886348] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.886378] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.897558] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.897587] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.908892] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.908921] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.920308] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.920338] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:28.963 [2024-04-27 03:24:53.931478] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:28.963 [2024-04-27 03:24:53.931508] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:53.944977] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:53.945008] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:53.954940] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:53.954970] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:53.967350] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:53.967384] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:53.978750] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:53.978781] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:53.990506] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:53.990537] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.003721] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.003751] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.014368] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.014399] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.025988] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.026018] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.037690] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.037721] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.049813] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.049844] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.061733] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.061763] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.073510] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.073540] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.084964] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.084994] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.096309] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.096337] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.108824] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.108851] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.118630] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.118656] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.129399] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.129426] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.140085] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.140111] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.152712] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.152740] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.164525] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.164552] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.173706] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.173734] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.185368] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.185395] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.222 [2024-04-27 03:24:54.196542] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.222 [2024-04-27 03:24:54.196569] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.206752] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.206780] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.217407] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.217434] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.228715] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.228746] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.239574] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.239600] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.250510] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.250537] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.261170] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.261197] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.273704] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.273731] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.283994] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.284021] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.294677] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.294704] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.308339] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.308366] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.318440] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.318466] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.328981] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.329008] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.339738] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.339765] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.350820] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.350846] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.363362] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.363389] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.373518] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.373545] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.384013] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.384040] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.394945] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.394971] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.405514] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.405541] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.482 [2024-04-27 03:24:54.416105] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.482 [2024-04-27 03:24:54.416132] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.483 [2024-04-27 03:24:54.426799] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.483 [2024-04-27 03:24:54.426825] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.483 [2024-04-27 03:24:54.439286] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.483 [2024-04-27 03:24:54.439313] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.483 [2024-04-27 03:24:54.449377] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.483 [2024-04-27 03:24:54.449405] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.459900] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.459932] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.470318] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.470345] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.481218] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.481245] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.491771] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.491797] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.504107] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.504134] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.514191] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.514218] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.524496] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.524523] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.535156] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.535183] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.547902] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.547932] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.559526] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.559568] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.571163] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.571194] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.582905] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.582935] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.594104] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.594135] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.607660] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.607691] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.618140] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.618169] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.630313] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.630340] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.642053] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.642083] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.653695] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.653725] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.665120] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.665150] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.676679] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.676709] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.742 [2024-04-27 03:24:54.690350] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.742 [2024-04-27 03:24:54.690378] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.743 [2024-04-27 03:24:54.701569] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.743 [2024-04-27 03:24:54.701599] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:29.743 [2024-04-27 03:24:54.713153] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:29.743 [2024-04-27 03:24:54.713183] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.724244] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.724298] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.735336] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.735364] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.746946] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.746976] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.758881] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.758911] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.770485] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.770513] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.781982] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.782012] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.793147] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.793177] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.806622] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.806662] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.817544] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.817574] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.829297] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.829326] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.840485] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.840512] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.852360] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.852387] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.863440] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.863468] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.875067] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.875097] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.886525] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.886568] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.897960] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.897990] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.909653] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.909683] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.921389] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.921417] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.935083] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.935114] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.946470] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.946498] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.957893] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.957923] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.000 [2024-04-27 03:24:54.969419] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.000 [2024-04-27 03:24:54.969447] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:54.980820] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:54.980851] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:54.992351] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:54.992379] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.003877] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.003907] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.016010] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.016040] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.027416] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.027451] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.038971] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.039002] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.050671] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.050701] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.062257] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.062301] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.073880] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.073910] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.085570] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.085601] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.097032] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.097063] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.108807] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.108838] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.122391] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.122418] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.133468] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.133495] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.145326] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.145361] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.156995] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.157025] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.169364] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.169391] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.180995] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.181026] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.192874] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.192903] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.204298] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.204329] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.215901] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.215932] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.259 [2024-04-27 03:24:55.227896] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.259 [2024-04-27 03:24:55.227926] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.239847] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.239878] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.251832] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.251871] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.263821] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.263850] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.275327] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.275354] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.286735] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.286765] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.298003] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.298033] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.309846] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.309876] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.321046] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.321076] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.332762] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.332794] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.344300] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.344327] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.356358] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.356386] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.367836] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.367866] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.379497] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.379525] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.391323] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.391351] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.402708] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.402738] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.414257] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.414303] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.426101] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.426131] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.437784] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.437815] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.449411] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.449439] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.460860] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.460891] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.472521] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.472572] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.519 [2024-04-27 03:24:55.484212] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.519 [2024-04-27 03:24:55.484241] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.777 [2024-04-27 03:24:55.496272] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.777 [2024-04-27 03:24:55.496317] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.777 [2024-04-27 03:24:55.507783] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.777 [2024-04-27 03:24:55.507813] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.777 [2024-04-27 03:24:55.520884] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.777 [2024-04-27 03:24:55.520916] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.777 [2024-04-27 03:24:55.535012] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.777 [2024-04-27 03:24:55.535041] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.777 [2024-04-27 03:24:55.546342] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.777 [2024-04-27 03:24:55.546370] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.777 [2024-04-27 03:24:55.557444] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.777 [2024-04-27 03:24:55.557472] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.777 [2024-04-27 03:24:55.569457] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.569485] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.580808] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.580838] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.592409] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.592436] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.603978] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.604008] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.615492] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.615520] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.626828] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.626858] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.640550] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.640577] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.651390] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.651417] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.662895] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.662925] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.674439] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.674467] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.688020] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.688050] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.699015] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.699045] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.710669] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.710699] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.722380] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.722407] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.733993] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.734022] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:30.778 [2024-04-27 03:24:55.746140] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:30.778 [2024-04-27 03:24:55.746170] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.034 [2024-04-27 03:24:55.758049] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.758080] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.769524] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.769552] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.781387] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.781414] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.793410] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.793440] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.804793] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.804823] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.816692] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.816722] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.830164] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.830194] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.840527] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.840572] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.852846] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.852876] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.864459] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.864487] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.875836] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.875866] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.887892] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.887923] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.899561] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.899591] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.911593] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.911623] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.923423] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.923451] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.935358] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.935385] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.948929] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.948959] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.959864] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.959894] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.972244] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.972303] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.983865] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.983895] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:55.995827] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:55.995857] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.035 [2024-04-27 03:24:56.007748] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.035 [2024-04-27 03:24:56.007779] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.018954] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.018985] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.030477] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.030507] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.042211] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.042242] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.055293] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.055321] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.066084] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.066115] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.078686] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.078716] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.090141] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.090172] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.102019] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.102049] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.113456] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.113483] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.126984] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.127015] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.138230] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.138287] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.150018] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.150049] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.161667] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.161697] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.175155] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.175185] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.186116] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.186146] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.197676] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.197706] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.209656] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.209687] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.221048] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.221078] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.232632] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.232663] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.244570] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.244614] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.256466] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.256494] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.293 [2024-04-27 03:24:56.268181] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.293 [2024-04-27 03:24:56.268211] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.279548] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.279579] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.291210] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.291241] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.302826] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.302856] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.314810] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.314841] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.328416] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.328444] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.339310] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.339337] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.350979] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.351008] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.362755] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.362785] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.376118] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.376148] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.387423] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.387451] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.399110] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.399140] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.410600] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.553 [2024-04-27 03:24:56.410630] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.553 [2024-04-27 03:24:56.422336] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.554 [2024-04-27 03:24:56.422364] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.554 [2024-04-27 03:24:56.433867] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.554 [2024-04-27 03:24:56.433897] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.554 [2024-04-27 03:24:56.445463] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.554 [2024-04-27 03:24:56.445490] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.554 [2024-04-27 03:24:56.457302] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.554 [2024-04-27 03:24:56.457330] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.554 [2024-04-27 03:24:56.469163] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.554 [2024-04-27 03:24:56.469193] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.554 [2024-04-27 03:24:56.480558] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.554 [2024-04-27 03:24:56.480589] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.554 [2024-04-27 03:24:56.492084] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.554 [2024-04-27 03:24:56.492113] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.554 [2024-04-27 03:24:56.503898] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.554 [2024-04-27 03:24:56.503927] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.554 [2024-04-27 03:24:56.515628] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.554 [2024-04-27 03:24:56.515659] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.554 [2024-04-27 03:24:56.527698] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.554 [2024-04-27 03:24:56.527729] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.539180] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.539211] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.550576] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.550606] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.564118] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.564148] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.575465] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.575493] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.587185] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.587226] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.598854] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.598883] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.616325] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.616354] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.626949] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.626980] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.638706] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.638736] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.650049] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.650079] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.661607] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.661636] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.673776] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.673807] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.685318] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.685346] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.696987] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.697017] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.710544] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.710574] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.721407] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.721434] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.733181] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.733210] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.745150] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.745180] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.758940] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.758970] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.814 [2024-04-27 03:24:56.770392] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.814 [2024-04-27 03:24:56.770419] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:31.815 [2024-04-27 03:24:56.782574] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:31.815 [2024-04-27 03:24:56.782604] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.794662] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.794693] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.806128] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.806157] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.819783] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.819824] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.830839] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.830869] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.842866] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.842897] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.854583] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.854613] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.865850] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.865880] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.877568] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.877599] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.889397] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.889424] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.900961] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.900992] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.914498] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.914540] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.924935] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.924965] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.936420] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.936447] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.948550] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.948581] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.959816] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.959846] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.971467] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.971495] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.983352] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.983380] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:56.995489] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:56.995517] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:57.007486] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:57.007530] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:57.019322] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:57.019349] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:57.030832] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:57.030862] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.074 [2024-04-27 03:24:57.042517] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.074 [2024-04-27 03:24:57.042572] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.054090] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.054122] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.065837] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.065868] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.077802] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.077832] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.089544] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.089574] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.100939] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.100970] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.112842] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.112873] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.126268] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.126295] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.136290] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.136317] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.146673] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.146700] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.157270] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.157297] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.167785] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.167813] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.180596] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.180623] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.188595] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.188623] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 00:13:32.333 Latency(us) 00:13:32.333 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:32.333 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:13:32.333 Nvme1n1 : 5.01 11025.60 86.14 0.00 0.00 11595.56 4878.79 19709.35 00:13:32.333 =================================================================================================================== 00:13:32.333 Total : 11025.60 86.14 0.00 0.00 11595.56 4878.79 19709.35 00:13:32.333 [2024-04-27 03:24:57.196554] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.196579] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.204586] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.204611] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.212596] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.212640] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.333 [2024-04-27 03:24:57.220660] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.333 [2024-04-27 03:24:57.220706] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.228677] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.228721] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.236697] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.236743] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.244723] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.244779] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.252752] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.252795] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.260773] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.260822] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.268787] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.268831] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.276816] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.276864] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.284843] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.284890] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.292861] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.292905] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.300878] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.300925] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.334 [2024-04-27 03:24:57.308899] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.334 [2024-04-27 03:24:57.308943] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.316923] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.316967] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.324884] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.324906] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.332904] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.332924] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.340924] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.340944] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.348945] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.348965] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.357027] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.357071] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.365054] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.365097] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.373052] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.373092] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.381037] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.381057] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.389058] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.389078] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.397082] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.397102] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.405147] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.405184] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.413180] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.413223] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.421194] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.421232] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.429167] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.429188] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 [2024-04-27 03:24:57.437189] subsystem.c:1906:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:32.594 [2024-04-27 03:24:57.437209] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:32.594 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1434911) - No such process 00:13:32.594 03:24:57 -- target/zcopy.sh@49 -- # wait 1434911 00:13:32.594 03:24:57 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.594 03:24:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:32.594 03:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:32.594 03:24:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:32.594 03:24:57 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:32.594 03:24:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:32.594 03:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:32.594 delay0 00:13:32.594 03:24:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:32.594 03:24:57 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:13:32.594 03:24:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:32.594 03:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:32.594 03:24:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:32.594 03:24:57 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:13:32.594 EAL: No free 2048 kB hugepages reported on node 1 00:13:32.594 [2024-04-27 03:24:57.560351] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:40.723 Initializing NVMe Controllers 00:13:40.723 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:40.723 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:40.723 Initialization complete. Launching workers. 00:13:40.723 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 3249 00:13:40.723 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 3522, failed to submit 47 00:13:40.723 success 3329, unsuccess 193, failed 0 00:13:40.723 03:25:04 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:13:40.723 03:25:04 -- target/zcopy.sh@60 -- # nvmftestfini 00:13:40.723 03:25:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:40.723 03:25:04 -- nvmf/common.sh@117 -- # sync 00:13:40.723 03:25:04 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:13:40.723 03:25:04 -- nvmf/common.sh@120 -- # set +e 00:13:40.723 03:25:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:40.723 03:25:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:13:40.723 rmmod nvme_tcp 00:13:40.723 rmmod nvme_fabrics 00:13:40.723 rmmod nvme_keyring 00:13:40.723 03:25:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:40.723 03:25:04 -- nvmf/common.sh@124 -- # set -e 00:13:40.723 03:25:04 -- nvmf/common.sh@125 -- # return 0 00:13:40.723 03:25:04 -- nvmf/common.sh@478 -- # '[' -n 1433518 ']' 00:13:40.723 03:25:04 -- nvmf/common.sh@479 -- # killprocess 1433518 00:13:40.723 03:25:04 -- common/autotest_common.sh@936 -- # '[' -z 1433518 ']' 00:13:40.723 03:25:04 -- common/autotest_common.sh@940 -- # kill -0 1433518 00:13:40.723 03:25:04 -- common/autotest_common.sh@941 -- # uname 00:13:40.723 03:25:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:40.723 03:25:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1433518 00:13:40.723 03:25:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:40.723 03:25:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:40.723 03:25:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1433518' 00:13:40.723 killing process with pid 1433518 00:13:40.723 03:25:04 -- common/autotest_common.sh@955 -- # kill 1433518 00:13:40.723 03:25:04 -- common/autotest_common.sh@960 -- # wait 1433518 00:13:40.723 03:25:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:40.723 03:25:04 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:13:40.723 03:25:04 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:13:40.723 03:25:04 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:40.723 03:25:04 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:13:40.723 03:25:04 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:40.723 03:25:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:40.723 03:25:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:42.130 03:25:06 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:13:42.130 00:13:42.130 real 0m29.234s 00:13:42.130 user 0m43.208s 00:13:42.130 sys 0m8.626s 00:13:42.130 03:25:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:42.130 03:25:06 -- common/autotest_common.sh@10 -- # set +x 00:13:42.130 ************************************ 00:13:42.130 END TEST nvmf_zcopy 00:13:42.130 ************************************ 00:13:42.130 03:25:06 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:13:42.130 03:25:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:42.130 03:25:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:42.130 03:25:06 -- common/autotest_common.sh@10 -- # set +x 00:13:42.130 ************************************ 00:13:42.130 START TEST nvmf_nmic 00:13:42.130 ************************************ 00:13:42.130 03:25:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:13:42.130 * Looking for test storage... 00:13:42.130 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:42.130 03:25:06 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:42.130 03:25:06 -- nvmf/common.sh@7 -- # uname -s 00:13:42.130 03:25:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:42.130 03:25:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:42.130 03:25:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:42.130 03:25:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:42.130 03:25:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:42.130 03:25:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:42.130 03:25:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:42.130 03:25:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:42.130 03:25:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:42.130 03:25:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:42.131 03:25:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:13:42.131 03:25:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:13:42.131 03:25:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:42.131 03:25:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:42.131 03:25:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:42.131 03:25:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:42.131 03:25:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:42.131 03:25:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:42.131 03:25:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:42.131 03:25:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:42.131 03:25:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.131 03:25:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.131 03:25:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.131 03:25:06 -- paths/export.sh@5 -- # export PATH 00:13:42.131 03:25:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.131 03:25:06 -- nvmf/common.sh@47 -- # : 0 00:13:42.131 03:25:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:42.131 03:25:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:42.131 03:25:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:42.131 03:25:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:42.131 03:25:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:42.131 03:25:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:42.131 03:25:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:42.131 03:25:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:42.131 03:25:06 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:42.131 03:25:06 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:42.131 03:25:06 -- target/nmic.sh@14 -- # nvmftestinit 00:13:42.131 03:25:06 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:13:42.131 03:25:06 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:42.131 03:25:06 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:42.131 03:25:06 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:42.131 03:25:06 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:42.131 03:25:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:42.131 03:25:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:42.131 03:25:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:42.131 03:25:06 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:42.131 03:25:06 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:42.131 03:25:06 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:42.131 03:25:06 -- common/autotest_common.sh@10 -- # set +x 00:13:44.044 03:25:08 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:44.045 03:25:08 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:44.045 03:25:08 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:44.045 03:25:08 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:44.045 03:25:08 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:44.045 03:25:08 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:44.045 03:25:08 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:44.045 03:25:08 -- nvmf/common.sh@295 -- # net_devs=() 00:13:44.045 03:25:08 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:44.045 03:25:08 -- nvmf/common.sh@296 -- # e810=() 00:13:44.045 03:25:08 -- nvmf/common.sh@296 -- # local -ga e810 00:13:44.045 03:25:08 -- nvmf/common.sh@297 -- # x722=() 00:13:44.045 03:25:08 -- nvmf/common.sh@297 -- # local -ga x722 00:13:44.045 03:25:08 -- nvmf/common.sh@298 -- # mlx=() 00:13:44.045 03:25:08 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:44.045 03:25:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:44.045 03:25:08 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:44.045 03:25:08 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:44.045 03:25:08 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:44.045 03:25:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:44.045 03:25:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:13:44.045 Found 0000:09:00.0 (0x8086 - 0x159b) 00:13:44.045 03:25:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:44.045 03:25:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:13:44.045 Found 0000:09:00.1 (0x8086 - 0x159b) 00:13:44.045 03:25:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:44.045 03:25:08 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:44.045 03:25:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:44.045 03:25:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:44.045 03:25:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:44.045 03:25:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:13:44.045 Found net devices under 0000:09:00.0: cvl_0_0 00:13:44.045 03:25:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:44.045 03:25:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:44.045 03:25:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:44.045 03:25:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:44.045 03:25:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:44.045 03:25:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:13:44.045 Found net devices under 0000:09:00.1: cvl_0_1 00:13:44.045 03:25:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:44.045 03:25:08 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:44.045 03:25:08 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:44.045 03:25:08 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:13:44.045 03:25:08 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:13:44.045 03:25:08 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:44.045 03:25:08 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:44.045 03:25:08 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:44.045 03:25:08 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:13:44.045 03:25:08 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:44.045 03:25:08 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:44.045 03:25:08 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:13:44.045 03:25:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:44.045 03:25:08 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:44.045 03:25:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:13:44.045 03:25:08 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:13:44.045 03:25:08 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:13:44.045 03:25:08 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:44.045 03:25:08 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:44.045 03:25:08 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:44.045 03:25:08 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:13:44.045 03:25:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:44.304 03:25:09 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:44.304 03:25:09 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:44.304 03:25:09 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:13:44.304 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:44.304 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.171 ms 00:13:44.304 00:13:44.304 --- 10.0.0.2 ping statistics --- 00:13:44.304 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:44.304 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:13:44.304 03:25:09 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:44.304 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:44.304 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:13:44.304 00:13:44.304 --- 10.0.0.1 ping statistics --- 00:13:44.304 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:44.304 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:13:44.304 03:25:09 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:44.304 03:25:09 -- nvmf/common.sh@411 -- # return 0 00:13:44.304 03:25:09 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:44.304 03:25:09 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:44.304 03:25:09 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:13:44.304 03:25:09 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:13:44.304 03:25:09 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:44.304 03:25:09 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:13:44.304 03:25:09 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:13:44.304 03:25:09 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:13:44.304 03:25:09 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:44.304 03:25:09 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:44.304 03:25:09 -- common/autotest_common.sh@10 -- # set +x 00:13:44.304 03:25:09 -- nvmf/common.sh@470 -- # nvmfpid=1438380 00:13:44.304 03:25:09 -- nvmf/common.sh@471 -- # waitforlisten 1438380 00:13:44.304 03:25:09 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:44.304 03:25:09 -- common/autotest_common.sh@817 -- # '[' -z 1438380 ']' 00:13:44.304 03:25:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:44.304 03:25:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:44.304 03:25:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:44.304 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:44.304 03:25:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:44.304 03:25:09 -- common/autotest_common.sh@10 -- # set +x 00:13:44.304 [2024-04-27 03:25:09.133127] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:13:44.304 [2024-04-27 03:25:09.133205] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:44.304 EAL: No free 2048 kB hugepages reported on node 1 00:13:44.304 [2024-04-27 03:25:09.204043] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:44.561 [2024-04-27 03:25:09.324202] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:44.561 [2024-04-27 03:25:09.324275] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:44.561 [2024-04-27 03:25:09.324293] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:44.561 [2024-04-27 03:25:09.324306] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:44.561 [2024-04-27 03:25:09.324318] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:44.561 [2024-04-27 03:25:09.324399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:44.561 [2024-04-27 03:25:09.324787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:44.561 [2024-04-27 03:25:09.324842] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:44.561 [2024-04-27 03:25:09.324839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:45.497 03:25:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:45.497 03:25:10 -- common/autotest_common.sh@850 -- # return 0 00:13:45.497 03:25:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:45.497 03:25:10 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:45.497 03:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.497 03:25:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:45.497 03:25:10 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:45.497 03:25:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:45.497 03:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.497 [2024-04-27 03:25:10.148188] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:45.497 03:25:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:45.497 03:25:10 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:45.497 03:25:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:45.497 03:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.497 Malloc0 00:13:45.497 03:25:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:45.497 03:25:10 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:45.497 03:25:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:45.497 03:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.497 03:25:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:45.497 03:25:10 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:45.497 03:25:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:45.497 03:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.497 03:25:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:45.497 03:25:10 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:45.497 03:25:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:45.497 03:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.497 [2024-04-27 03:25:10.201580] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:45.497 03:25:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:45.497 03:25:10 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:13:45.497 test case1: single bdev can't be used in multiple subsystems 00:13:45.497 03:25:10 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:13:45.497 03:25:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:45.497 03:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.497 03:25:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:45.497 03:25:10 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:13:45.497 03:25:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:45.497 03:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.497 03:25:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:45.497 03:25:10 -- target/nmic.sh@28 -- # nmic_status=0 00:13:45.497 03:25:10 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:13:45.497 03:25:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:45.497 03:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.497 [2024-04-27 03:25:10.225374] bdev.c:8005:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:13:45.497 [2024-04-27 03:25:10.225404] subsystem.c:1940:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:13:45.497 [2024-04-27 03:25:10.225419] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:45.497 request: 00:13:45.497 { 00:13:45.497 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:13:45.497 "namespace": { 00:13:45.497 "bdev_name": "Malloc0", 00:13:45.497 "no_auto_visible": false 00:13:45.497 }, 00:13:45.497 "method": "nvmf_subsystem_add_ns", 00:13:45.497 "req_id": 1 00:13:45.497 } 00:13:45.497 Got JSON-RPC error response 00:13:45.497 response: 00:13:45.497 { 00:13:45.497 "code": -32602, 00:13:45.497 "message": "Invalid parameters" 00:13:45.497 } 00:13:45.497 03:25:10 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:13:45.497 03:25:10 -- target/nmic.sh@29 -- # nmic_status=1 00:13:45.497 03:25:10 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:13:45.497 03:25:10 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:13:45.497 Adding namespace failed - expected result. 00:13:45.497 03:25:10 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:13:45.497 test case2: host connect to nvmf target in multiple paths 00:13:45.497 03:25:10 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:13:45.497 03:25:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:45.497 03:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.497 [2024-04-27 03:25:10.233499] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:13:45.497 03:25:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:45.497 03:25:10 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:46.064 03:25:10 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:13:46.629 03:25:11 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:13:46.629 03:25:11 -- common/autotest_common.sh@1184 -- # local i=0 00:13:46.629 03:25:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:13:46.629 03:25:11 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:13:46.629 03:25:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:13:49.167 03:25:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:13:49.167 03:25:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:13:49.167 03:25:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:13:49.167 03:25:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:13:49.167 03:25:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:13:49.167 03:25:13 -- common/autotest_common.sh@1194 -- # return 0 00:13:49.167 03:25:13 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:13:49.167 [global] 00:13:49.167 thread=1 00:13:49.167 invalidate=1 00:13:49.167 rw=write 00:13:49.167 time_based=1 00:13:49.167 runtime=1 00:13:49.167 ioengine=libaio 00:13:49.167 direct=1 00:13:49.167 bs=4096 00:13:49.167 iodepth=1 00:13:49.167 norandommap=0 00:13:49.167 numjobs=1 00:13:49.167 00:13:49.167 verify_dump=1 00:13:49.167 verify_backlog=512 00:13:49.167 verify_state_save=0 00:13:49.167 do_verify=1 00:13:49.167 verify=crc32c-intel 00:13:49.167 [job0] 00:13:49.167 filename=/dev/nvme0n1 00:13:49.167 Could not set queue depth (nvme0n1) 00:13:49.167 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:49.167 fio-3.35 00:13:49.167 Starting 1 thread 00:13:50.102 00:13:50.102 job0: (groupid=0, jobs=1): err= 0: pid=1439028: Sat Apr 27 03:25:14 2024 00:13:50.102 read: IOPS=1953, BW=7812KiB/s (8000kB/s)(7820KiB/1001msec) 00:13:50.102 slat (nsec): min=5498, max=74611, avg=16715.50, stdev=8940.17 00:13:50.102 clat (usec): min=227, max=412, avg=278.52, stdev=29.71 00:13:50.102 lat (usec): min=233, max=448, avg=295.24, stdev=33.34 00:13:50.102 clat percentiles (usec): 00:13:50.102 | 1.00th=[ 235], 5.00th=[ 243], 10.00th=[ 247], 20.00th=[ 253], 00:13:50.102 | 30.00th=[ 262], 40.00th=[ 265], 50.00th=[ 273], 60.00th=[ 281], 00:13:50.102 | 70.00th=[ 289], 80.00th=[ 297], 90.00th=[ 322], 95.00th=[ 338], 00:13:50.102 | 99.00th=[ 375], 99.50th=[ 379], 99.90th=[ 396], 99.95th=[ 412], 00:13:50.102 | 99.99th=[ 412] 00:13:50.102 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:13:50.102 slat (usec): min=5, max=27895, avg=28.05, stdev=616.11 00:13:50.102 clat (usec): min=137, max=302, avg=169.28, stdev=18.96 00:13:50.102 lat (usec): min=147, max=28147, avg=197.34, stdev=618.22 00:13:50.102 clat percentiles (usec): 00:13:50.102 | 1.00th=[ 143], 5.00th=[ 147], 10.00th=[ 151], 20.00th=[ 157], 00:13:50.102 | 30.00th=[ 161], 40.00th=[ 163], 50.00th=[ 167], 60.00th=[ 169], 00:13:50.102 | 70.00th=[ 174], 80.00th=[ 180], 90.00th=[ 188], 95.00th=[ 196], 00:13:50.102 | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 265], 99.95th=[ 265], 00:13:50.102 | 99.99th=[ 302] 00:13:50.102 bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 00:13:50.102 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:13:50.102 lat (usec) : 250=57.91%, 500=42.09% 00:13:50.102 cpu : usr=2.90%, sys=6.90%, ctx=4006, majf=0, minf=2 00:13:50.102 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:50.102 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:50.102 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:50.102 issued rwts: total=1955,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:50.102 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:50.102 00:13:50.102 Run status group 0 (all jobs): 00:13:50.102 READ: bw=7812KiB/s (8000kB/s), 7812KiB/s-7812KiB/s (8000kB/s-8000kB/s), io=7820KiB (8008kB), run=1001-1001msec 00:13:50.102 WRITE: bw=8184KiB/s (8380kB/s), 8184KiB/s-8184KiB/s (8380kB/s-8380kB/s), io=8192KiB (8389kB), run=1001-1001msec 00:13:50.102 00:13:50.102 Disk stats (read/write): 00:13:50.102 nvme0n1: ios=1692/2048, merge=0/0, ticks=984/330, in_queue=1314, util=98.50% 00:13:50.102 03:25:14 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:50.102 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:13:50.102 03:25:15 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:50.102 03:25:15 -- common/autotest_common.sh@1205 -- # local i=0 00:13:50.102 03:25:15 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:13:50.102 03:25:15 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:50.360 03:25:15 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:13:50.361 03:25:15 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:50.361 03:25:15 -- common/autotest_common.sh@1217 -- # return 0 00:13:50.361 03:25:15 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:13:50.361 03:25:15 -- target/nmic.sh@53 -- # nvmftestfini 00:13:50.361 03:25:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:50.361 03:25:15 -- nvmf/common.sh@117 -- # sync 00:13:50.361 03:25:15 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:13:50.361 03:25:15 -- nvmf/common.sh@120 -- # set +e 00:13:50.361 03:25:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:50.361 03:25:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:13:50.361 rmmod nvme_tcp 00:13:50.361 rmmod nvme_fabrics 00:13:50.361 rmmod nvme_keyring 00:13:50.361 03:25:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:50.361 03:25:15 -- nvmf/common.sh@124 -- # set -e 00:13:50.361 03:25:15 -- nvmf/common.sh@125 -- # return 0 00:13:50.361 03:25:15 -- nvmf/common.sh@478 -- # '[' -n 1438380 ']' 00:13:50.361 03:25:15 -- nvmf/common.sh@479 -- # killprocess 1438380 00:13:50.361 03:25:15 -- common/autotest_common.sh@936 -- # '[' -z 1438380 ']' 00:13:50.361 03:25:15 -- common/autotest_common.sh@940 -- # kill -0 1438380 00:13:50.361 03:25:15 -- common/autotest_common.sh@941 -- # uname 00:13:50.361 03:25:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:50.361 03:25:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1438380 00:13:50.361 03:25:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:50.361 03:25:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:50.361 03:25:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1438380' 00:13:50.361 killing process with pid 1438380 00:13:50.361 03:25:15 -- common/autotest_common.sh@955 -- # kill 1438380 00:13:50.361 03:25:15 -- common/autotest_common.sh@960 -- # wait 1438380 00:13:50.619 03:25:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:50.619 03:25:15 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:13:50.619 03:25:15 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:13:50.619 03:25:15 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:50.619 03:25:15 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:13:50.619 03:25:15 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:50.619 03:25:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:50.619 03:25:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.526 03:25:17 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:13:52.526 00:13:52.526 real 0m10.609s 00:13:52.526 user 0m25.300s 00:13:52.526 sys 0m2.472s 00:13:52.526 03:25:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:52.526 03:25:17 -- common/autotest_common.sh@10 -- # set +x 00:13:52.526 ************************************ 00:13:52.526 END TEST nvmf_nmic 00:13:52.526 ************************************ 00:13:52.785 03:25:17 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:13:52.785 03:25:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:52.785 03:25:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:52.785 03:25:17 -- common/autotest_common.sh@10 -- # set +x 00:13:52.785 ************************************ 00:13:52.785 START TEST nvmf_fio_target 00:13:52.785 ************************************ 00:13:52.785 03:25:17 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:13:52.785 * Looking for test storage... 00:13:52.786 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:52.786 03:25:17 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:52.786 03:25:17 -- nvmf/common.sh@7 -- # uname -s 00:13:52.786 03:25:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:52.786 03:25:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:52.786 03:25:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:52.786 03:25:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:52.786 03:25:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:52.786 03:25:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:52.786 03:25:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:52.786 03:25:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:52.786 03:25:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:52.786 03:25:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:52.786 03:25:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:13:52.786 03:25:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:13:52.786 03:25:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:52.786 03:25:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:52.786 03:25:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:52.786 03:25:17 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:52.786 03:25:17 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:52.786 03:25:17 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:52.786 03:25:17 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:52.786 03:25:17 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:52.786 03:25:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.786 03:25:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.786 03:25:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.786 03:25:17 -- paths/export.sh@5 -- # export PATH 00:13:52.786 03:25:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.786 03:25:17 -- nvmf/common.sh@47 -- # : 0 00:13:52.786 03:25:17 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:52.786 03:25:17 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:52.786 03:25:17 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:52.786 03:25:17 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:52.786 03:25:17 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:52.786 03:25:17 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:52.786 03:25:17 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:52.786 03:25:17 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:52.786 03:25:17 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:52.786 03:25:17 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:52.786 03:25:17 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:52.786 03:25:17 -- target/fio.sh@16 -- # nvmftestinit 00:13:52.786 03:25:17 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:13:52.786 03:25:17 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:52.786 03:25:17 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:52.786 03:25:17 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:52.786 03:25:17 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:52.786 03:25:17 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.786 03:25:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.786 03:25:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.786 03:25:17 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:52.786 03:25:17 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:52.786 03:25:17 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:52.786 03:25:17 -- common/autotest_common.sh@10 -- # set +x 00:13:55.316 03:25:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:55.316 03:25:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:55.316 03:25:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:55.316 03:25:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:55.316 03:25:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:55.316 03:25:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:55.316 03:25:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:55.316 03:25:19 -- nvmf/common.sh@295 -- # net_devs=() 00:13:55.316 03:25:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:55.316 03:25:19 -- nvmf/common.sh@296 -- # e810=() 00:13:55.316 03:25:19 -- nvmf/common.sh@296 -- # local -ga e810 00:13:55.316 03:25:19 -- nvmf/common.sh@297 -- # x722=() 00:13:55.316 03:25:19 -- nvmf/common.sh@297 -- # local -ga x722 00:13:55.316 03:25:19 -- nvmf/common.sh@298 -- # mlx=() 00:13:55.316 03:25:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:55.316 03:25:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:55.316 03:25:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:55.316 03:25:19 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:55.316 03:25:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:55.316 03:25:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:55.316 03:25:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:13:55.316 Found 0000:09:00.0 (0x8086 - 0x159b) 00:13:55.316 03:25:19 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:55.316 03:25:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:13:55.316 Found 0000:09:00.1 (0x8086 - 0x159b) 00:13:55.316 03:25:19 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:55.316 03:25:19 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:55.316 03:25:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.316 03:25:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:55.316 03:25:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.316 03:25:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:13:55.316 Found net devices under 0000:09:00.0: cvl_0_0 00:13:55.316 03:25:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.316 03:25:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:55.316 03:25:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.316 03:25:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:55.316 03:25:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.316 03:25:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:13:55.316 Found net devices under 0000:09:00.1: cvl_0_1 00:13:55.316 03:25:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.316 03:25:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:55.316 03:25:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:55.316 03:25:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:13:55.316 03:25:19 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:55.316 03:25:19 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:55.316 03:25:19 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:55.316 03:25:19 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:13:55.316 03:25:19 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:55.316 03:25:19 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:55.316 03:25:19 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:13:55.316 03:25:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:55.316 03:25:19 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:55.316 03:25:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:13:55.316 03:25:19 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:13:55.316 03:25:19 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:13:55.316 03:25:19 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:55.316 03:25:19 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:55.316 03:25:19 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:55.316 03:25:19 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:13:55.316 03:25:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:55.316 03:25:19 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:55.316 03:25:19 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:55.316 03:25:19 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:13:55.316 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:55.316 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:13:55.316 00:13:55.316 --- 10.0.0.2 ping statistics --- 00:13:55.316 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.316 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:13:55.316 03:25:19 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:55.316 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:55.316 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:13:55.316 00:13:55.316 --- 10.0.0.1 ping statistics --- 00:13:55.316 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.316 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:13:55.316 03:25:19 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:55.316 03:25:19 -- nvmf/common.sh@411 -- # return 0 00:13:55.316 03:25:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:55.316 03:25:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:55.316 03:25:19 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:13:55.316 03:25:19 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:55.316 03:25:19 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:13:55.316 03:25:19 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:13:55.316 03:25:19 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:13:55.316 03:25:19 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:55.316 03:25:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:55.316 03:25:19 -- common/autotest_common.sh@10 -- # set +x 00:13:55.316 03:25:19 -- nvmf/common.sh@470 -- # nvmfpid=1441103 00:13:55.316 03:25:19 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:55.316 03:25:19 -- nvmf/common.sh@471 -- # waitforlisten 1441103 00:13:55.316 03:25:19 -- common/autotest_common.sh@817 -- # '[' -z 1441103 ']' 00:13:55.316 03:25:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:55.316 03:25:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:55.316 03:25:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:55.316 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:55.316 03:25:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:55.316 03:25:19 -- common/autotest_common.sh@10 -- # set +x 00:13:55.316 [2024-04-27 03:25:19.902523] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:13:55.316 [2024-04-27 03:25:19.902628] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:55.316 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.316 [2024-04-27 03:25:19.971448] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:55.316 [2024-04-27 03:25:20.097260] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:55.316 [2024-04-27 03:25:20.097315] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:55.316 [2024-04-27 03:25:20.097331] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:55.316 [2024-04-27 03:25:20.097344] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:55.316 [2024-04-27 03:25:20.097356] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:55.317 [2024-04-27 03:25:20.097419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:55.317 [2024-04-27 03:25:20.097457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:55.317 [2024-04-27 03:25:20.097509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:55.317 [2024-04-27 03:25:20.097512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:56.250 03:25:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:56.250 03:25:20 -- common/autotest_common.sh@850 -- # return 0 00:13:56.250 03:25:20 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:56.250 03:25:20 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:56.250 03:25:20 -- common/autotest_common.sh@10 -- # set +x 00:13:56.250 03:25:20 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:56.250 03:25:20 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:56.250 [2024-04-27 03:25:21.150187] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:56.250 03:25:21 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:56.509 03:25:21 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:13:56.509 03:25:21 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:56.767 03:25:21 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:13:56.767 03:25:21 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:57.025 03:25:21 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:13:57.025 03:25:21 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:57.283 03:25:22 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:13:57.283 03:25:22 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:13:57.540 03:25:22 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:57.798 03:25:22 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:13:57.798 03:25:22 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:58.056 03:25:22 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:13:58.056 03:25:22 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:58.313 03:25:23 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:13:58.313 03:25:23 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:13:58.571 03:25:23 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:58.828 03:25:23 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:13:58.828 03:25:23 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:59.085 03:25:23 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:13:59.085 03:25:23 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:59.341 03:25:24 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:59.598 [2024-04-27 03:25:24.406998] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:59.598 03:25:24 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:13:59.856 03:25:24 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:14:00.113 03:25:24 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:00.679 03:25:25 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:14:00.679 03:25:25 -- common/autotest_common.sh@1184 -- # local i=0 00:14:00.679 03:25:25 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:00.679 03:25:25 -- common/autotest_common.sh@1186 -- # [[ -n 4 ]] 00:14:00.679 03:25:25 -- common/autotest_common.sh@1187 -- # nvme_device_counter=4 00:14:00.679 03:25:25 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:02.621 03:25:27 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:02.621 03:25:27 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:02.621 03:25:27 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:02.879 03:25:27 -- common/autotest_common.sh@1193 -- # nvme_devices=4 00:14:02.879 03:25:27 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:02.879 03:25:27 -- common/autotest_common.sh@1194 -- # return 0 00:14:02.879 03:25:27 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:14:02.879 [global] 00:14:02.879 thread=1 00:14:02.879 invalidate=1 00:14:02.879 rw=write 00:14:02.879 time_based=1 00:14:02.879 runtime=1 00:14:02.879 ioengine=libaio 00:14:02.879 direct=1 00:14:02.879 bs=4096 00:14:02.879 iodepth=1 00:14:02.879 norandommap=0 00:14:02.879 numjobs=1 00:14:02.879 00:14:02.879 verify_dump=1 00:14:02.879 verify_backlog=512 00:14:02.879 verify_state_save=0 00:14:02.879 do_verify=1 00:14:02.879 verify=crc32c-intel 00:14:02.879 [job0] 00:14:02.879 filename=/dev/nvme0n1 00:14:02.879 [job1] 00:14:02.879 filename=/dev/nvme0n2 00:14:02.879 [job2] 00:14:02.879 filename=/dev/nvme0n3 00:14:02.879 [job3] 00:14:02.879 filename=/dev/nvme0n4 00:14:02.879 Could not set queue depth (nvme0n1) 00:14:02.879 Could not set queue depth (nvme0n2) 00:14:02.879 Could not set queue depth (nvme0n3) 00:14:02.879 Could not set queue depth (nvme0n4) 00:14:02.879 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:02.879 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:02.879 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:02.879 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:02.879 fio-3.35 00:14:02.879 Starting 4 threads 00:14:04.253 00:14:04.253 job0: (groupid=0, jobs=1): err= 0: pid=1442216: Sat Apr 27 03:25:29 2024 00:14:04.253 read: IOPS=23, BW=93.8KiB/s (96.0kB/s)(96.0KiB/1024msec) 00:14:04.253 slat (nsec): min=12143, max=34140, avg=20745.42, stdev=9275.10 00:14:04.253 clat (usec): min=394, max=41291, avg=37581.77, stdev=11444.90 00:14:04.253 lat (usec): min=428, max=41309, avg=37602.51, stdev=11443.13 00:14:04.253 clat percentiles (usec): 00:14:04.253 | 1.00th=[ 396], 5.00th=[ 457], 10.00th=[40633], 20.00th=[40633], 00:14:04.253 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:14:04.253 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:14:04.253 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:14:04.253 | 99.99th=[41157] 00:14:04.253 write: IOPS=500, BW=2000KiB/s (2048kB/s)(2048KiB/1024msec); 0 zone resets 00:14:04.253 slat (nsec): min=7713, max=39660, avg=17408.14, stdev=6720.13 00:14:04.253 clat (usec): min=166, max=376, avg=213.89, stdev=20.47 00:14:04.253 lat (usec): min=179, max=397, avg=231.30, stdev=20.04 00:14:04.253 clat percentiles (usec): 00:14:04.253 | 1.00th=[ 174], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 200], 00:14:04.253 | 30.00th=[ 204], 40.00th=[ 208], 50.00th=[ 212], 60.00th=[ 217], 00:14:04.253 | 70.00th=[ 221], 80.00th=[ 227], 90.00th=[ 237], 95.00th=[ 243], 00:14:04.253 | 99.00th=[ 277], 99.50th=[ 306], 99.90th=[ 375], 99.95th=[ 375], 00:14:04.253 | 99.99th=[ 375] 00:14:04.253 bw ( KiB/s): min= 4096, max= 4096, per=51.50%, avg=4096.00, stdev= 0.00, samples=1 00:14:04.253 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:14:04.253 lat (usec) : 250=93.10%, 500=2.80% 00:14:04.253 lat (msec) : 50=4.10% 00:14:04.253 cpu : usr=0.39%, sys=1.37%, ctx=536, majf=0, minf=1 00:14:04.253 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:04.253 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:04.253 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:04.253 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:04.253 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:04.253 job1: (groupid=0, jobs=1): err= 0: pid=1442239: Sat Apr 27 03:25:29 2024 00:14:04.253 read: IOPS=21, BW=86.0KiB/s (88.1kB/s)(88.0KiB/1023msec) 00:14:04.253 slat (nsec): min=13101, max=34200, avg=21499.09, stdev=9564.95 00:14:04.253 clat (usec): min=40866, max=41054, avg=40963.59, stdev=41.74 00:14:04.253 lat (usec): min=40881, max=41068, avg=40985.09, stdev=37.91 00:14:04.253 clat percentiles (usec): 00:14:04.253 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:14:04.253 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:14:04.253 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:14:04.253 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:14:04.253 | 99.99th=[41157] 00:14:04.253 write: IOPS=500, BW=2002KiB/s (2050kB/s)(2048KiB/1023msec); 0 zone resets 00:14:04.253 slat (nsec): min=6403, max=54976, avg=14301.84, stdev=6016.28 00:14:04.253 clat (usec): min=168, max=361, avg=217.93, stdev=23.68 00:14:04.253 lat (usec): min=185, max=416, avg=232.24, stdev=23.48 00:14:04.253 clat percentiles (usec): 00:14:04.253 | 1.00th=[ 176], 5.00th=[ 182], 10.00th=[ 188], 20.00th=[ 198], 00:14:04.253 | 30.00th=[ 208], 40.00th=[ 212], 50.00th=[ 219], 60.00th=[ 223], 00:14:04.253 | 70.00th=[ 229], 80.00th=[ 235], 90.00th=[ 245], 95.00th=[ 253], 00:14:04.253 | 99.00th=[ 289], 99.50th=[ 297], 99.90th=[ 363], 99.95th=[ 363], 00:14:04.253 | 99.99th=[ 363] 00:14:04.253 bw ( KiB/s): min= 4096, max= 4096, per=51.50%, avg=4096.00, stdev= 0.00, samples=1 00:14:04.253 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:14:04.253 lat (usec) : 250=89.33%, 500=6.55% 00:14:04.253 lat (msec) : 50=4.12% 00:14:04.253 cpu : usr=0.29%, sys=0.78%, ctx=535, majf=0, minf=2 00:14:04.253 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:04.253 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:04.253 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:04.253 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:04.253 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:04.253 job2: (groupid=0, jobs=1): err= 0: pid=1442280: Sat Apr 27 03:25:29 2024 00:14:04.253 read: IOPS=20, BW=81.6KiB/s (83.5kB/s)(84.0KiB/1030msec) 00:14:04.253 slat (nsec): min=12197, max=34692, avg=22356.14, stdev=9314.07 00:14:04.253 clat (usec): min=41891, max=42209, avg=41984.05, stdev=68.80 00:14:04.253 lat (usec): min=41925, max=42229, avg=42006.41, stdev=65.96 00:14:04.253 clat percentiles (usec): 00:14:04.253 | 1.00th=[41681], 5.00th=[41681], 10.00th=[41681], 20.00th=[41681], 00:14:04.253 | 30.00th=[42206], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:14:04.253 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:14:04.253 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:14:04.253 | 99.99th=[42206] 00:14:04.253 write: IOPS=497, BW=1988KiB/s (2036kB/s)(2048KiB/1030msec); 0 zone resets 00:14:04.253 slat (nsec): min=7434, max=51336, avg=19349.38, stdev=8403.58 00:14:04.253 clat (usec): min=188, max=415, avg=263.71, stdev=43.82 00:14:04.253 lat (usec): min=206, max=436, avg=283.06, stdev=44.20 00:14:04.253 clat percentiles (usec): 00:14:04.253 | 1.00th=[ 198], 5.00th=[ 210], 10.00th=[ 219], 20.00th=[ 231], 00:14:04.253 | 30.00th=[ 235], 40.00th=[ 245], 50.00th=[ 255], 60.00th=[ 262], 00:14:04.253 | 70.00th=[ 277], 80.00th=[ 297], 90.00th=[ 322], 95.00th=[ 347], 00:14:04.253 | 99.00th=[ 404], 99.50th=[ 408], 99.90th=[ 416], 99.95th=[ 416], 00:14:04.253 | 99.99th=[ 416] 00:14:04.253 bw ( KiB/s): min= 4096, max= 4096, per=51.50%, avg=4096.00, stdev= 0.00, samples=1 00:14:04.253 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:14:04.253 lat (usec) : 250=42.96%, 500=53.10% 00:14:04.253 lat (msec) : 50=3.94% 00:14:04.253 cpu : usr=0.78%, sys=1.17%, ctx=533, majf=0, minf=1 00:14:04.253 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:04.253 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:04.253 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:04.253 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:04.253 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:04.253 job3: (groupid=0, jobs=1): err= 0: pid=1442294: Sat Apr 27 03:25:29 2024 00:14:04.253 read: IOPS=309, BW=1239KiB/s (1268kB/s)(1240KiB/1001msec) 00:14:04.253 slat (nsec): min=4745, max=34445, avg=7871.47, stdev=5532.73 00:14:04.253 clat (usec): min=214, max=41246, avg=2747.24, stdev=9789.42 00:14:04.253 lat (usec): min=219, max=41259, avg=2755.11, stdev=9792.93 00:14:04.253 clat percentiles (usec): 00:14:04.253 | 1.00th=[ 225], 5.00th=[ 229], 10.00th=[ 231], 20.00th=[ 237], 00:14:04.253 | 30.00th=[ 241], 40.00th=[ 243], 50.00th=[ 247], 60.00th=[ 253], 00:14:04.253 | 70.00th=[ 258], 80.00th=[ 265], 90.00th=[ 289], 95.00th=[41157], 00:14:04.253 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:14:04.253 | 99.99th=[41157] 00:14:04.253 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:14:04.253 slat (nsec): min=6179, max=54087, avg=17301.96, stdev=7748.73 00:14:04.253 clat (usec): min=170, max=452, avg=261.93, stdev=44.31 00:14:04.253 lat (usec): min=185, max=469, avg=279.24, stdev=45.34 00:14:04.253 clat percentiles (usec): 00:14:04.253 | 1.00th=[ 190], 5.00th=[ 208], 10.00th=[ 217], 20.00th=[ 227], 00:14:04.253 | 30.00th=[ 235], 40.00th=[ 245], 50.00th=[ 255], 60.00th=[ 265], 00:14:04.253 | 70.00th=[ 273], 80.00th=[ 289], 90.00th=[ 314], 95.00th=[ 367], 00:14:04.253 | 99.00th=[ 392], 99.50th=[ 400], 99.90th=[ 453], 99.95th=[ 453], 00:14:04.253 | 99.99th=[ 453] 00:14:04.253 bw ( KiB/s): min= 4096, max= 4096, per=51.50%, avg=4096.00, stdev= 0.00, samples=1 00:14:04.253 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:14:04.253 lat (usec) : 250=49.76%, 500=47.93% 00:14:04.253 lat (msec) : 50=2.31% 00:14:04.253 cpu : usr=0.70%, sys=1.00%, ctx=824, majf=0, minf=1 00:14:04.253 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:04.253 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:04.253 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:04.253 issued rwts: total=310,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:04.253 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:04.253 00:14:04.253 Run status group 0 (all jobs): 00:14:04.254 READ: bw=1464KiB/s (1499kB/s), 81.6KiB/s-1239KiB/s (83.5kB/s-1268kB/s), io=1508KiB (1544kB), run=1001-1030msec 00:14:04.254 WRITE: bw=7953KiB/s (8144kB/s), 1988KiB/s-2046KiB/s (2036kB/s-2095kB/s), io=8192KiB (8389kB), run=1001-1030msec 00:14:04.254 00:14:04.254 Disk stats (read/write): 00:14:04.254 nvme0n1: ios=68/512, merge=0/0, ticks=727/108, in_queue=835, util=84.97% 00:14:04.254 nvme0n2: ios=22/512, merge=0/0, ticks=702/108, in_queue=810, util=85.09% 00:14:04.254 nvme0n3: ios=16/512, merge=0/0, ticks=672/130, in_queue=802, util=88.42% 00:14:04.254 nvme0n4: ios=286/512, merge=0/0, ticks=1590/125, in_queue=1715, util=96.03% 00:14:04.254 03:25:29 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:14:04.254 [global] 00:14:04.254 thread=1 00:14:04.254 invalidate=1 00:14:04.254 rw=randwrite 00:14:04.254 time_based=1 00:14:04.254 runtime=1 00:14:04.254 ioengine=libaio 00:14:04.254 direct=1 00:14:04.254 bs=4096 00:14:04.254 iodepth=1 00:14:04.254 norandommap=0 00:14:04.254 numjobs=1 00:14:04.254 00:14:04.254 verify_dump=1 00:14:04.254 verify_backlog=512 00:14:04.254 verify_state_save=0 00:14:04.254 do_verify=1 00:14:04.254 verify=crc32c-intel 00:14:04.254 [job0] 00:14:04.254 filename=/dev/nvme0n1 00:14:04.254 [job1] 00:14:04.254 filename=/dev/nvme0n2 00:14:04.254 [job2] 00:14:04.254 filename=/dev/nvme0n3 00:14:04.254 [job3] 00:14:04.254 filename=/dev/nvme0n4 00:14:04.254 Could not set queue depth (nvme0n1) 00:14:04.254 Could not set queue depth (nvme0n2) 00:14:04.254 Could not set queue depth (nvme0n3) 00:14:04.254 Could not set queue depth (nvme0n4) 00:14:04.511 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:04.511 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:04.511 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:04.511 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:04.511 fio-3.35 00:14:04.511 Starting 4 threads 00:14:05.886 00:14:05.886 job0: (groupid=0, jobs=1): err= 0: pid=1442538: Sat Apr 27 03:25:30 2024 00:14:05.886 read: IOPS=604, BW=2417KiB/s (2475kB/s)(2468KiB/1021msec) 00:14:05.886 slat (nsec): min=5400, max=67975, avg=18222.43, stdev=10518.92 00:14:05.886 clat (usec): min=223, max=41031, avg=1242.19, stdev=5859.40 00:14:05.886 lat (usec): min=229, max=41045, avg=1260.41, stdev=5859.85 00:14:05.886 clat percentiles (usec): 00:14:05.886 | 1.00th=[ 235], 5.00th=[ 285], 10.00th=[ 302], 20.00th=[ 318], 00:14:05.886 | 30.00th=[ 326], 40.00th=[ 338], 50.00th=[ 359], 60.00th=[ 371], 00:14:05.886 | 70.00th=[ 388], 80.00th=[ 416], 90.00th=[ 469], 95.00th=[ 510], 00:14:05.886 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:14:05.886 | 99.99th=[41157] 00:14:05.886 write: IOPS=1002, BW=4012KiB/s (4108kB/s)(4096KiB/1021msec); 0 zone resets 00:14:05.886 slat (nsec): min=7370, max=50789, avg=11763.43, stdev=6893.40 00:14:05.886 clat (usec): min=148, max=464, avg=219.11, stdev=48.68 00:14:05.886 lat (usec): min=157, max=499, avg=230.87, stdev=52.07 00:14:05.886 clat percentiles (usec): 00:14:05.886 | 1.00th=[ 161], 5.00th=[ 176], 10.00th=[ 182], 20.00th=[ 188], 00:14:05.886 | 30.00th=[ 192], 40.00th=[ 194], 50.00th=[ 198], 60.00th=[ 206], 00:14:05.886 | 70.00th=[ 223], 80.00th=[ 249], 90.00th=[ 297], 95.00th=[ 326], 00:14:05.886 | 99.00th=[ 379], 99.50th=[ 392], 99.90th=[ 412], 99.95th=[ 465], 00:14:05.886 | 99.99th=[ 465] 00:14:05.886 bw ( KiB/s): min= 8192, max= 8192, per=59.20%, avg=8192.00, stdev= 0.00, samples=1 00:14:05.886 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:14:05.886 lat (usec) : 250=50.82%, 500=46.92%, 750=1.40% 00:14:05.886 lat (msec) : 20=0.06%, 50=0.79% 00:14:05.886 cpu : usr=1.67%, sys=1.96%, ctx=1641, majf=0, minf=2 00:14:05.886 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:05.886 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:05.886 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:05.886 issued rwts: total=617,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:05.886 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:05.886 job1: (groupid=0, jobs=1): err= 0: pid=1442539: Sat Apr 27 03:25:30 2024 00:14:05.886 read: IOPS=638, BW=2555KiB/s (2616kB/s)(2624KiB/1027msec) 00:14:05.886 slat (nsec): min=5173, max=66610, avg=18591.74, stdev=10471.24 00:14:05.886 clat (usec): min=246, max=42049, avg=1162.22, stdev=5726.26 00:14:05.886 lat (usec): min=260, max=42065, avg=1180.81, stdev=5726.58 00:14:05.886 clat percentiles (usec): 00:14:05.886 | 1.00th=[ 273], 5.00th=[ 285], 10.00th=[ 293], 20.00th=[ 310], 00:14:05.887 | 30.00th=[ 318], 40.00th=[ 326], 50.00th=[ 334], 60.00th=[ 351], 00:14:05.887 | 70.00th=[ 363], 80.00th=[ 383], 90.00th=[ 437], 95.00th=[ 486], 00:14:05.887 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:14:05.887 | 99.99th=[42206] 00:14:05.887 write: IOPS=997, BW=3988KiB/s (4084kB/s)(4096KiB/1027msec); 0 zone resets 00:14:05.887 slat (nsec): min=6441, max=70126, avg=11829.71, stdev=7511.88 00:14:05.887 clat (usec): min=154, max=422, avg=227.62, stdev=54.12 00:14:05.887 lat (usec): min=161, max=441, avg=239.45, stdev=57.46 00:14:05.887 clat percentiles (usec): 00:14:05.887 | 1.00th=[ 161], 5.00th=[ 176], 10.00th=[ 184], 20.00th=[ 188], 00:14:05.887 | 30.00th=[ 192], 40.00th=[ 196], 50.00th=[ 200], 60.00th=[ 210], 00:14:05.887 | 70.00th=[ 243], 80.00th=[ 285], 90.00th=[ 318], 95.00th=[ 338], 00:14:05.887 | 99.00th=[ 367], 99.50th=[ 396], 99.90th=[ 408], 99.95th=[ 424], 00:14:05.887 | 99.99th=[ 424] 00:14:05.887 bw ( KiB/s): min= 8192, max= 8192, per=59.20%, avg=8192.00, stdev= 0.00, samples=1 00:14:05.887 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:14:05.887 lat (usec) : 250=44.29%, 500=54.35%, 750=0.54% 00:14:05.887 lat (msec) : 2=0.06%, 50=0.77% 00:14:05.887 cpu : usr=1.46%, sys=2.24%, ctx=1680, majf=0, minf=1 00:14:05.887 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:05.887 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:05.887 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:05.887 issued rwts: total=656,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:05.887 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:05.887 job2: (groupid=0, jobs=1): err= 0: pid=1442540: Sat Apr 27 03:25:30 2024 00:14:05.887 read: IOPS=948, BW=3793KiB/s (3884kB/s)(3884KiB/1024msec) 00:14:05.887 slat (nsec): min=5226, max=71989, avg=16869.80, stdev=9814.11 00:14:05.887 clat (usec): min=212, max=41003, avg=772.70, stdev=4300.88 00:14:05.887 lat (usec): min=217, max=41023, avg=789.57, stdev=4301.63 00:14:05.887 clat percentiles (usec): 00:14:05.887 | 1.00th=[ 219], 5.00th=[ 227], 10.00th=[ 233], 20.00th=[ 243], 00:14:05.887 | 30.00th=[ 255], 40.00th=[ 277], 50.00th=[ 293], 60.00th=[ 314], 00:14:05.887 | 70.00th=[ 347], 80.00th=[ 363], 90.00th=[ 453], 95.00th=[ 498], 00:14:05.887 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:14:05.887 | 99.99th=[41157] 00:14:05.887 write: IOPS=1000, BW=4000KiB/s (4096kB/s)(4096KiB/1024msec); 0 zone resets 00:14:05.887 slat (nsec): min=7026, max=58460, avg=13103.80, stdev=6887.25 00:14:05.887 clat (usec): min=164, max=405, avg=229.72, stdev=40.83 00:14:05.887 lat (usec): min=172, max=452, avg=242.82, stdev=43.74 00:14:05.887 clat percentiles (usec): 00:14:05.887 | 1.00th=[ 178], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 198], 00:14:05.887 | 30.00th=[ 204], 40.00th=[ 210], 50.00th=[ 215], 60.00th=[ 225], 00:14:05.887 | 70.00th=[ 235], 80.00th=[ 269], 90.00th=[ 293], 95.00th=[ 318], 00:14:05.887 | 99.00th=[ 351], 99.50th=[ 355], 99.90th=[ 371], 99.95th=[ 408], 00:14:05.887 | 99.99th=[ 408] 00:14:05.887 bw ( KiB/s): min= 8192, max= 8192, per=59.20%, avg=8192.00, stdev= 0.00, samples=1 00:14:05.887 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:14:05.887 lat (usec) : 250=51.38%, 500=46.62%, 750=1.35% 00:14:05.887 lat (msec) : 2=0.10%, 50=0.55% 00:14:05.887 cpu : usr=1.47%, sys=3.13%, ctx=1996, majf=0, minf=1 00:14:05.887 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:05.887 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:05.887 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:05.887 issued rwts: total=971,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:05.887 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:05.887 job3: (groupid=0, jobs=1): err= 0: pid=1442541: Sat Apr 27 03:25:30 2024 00:14:05.887 read: IOPS=21, BW=84.9KiB/s (87.0kB/s)(88.0KiB/1036msec) 00:14:05.887 slat (nsec): min=7451, max=35283, avg=19721.68, stdev=8301.87 00:14:05.887 clat (usec): min=40845, max=42058, avg=41612.31, stdev=499.16 00:14:05.887 lat (usec): min=40879, max=42073, avg=41632.03, stdev=498.20 00:14:05.887 clat percentiles (usec): 00:14:05.887 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:14:05.887 | 30.00th=[41157], 40.00th=[41681], 50.00th=[41681], 60.00th=[42206], 00:14:05.887 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:14:05.887 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:14:05.887 | 99.99th=[42206] 00:14:05.887 write: IOPS=494, BW=1977KiB/s (2024kB/s)(2048KiB/1036msec); 0 zone resets 00:14:05.887 slat (nsec): min=7106, max=42586, avg=13497.36, stdev=5818.37 00:14:05.887 clat (usec): min=167, max=369, avg=217.29, stdev=33.82 00:14:05.887 lat (usec): min=175, max=387, avg=230.78, stdev=35.05 00:14:05.887 clat percentiles (usec): 00:14:05.887 | 1.00th=[ 174], 5.00th=[ 180], 10.00th=[ 184], 20.00th=[ 190], 00:14:05.887 | 30.00th=[ 194], 40.00th=[ 200], 50.00th=[ 208], 60.00th=[ 219], 00:14:05.887 | 70.00th=[ 229], 80.00th=[ 245], 90.00th=[ 273], 95.00th=[ 285], 00:14:05.887 | 99.00th=[ 310], 99.50th=[ 314], 99.90th=[ 371], 99.95th=[ 371], 00:14:05.887 | 99.99th=[ 371] 00:14:05.887 bw ( KiB/s): min= 4096, max= 4096, per=29.60%, avg=4096.00, stdev= 0.00, samples=1 00:14:05.887 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:14:05.887 lat (usec) : 250=80.52%, 500=15.36% 00:14:05.887 lat (msec) : 50=4.12% 00:14:05.887 cpu : usr=0.00%, sys=0.97%, ctx=535, majf=0, minf=1 00:14:05.887 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:05.887 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:05.887 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:05.887 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:05.887 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:05.887 00:14:05.887 Run status group 0 (all jobs): 00:14:05.887 READ: bw=8749KiB/s (8959kB/s), 84.9KiB/s-3793KiB/s (87.0kB/s-3884kB/s), io=9064KiB (9282kB), run=1021-1036msec 00:14:05.887 WRITE: bw=13.5MiB/s (14.2MB/s), 1977KiB/s-4012KiB/s (2024kB/s-4108kB/s), io=14.0MiB (14.7MB), run=1021-1036msec 00:14:05.887 00:14:05.887 Disk stats (read/write): 00:14:05.887 nvme0n1: ios=661/1024, merge=0/0, ticks=542/219, in_queue=761, util=83.07% 00:14:05.887 nvme0n2: ios=650/1024, merge=0/0, ticks=497/231, in_queue=728, util=83.45% 00:14:05.887 nvme0n3: ios=1009/1024, merge=0/0, ticks=1246/229, in_queue=1475, util=98.05% 00:14:05.887 nvme0n4: ios=42/512, merge=0/0, ticks=1583/107, in_queue=1690, util=98.57% 00:14:05.887 03:25:30 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:14:05.887 [global] 00:14:05.887 thread=1 00:14:05.887 invalidate=1 00:14:05.887 rw=write 00:14:05.887 time_based=1 00:14:05.887 runtime=1 00:14:05.887 ioengine=libaio 00:14:05.887 direct=1 00:14:05.887 bs=4096 00:14:05.887 iodepth=128 00:14:05.887 norandommap=0 00:14:05.887 numjobs=1 00:14:05.887 00:14:05.887 verify_dump=1 00:14:05.887 verify_backlog=512 00:14:05.887 verify_state_save=0 00:14:05.887 do_verify=1 00:14:05.887 verify=crc32c-intel 00:14:05.887 [job0] 00:14:05.887 filename=/dev/nvme0n1 00:14:05.887 [job1] 00:14:05.887 filename=/dev/nvme0n2 00:14:05.887 [job2] 00:14:05.887 filename=/dev/nvme0n3 00:14:05.887 [job3] 00:14:05.887 filename=/dev/nvme0n4 00:14:05.887 Could not set queue depth (nvme0n1) 00:14:05.887 Could not set queue depth (nvme0n2) 00:14:05.887 Could not set queue depth (nvme0n3) 00:14:05.887 Could not set queue depth (nvme0n4) 00:14:05.887 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:05.887 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:05.887 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:05.887 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:05.887 fio-3.35 00:14:05.887 Starting 4 threads 00:14:07.263 00:14:07.263 job0: (groupid=0, jobs=1): err= 0: pid=1442770: Sat Apr 27 03:25:32 2024 00:14:07.263 read: IOPS=4703, BW=18.4MiB/s (19.3MB/s)(18.5MiB/1008msec) 00:14:07.263 slat (usec): min=3, max=10835, avg=100.10, stdev=510.16 00:14:07.263 clat (usec): min=6679, max=31463, avg=13174.14, stdev=3923.72 00:14:07.263 lat (usec): min=8803, max=31478, avg=13274.24, stdev=3933.47 00:14:07.263 clat percentiles (usec): 00:14:07.263 | 1.00th=[ 9110], 5.00th=[ 9765], 10.00th=[10290], 20.00th=[11207], 00:14:07.263 | 30.00th=[11469], 40.00th=[11731], 50.00th=[11863], 60.00th=[12125], 00:14:07.263 | 70.00th=[12387], 80.00th=[13698], 90.00th=[19006], 95.00th=[21890], 00:14:07.263 | 99.00th=[29230], 99.50th=[31327], 99.90th=[31327], 99.95th=[31589], 00:14:07.263 | 99.99th=[31589] 00:14:07.263 write: IOPS=5079, BW=19.8MiB/s (20.8MB/s)(20.0MiB/1008msec); 0 zone resets 00:14:07.263 slat (usec): min=4, max=6643, avg=92.36, stdev=436.27 00:14:07.263 clat (usec): min=8456, max=48056, avg=12718.43, stdev=5291.14 00:14:07.263 lat (usec): min=8467, max=48084, avg=12810.79, stdev=5313.36 00:14:07.263 clat percentiles (usec): 00:14:07.263 | 1.00th=[ 9110], 5.00th=[ 9372], 10.00th=[ 9634], 20.00th=[ 9896], 00:14:07.263 | 30.00th=[11076], 40.00th=[11469], 50.00th=[11731], 60.00th=[11863], 00:14:07.263 | 70.00th=[12125], 80.00th=[12518], 90.00th=[14091], 95.00th=[22676], 00:14:07.263 | 99.00th=[39060], 99.50th=[43779], 99.90th=[47973], 99.95th=[47973], 00:14:07.263 | 99.99th=[47973] 00:14:07.263 bw ( KiB/s): min=16696, max=24264, per=33.30%, avg=20480.00, stdev=5351.38, samples=2 00:14:07.263 iops : min= 4174, max= 6066, avg=5120.00, stdev=1337.85, samples=2 00:14:07.263 lat (msec) : 10=14.64%, 20=78.56%, 50=6.79% 00:14:07.263 cpu : usr=7.25%, sys=9.93%, ctx=548, majf=0, minf=1 00:14:07.263 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:14:07.263 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:07.263 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:07.263 issued rwts: total=4741,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:07.263 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:07.263 job1: (groupid=0, jobs=1): err= 0: pid=1442771: Sat Apr 27 03:25:32 2024 00:14:07.263 read: IOPS=2527, BW=9.87MiB/s (10.4MB/s)(10.0MiB/1013msec) 00:14:07.263 slat (usec): min=2, max=16891, avg=173.26, stdev=1082.65 00:14:07.263 clat (usec): min=6714, max=69966, avg=19529.73, stdev=10732.23 00:14:07.263 lat (usec): min=6732, max=69973, avg=19702.99, stdev=10820.25 00:14:07.263 clat percentiles (usec): 00:14:07.263 | 1.00th=[ 8160], 5.00th=[11469], 10.00th=[11731], 20.00th=[12256], 00:14:07.263 | 30.00th=[12518], 40.00th=[15401], 50.00th=[16712], 60.00th=[16909], 00:14:07.263 | 70.00th=[20055], 80.00th=[22152], 90.00th=[35390], 95.00th=[42730], 00:14:07.263 | 99.00th=[60556], 99.50th=[65274], 99.90th=[69731], 99.95th=[69731], 00:14:07.263 | 99.99th=[69731] 00:14:07.263 write: IOPS=2738, BW=10.7MiB/s (11.2MB/s)(10.8MiB/1013msec); 0 zone resets 00:14:07.263 slat (usec): min=4, max=20353, avg=191.53, stdev=918.19 00:14:07.263 clat (usec): min=1247, max=69960, avg=28314.01, stdev=12846.22 00:14:07.263 lat (usec): min=1262, max=69976, avg=28505.53, stdev=12932.07 00:14:07.263 clat percentiles (usec): 00:14:07.263 | 1.00th=[ 4621], 5.00th=[10552], 10.00th=[13698], 20.00th=[21103], 00:14:07.263 | 30.00th=[22152], 40.00th=[22938], 50.00th=[23987], 60.00th=[24511], 00:14:07.263 | 70.00th=[31589], 80.00th=[40109], 90.00th=[47973], 95.00th=[54789], 00:14:07.263 | 99.00th=[61080], 99.50th=[61080], 99.90th=[61080], 99.95th=[69731], 00:14:07.263 | 99.99th=[69731] 00:14:07.263 bw ( KiB/s): min= 9792, max=11376, per=17.21%, avg=10584.00, stdev=1120.06, samples=2 00:14:07.263 iops : min= 2448, max= 2844, avg=2646.00, stdev=280.01, samples=2 00:14:07.263 lat (msec) : 2=0.04%, 4=0.22%, 10=2.02%, 20=40.66%, 50=50.88% 00:14:07.263 lat (msec) : 100=6.17% 00:14:07.263 cpu : usr=3.56%, sys=5.73%, ctx=330, majf=0, minf=1 00:14:07.263 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:14:07.263 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:07.263 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:07.263 issued rwts: total=2560,2774,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:07.263 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:07.263 job2: (groupid=0, jobs=1): err= 0: pid=1442772: Sat Apr 27 03:25:32 2024 00:14:07.263 read: IOPS=2881, BW=11.3MiB/s (11.8MB/s)(11.3MiB/1007msec) 00:14:07.263 slat (usec): min=3, max=13987, avg=153.50, stdev=989.17 00:14:07.263 clat (usec): min=4270, max=46658, avg=19119.74, stdev=7143.71 00:14:07.263 lat (usec): min=5636, max=46675, avg=19273.24, stdev=7225.24 00:14:07.263 clat percentiles (usec): 00:14:07.263 | 1.00th=[ 8717], 5.00th=[10814], 10.00th=[13566], 20.00th=[14877], 00:14:07.263 | 30.00th=[15139], 40.00th=[15795], 50.00th=[16319], 60.00th=[17433], 00:14:07.263 | 70.00th=[20055], 80.00th=[23200], 90.00th=[32900], 95.00th=[34341], 00:14:07.263 | 99.00th=[42206], 99.50th=[43254], 99.90th=[45876], 99.95th=[46400], 00:14:07.263 | 99.99th=[46400] 00:14:07.263 write: IOPS=3050, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1007msec); 0 zone resets 00:14:07.263 slat (usec): min=5, max=32029, avg=164.64, stdev=1066.63 00:14:07.263 clat (usec): min=3455, max=66598, avg=23448.83, stdev=11958.80 00:14:07.263 lat (usec): min=3473, max=66625, avg=23613.48, stdev=12034.37 00:14:07.263 clat percentiles (usec): 00:14:07.263 | 1.00th=[ 5276], 5.00th=[13829], 10.00th=[14222], 20.00th=[14615], 00:14:07.263 | 30.00th=[15008], 40.00th=[19792], 50.00th=[21890], 60.00th=[23200], 00:14:07.263 | 70.00th=[23987], 80.00th=[26608], 90.00th=[34866], 95.00th=[56361], 00:14:07.263 | 99.00th=[63701], 99.50th=[64750], 99.90th=[66847], 99.95th=[66847], 00:14:07.263 | 99.99th=[66847] 00:14:07.263 bw ( KiB/s): min=11784, max=12792, per=19.98%, avg=12288.00, stdev=712.76, samples=2 00:14:07.263 iops : min= 2946, max= 3198, avg=3072.00, stdev=178.19, samples=2 00:14:07.263 lat (msec) : 4=0.32%, 10=3.33%, 20=49.82%, 50=43.22%, 100=3.31% 00:14:07.263 cpu : usr=4.27%, sys=7.16%, ctx=297, majf=0, minf=1 00:14:07.263 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:14:07.263 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:07.263 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:07.263 issued rwts: total=2902,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:07.263 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:07.263 job3: (groupid=0, jobs=1): err= 0: pid=1442773: Sat Apr 27 03:25:32 2024 00:14:07.263 read: IOPS=4174, BW=16.3MiB/s (17.1MB/s)(16.4MiB/1004msec) 00:14:07.263 slat (usec): min=2, max=22948, avg=116.48, stdev=784.63 00:14:07.263 clat (usec): min=3405, max=36676, avg=14309.78, stdev=4603.91 00:14:07.263 lat (usec): min=3417, max=36692, avg=14426.26, stdev=4650.76 00:14:07.263 clat percentiles (usec): 00:14:07.263 | 1.00th=[ 8717], 5.00th=[10159], 10.00th=[10814], 20.00th=[12387], 00:14:07.263 | 30.00th=[12649], 40.00th=[12911], 50.00th=[13042], 60.00th=[13304], 00:14:07.263 | 70.00th=[13698], 80.00th=[15401], 90.00th=[17957], 95.00th=[24511], 00:14:07.263 | 99.00th=[33817], 99.50th=[35914], 99.90th=[36439], 99.95th=[36439], 00:14:07.263 | 99.99th=[36439] 00:14:07.263 write: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec); 0 zone resets 00:14:07.263 slat (usec): min=3, max=13196, avg=100.86, stdev=445.41 00:14:07.263 clat (usec): min=942, max=36049, avg=14583.24, stdev=3592.91 00:14:07.263 lat (usec): min=950, max=36062, avg=14684.10, stdev=3628.70 00:14:07.263 clat percentiles (usec): 00:14:07.263 | 1.00th=[ 8586], 5.00th=[11207], 10.00th=[11731], 20.00th=[12780], 00:14:07.263 | 30.00th=[13173], 40.00th=[13566], 50.00th=[13698], 60.00th=[13829], 00:14:07.263 | 70.00th=[14091], 80.00th=[15533], 90.00th=[19006], 95.00th=[22938], 00:14:07.263 | 99.00th=[27919], 99.50th=[30802], 99.90th=[34341], 99.95th=[34341], 00:14:07.263 | 99.99th=[35914] 00:14:07.263 bw ( KiB/s): min=16384, max=20224, per=29.76%, avg=18304.00, stdev=2715.29, samples=2 00:14:07.263 iops : min= 4096, max= 5056, avg=4576.00, stdev=678.82, samples=2 00:14:07.263 lat (usec) : 1000=0.03% 00:14:07.263 lat (msec) : 4=0.34%, 10=2.68%, 20=90.26%, 50=6.68% 00:14:07.263 cpu : usr=5.78%, sys=9.57%, ctx=578, majf=0, minf=1 00:14:07.263 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:14:07.263 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:07.263 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:07.263 issued rwts: total=4191,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:07.263 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:07.263 00:14:07.263 Run status group 0 (all jobs): 00:14:07.263 READ: bw=55.5MiB/s (58.2MB/s), 9.87MiB/s-18.4MiB/s (10.4MB/s-19.3MB/s), io=56.2MiB (59.0MB), run=1004-1013msec 00:14:07.263 WRITE: bw=60.1MiB/s (63.0MB/s), 10.7MiB/s-19.8MiB/s (11.2MB/s-20.8MB/s), io=60.8MiB (63.8MB), run=1004-1013msec 00:14:07.263 00:14:07.263 Disk stats (read/write): 00:14:07.263 nvme0n1: ios=4114/4096, merge=0/0, ticks=13429/11619, in_queue=25048, util=86.57% 00:14:07.263 nvme0n2: ios=2069/2223, merge=0/0, ticks=40903/62991, in_queue=103894, util=89.33% 00:14:07.263 nvme0n3: ios=2583/2655, merge=0/0, ticks=30205/36357, in_queue=66562, util=98.23% 00:14:07.263 nvme0n4: ios=3613/3799, merge=0/0, ticks=25199/26572, in_queue=51771, util=96.64% 00:14:07.263 03:25:32 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:14:07.263 [global] 00:14:07.263 thread=1 00:14:07.263 invalidate=1 00:14:07.263 rw=randwrite 00:14:07.263 time_based=1 00:14:07.263 runtime=1 00:14:07.263 ioengine=libaio 00:14:07.263 direct=1 00:14:07.263 bs=4096 00:14:07.263 iodepth=128 00:14:07.263 norandommap=0 00:14:07.263 numjobs=1 00:14:07.263 00:14:07.263 verify_dump=1 00:14:07.263 verify_backlog=512 00:14:07.263 verify_state_save=0 00:14:07.263 do_verify=1 00:14:07.263 verify=crc32c-intel 00:14:07.263 [job0] 00:14:07.263 filename=/dev/nvme0n1 00:14:07.263 [job1] 00:14:07.263 filename=/dev/nvme0n2 00:14:07.263 [job2] 00:14:07.263 filename=/dev/nvme0n3 00:14:07.263 [job3] 00:14:07.263 filename=/dev/nvme0n4 00:14:07.263 Could not set queue depth (nvme0n1) 00:14:07.263 Could not set queue depth (nvme0n2) 00:14:07.263 Could not set queue depth (nvme0n3) 00:14:07.263 Could not set queue depth (nvme0n4) 00:14:07.522 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:07.522 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:07.522 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:07.522 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:07.522 fio-3.35 00:14:07.522 Starting 4 threads 00:14:08.896 00:14:08.896 job0: (groupid=0, jobs=1): err= 0: pid=1443005: Sat Apr 27 03:25:33 2024 00:14:08.896 read: IOPS=2518, BW=9.84MiB/s (10.3MB/s)(9.88MiB/1004msec) 00:14:08.896 slat (usec): min=3, max=20773, avg=239.15, stdev=1234.35 00:14:08.896 clat (usec): min=2969, max=99142, avg=30781.80, stdev=19853.75 00:14:08.896 lat (usec): min=5045, max=99149, avg=31020.95, stdev=19938.13 00:14:08.896 clat percentiles (usec): 00:14:08.896 | 1.00th=[ 7504], 5.00th=[14877], 10.00th=[16909], 20.00th=[19268], 00:14:08.896 | 30.00th=[19530], 40.00th=[19792], 50.00th=[20055], 60.00th=[21365], 00:14:08.896 | 70.00th=[34866], 80.00th=[47973], 90.00th=[58459], 95.00th=[73925], 00:14:08.896 | 99.00th=[99091], 99.50th=[99091], 99.90th=[99091], 99.95th=[99091], 00:14:08.896 | 99.99th=[99091] 00:14:08.896 write: IOPS=2549, BW=9.96MiB/s (10.4MB/s)(10.0MiB/1004msec); 0 zone resets 00:14:08.896 slat (usec): min=4, max=19336, avg=144.32, stdev=933.66 00:14:08.896 clat (usec): min=8243, max=57506, avg=19140.12, stdev=10533.54 00:14:08.896 lat (usec): min=8256, max=61211, avg=19284.44, stdev=10582.14 00:14:08.896 clat percentiles (usec): 00:14:08.896 | 1.00th=[11076], 5.00th=[11600], 10.00th=[11863], 20.00th=[13566], 00:14:08.896 | 30.00th=[13829], 40.00th=[13960], 50.00th=[14222], 60.00th=[14615], 00:14:08.896 | 70.00th=[16909], 80.00th=[23200], 90.00th=[38536], 95.00th=[46400], 00:14:08.896 | 99.00th=[54264], 99.50th=[57410], 99.90th=[57410], 99.95th=[57410], 00:14:08.896 | 99.99th=[57410] 00:14:08.896 bw ( KiB/s): min= 8696, max=11784, per=19.65%, avg=10240.00, stdev=2183.55, samples=2 00:14:08.896 iops : min= 2174, max= 2946, avg=2560.00, stdev=545.89, samples=2 00:14:08.896 lat (msec) : 4=0.02%, 10=0.86%, 20=63.10%, 50=25.49%, 100=10.53% 00:14:08.896 cpu : usr=2.89%, sys=5.38%, ctx=227, majf=0, minf=1 00:14:08.896 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:14:08.896 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:08.896 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:08.896 issued rwts: total=2529,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:08.896 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:08.896 job1: (groupid=0, jobs=1): err= 0: pid=1443006: Sat Apr 27 03:25:33 2024 00:14:08.896 read: IOPS=4055, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1010msec) 00:14:08.896 slat (usec): min=3, max=10138, avg=109.40, stdev=712.63 00:14:08.896 clat (usec): min=4946, max=36521, avg=13009.33, stdev=4754.78 00:14:08.896 lat (usec): min=4965, max=36535, avg=13118.73, stdev=4813.73 00:14:08.896 clat percentiles (usec): 00:14:08.896 | 1.00th=[ 7570], 5.00th=[ 9503], 10.00th=[10028], 20.00th=[10290], 00:14:08.896 | 30.00th=[10683], 40.00th=[10945], 50.00th=[11207], 60.00th=[11600], 00:14:08.896 | 70.00th=[12256], 80.00th=[14746], 90.00th=[19530], 95.00th=[25035], 00:14:08.896 | 99.00th=[32113], 99.50th=[33424], 99.90th=[36439], 99.95th=[36439], 00:14:08.896 | 99.99th=[36439] 00:14:08.896 write: IOPS=4409, BW=17.2MiB/s (18.1MB/s)(17.4MiB/1010msec); 0 zone resets 00:14:08.896 slat (usec): min=4, max=9424, avg=114.63, stdev=495.81 00:14:08.896 clat (usec): min=1450, max=36523, avg=16794.29, stdev=6459.20 00:14:08.896 lat (usec): min=1462, max=36542, avg=16908.92, stdev=6502.43 00:14:08.896 clat percentiles (usec): 00:14:08.896 | 1.00th=[ 3785], 5.00th=[ 7046], 10.00th=[ 8455], 20.00th=[10421], 00:14:08.896 | 30.00th=[11731], 40.00th=[13435], 50.00th=[18744], 60.00th=[19530], 00:14:08.896 | 70.00th=[20055], 80.00th=[22152], 90.00th=[25822], 95.00th=[27657], 00:14:08.896 | 99.00th=[28181], 99.50th=[28443], 99.90th=[28443], 99.95th=[33424], 00:14:08.896 | 99.99th=[36439] 00:14:08.896 bw ( KiB/s): min=17096, max=17520, per=33.21%, avg=17308.00, stdev=299.81, samples=2 00:14:08.896 iops : min= 4274, max= 4380, avg=4327.00, stdev=74.95, samples=2 00:14:08.896 lat (msec) : 2=0.11%, 4=0.49%, 10=11.77%, 20=67.58%, 50=20.06% 00:14:08.896 cpu : usr=5.75%, sys=7.73%, ctx=506, majf=0, minf=1 00:14:08.896 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:14:08.896 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:08.896 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:08.896 issued rwts: total=4096,4454,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:08.896 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:08.896 job2: (groupid=0, jobs=1): err= 0: pid=1443007: Sat Apr 27 03:25:33 2024 00:14:08.896 read: IOPS=3358, BW=13.1MiB/s (13.8MB/s)(13.2MiB/1007msec) 00:14:08.896 slat (usec): min=3, max=11530, avg=128.92, stdev=793.08 00:14:08.896 clat (usec): min=5422, max=44784, avg=15163.42, stdev=6514.97 00:14:08.896 lat (usec): min=5431, max=44799, avg=15292.34, stdev=6572.46 00:14:08.896 clat percentiles (usec): 00:14:08.896 | 1.00th=[ 6587], 5.00th=[ 8979], 10.00th=[11338], 20.00th=[11600], 00:14:08.896 | 30.00th=[11731], 40.00th=[11863], 50.00th=[11994], 60.00th=[13829], 00:14:08.896 | 70.00th=[15533], 80.00th=[17695], 90.00th=[23987], 95.00th=[29230], 00:14:08.896 | 99.00th=[42206], 99.50th=[43254], 99.90th=[44827], 99.95th=[44827], 00:14:08.896 | 99.99th=[44827] 00:14:08.896 write: IOPS=3559, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1007msec); 0 zone resets 00:14:08.896 slat (usec): min=4, max=14072, avg=146.96, stdev=684.95 00:14:08.896 clat (usec): min=2740, max=44726, avg=21340.19, stdev=10014.34 00:14:08.896 lat (usec): min=2747, max=44747, avg=21487.15, stdev=10089.59 00:14:08.896 clat percentiles (usec): 00:14:08.896 | 1.00th=[ 4293], 5.00th=[ 8979], 10.00th=[10290], 20.00th=[11076], 00:14:08.896 | 30.00th=[12780], 40.00th=[17695], 50.00th=[21627], 60.00th=[22152], 00:14:08.896 | 70.00th=[25297], 80.00th=[31851], 90.00th=[36963], 95.00th=[39060], 00:14:08.896 | 99.00th=[42206], 99.50th=[42730], 99.90th=[44303], 99.95th=[44827], 00:14:08.896 | 99.99th=[44827] 00:14:08.896 bw ( KiB/s): min=12304, max=16368, per=27.51%, avg=14336.00, stdev=2873.68, samples=2 00:14:08.896 iops : min= 3076, max= 4092, avg=3584.00, stdev=718.42, samples=2 00:14:08.896 lat (msec) : 4=0.37%, 10=7.26%, 20=55.44%, 50=36.92% 00:14:08.896 cpu : usr=4.27%, sys=7.55%, ctx=397, majf=0, minf=1 00:14:08.896 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:14:08.896 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:08.896 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:08.896 issued rwts: total=3382,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:08.896 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:08.896 job3: (groupid=0, jobs=1): err= 0: pid=1443008: Sat Apr 27 03:25:33 2024 00:14:08.896 read: IOPS=2410, BW=9641KiB/s (9872kB/s)(9708KiB/1007msec) 00:14:08.896 slat (usec): min=3, max=13644, avg=131.73, stdev=736.07 00:14:08.896 clat (usec): min=1439, max=51663, avg=16288.76, stdev=4896.66 00:14:08.896 lat (usec): min=8206, max=51668, avg=16420.49, stdev=4935.85 00:14:08.896 clat percentiles (usec): 00:14:08.896 | 1.00th=[10159], 5.00th=[12387], 10.00th=[13173], 20.00th=[13960], 00:14:08.896 | 30.00th=[14222], 40.00th=[14484], 50.00th=[14746], 60.00th=[15008], 00:14:08.896 | 70.00th=[15664], 80.00th=[17695], 90.00th=[22152], 95.00th=[27132], 00:14:08.896 | 99.00th=[39584], 99.50th=[41157], 99.90th=[51643], 99.95th=[51643], 00:14:08.896 | 99.99th=[51643] 00:14:08.896 write: IOPS=2542, BW=9.93MiB/s (10.4MB/s)(10.0MiB/1007msec); 0 zone resets 00:14:08.896 slat (usec): min=5, max=21416, avg=246.54, stdev=1181.19 00:14:08.896 clat (msec): min=10, max=112, avg=32.77, stdev=20.50 00:14:08.896 lat (msec): min=10, max=112, avg=33.02, stdev=20.61 00:14:08.896 clat percentiles (msec): 00:14:08.896 | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], 00:14:08.896 | 30.00th=[ 22], 40.00th=[ 23], 50.00th=[ 23], 60.00th=[ 28], 00:14:08.896 | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 59], 95.00th=[ 74], 00:14:08.896 | 99.00th=[ 111], 99.50th=[ 112], 99.90th=[ 113], 99.95th=[ 113], 00:14:08.896 | 99.99th=[ 113] 00:14:08.896 bw ( KiB/s): min= 9656, max=10824, per=19.65%, avg=10240.00, stdev=825.90, samples=2 00:14:08.896 iops : min= 2414, max= 2706, avg=2560.00, stdev=206.48, samples=2 00:14:08.896 lat (msec) : 2=0.02%, 10=0.26%, 20=49.05%, 50=41.87%, 100=7.08% 00:14:08.896 lat (msec) : 250=1.72% 00:14:08.896 cpu : usr=3.08%, sys=5.96%, ctx=357, majf=0, minf=1 00:14:08.896 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:14:08.896 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:08.896 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:08.896 issued rwts: total=2427,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:08.896 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:08.896 00:14:08.896 Run status group 0 (all jobs): 00:14:08.896 READ: bw=48.1MiB/s (50.4MB/s), 9641KiB/s-15.8MiB/s (9872kB/s-16.6MB/s), io=48.6MiB (50.9MB), run=1004-1010msec 00:14:08.896 WRITE: bw=50.9MiB/s (53.4MB/s), 9.93MiB/s-17.2MiB/s (10.4MB/s-18.1MB/s), io=51.4MiB (53.9MB), run=1004-1010msec 00:14:08.896 00:14:08.896 Disk stats (read/write): 00:14:08.896 nvme0n1: ios=2098/2159, merge=0/0, ticks=16764/10044, in_queue=26808, util=89.98% 00:14:08.896 nvme0n2: ios=3634/3727, merge=0/0, ticks=45623/58410, in_queue=104033, util=90.96% 00:14:08.896 nvme0n3: ios=2867/3072, merge=0/0, ticks=40121/64359, in_queue=104480, util=92.81% 00:14:08.896 nvme0n4: ios=2105/2095, merge=0/0, ticks=15112/34485, in_queue=49597, util=91.50% 00:14:08.896 03:25:33 -- target/fio.sh@55 -- # sync 00:14:08.896 03:25:33 -- target/fio.sh@59 -- # fio_pid=1443156 00:14:08.896 03:25:33 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:14:08.896 03:25:33 -- target/fio.sh@61 -- # sleep 3 00:14:08.896 [global] 00:14:08.896 thread=1 00:14:08.896 invalidate=1 00:14:08.896 rw=read 00:14:08.896 time_based=1 00:14:08.896 runtime=10 00:14:08.896 ioengine=libaio 00:14:08.896 direct=1 00:14:08.896 bs=4096 00:14:08.896 iodepth=1 00:14:08.896 norandommap=1 00:14:08.896 numjobs=1 00:14:08.896 00:14:08.896 [job0] 00:14:08.896 filename=/dev/nvme0n1 00:14:08.896 [job1] 00:14:08.896 filename=/dev/nvme0n2 00:14:08.896 [job2] 00:14:08.896 filename=/dev/nvme0n3 00:14:08.896 [job3] 00:14:08.896 filename=/dev/nvme0n4 00:14:08.897 Could not set queue depth (nvme0n1) 00:14:08.897 Could not set queue depth (nvme0n2) 00:14:08.897 Could not set queue depth (nvme0n3) 00:14:08.897 Could not set queue depth (nvme0n4) 00:14:08.897 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:08.897 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:08.897 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:08.897 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:08.897 fio-3.35 00:14:08.897 Starting 4 threads 00:14:12.173 03:25:36 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:14:12.173 03:25:36 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:14:12.173 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=38948864, buflen=4096 00:14:12.173 fio: pid=1443353, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:12.173 03:25:37 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:12.173 03:25:37 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:14:12.173 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=9269248, buflen=4096 00:14:12.173 fio: pid=1443352, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:12.431 03:25:37 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:12.431 03:25:37 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:14:12.431 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=41435136, buflen=4096 00:14:12.431 fio: pid=1443350, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:12.689 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=17068032, buflen=4096 00:14:12.689 fio: pid=1443351, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:14:12.690 03:25:37 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:12.690 03:25:37 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:14:12.690 00:14:12.690 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1443350: Sat Apr 27 03:25:37 2024 00:14:12.690 read: IOPS=2940, BW=11.5MiB/s (12.0MB/s)(39.5MiB/3441msec) 00:14:12.690 slat (usec): min=5, max=12914, avg=12.78, stdev=183.73 00:14:12.690 clat (usec): min=212, max=41136, avg=322.08, stdev=991.78 00:14:12.690 lat (usec): min=219, max=54051, avg=334.86, stdev=1059.59 00:14:12.690 clat percentiles (usec): 00:14:12.690 | 1.00th=[ 231], 5.00th=[ 239], 10.00th=[ 243], 20.00th=[ 249], 00:14:12.690 | 30.00th=[ 258], 40.00th=[ 265], 50.00th=[ 281], 60.00th=[ 302], 00:14:12.690 | 70.00th=[ 318], 80.00th=[ 338], 90.00th=[ 367], 95.00th=[ 400], 00:14:12.690 | 99.00th=[ 529], 99.50th=[ 586], 99.90th=[ 947], 99.95th=[40633], 00:14:12.690 | 99.99th=[41157] 00:14:12.690 bw ( KiB/s): min=10656, max=14968, per=45.85%, avg=12896.00, stdev=1610.27, samples=6 00:14:12.690 iops : min= 2664, max= 3742, avg=3224.00, stdev=402.57, samples=6 00:14:12.690 lat (usec) : 250=20.49%, 500=78.08%, 750=1.29%, 1000=0.05% 00:14:12.690 lat (msec) : 2=0.01%, 4=0.01%, 50=0.06% 00:14:12.690 cpu : usr=1.72%, sys=4.80%, ctx=10120, majf=0, minf=1 00:14:12.690 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:12.690 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:12.690 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:12.690 issued rwts: total=10117,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:12.690 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:12.690 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=1443351: Sat Apr 27 03:25:37 2024 00:14:12.690 read: IOPS=1124, BW=4499KiB/s (4607kB/s)(16.3MiB/3705msec) 00:14:12.690 slat (usec): min=4, max=16664, avg=32.09, stdev=387.56 00:14:12.690 clat (usec): min=200, max=54864, avg=852.37, stdev=4546.99 00:14:12.690 lat (usec): min=210, max=54878, avg=882.87, stdev=4600.76 00:14:12.690 clat percentiles (usec): 00:14:12.690 | 1.00th=[ 219], 5.00th=[ 251], 10.00th=[ 277], 20.00th=[ 297], 00:14:12.690 | 30.00th=[ 310], 40.00th=[ 322], 50.00th=[ 338], 60.00th=[ 347], 00:14:12.690 | 70.00th=[ 363], 80.00th=[ 379], 90.00th=[ 424], 95.00th=[ 482], 00:14:12.690 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:14:12.690 | 99.99th=[54789] 00:14:12.690 bw ( KiB/s): min= 96, max=10048, per=16.63%, avg=4679.86, stdev=3779.94, samples=7 00:14:12.690 iops : min= 24, max= 2512, avg=1169.86, stdev=945.04, samples=7 00:14:12.690 lat (usec) : 250=4.97%, 500=90.74%, 750=3.00% 00:14:12.690 lat (msec) : 2=0.02%, 50=1.22%, 100=0.02% 00:14:12.690 cpu : usr=1.05%, sys=2.56%, ctx=4174, majf=0, minf=1 00:14:12.690 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:12.690 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:12.690 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:12.690 issued rwts: total=4168,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:12.690 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:12.690 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1443352: Sat Apr 27 03:25:37 2024 00:14:12.690 read: IOPS=708, BW=2833KiB/s (2901kB/s)(9052KiB/3195msec) 00:14:12.690 slat (usec): min=5, max=11902, avg=14.15, stdev=250.01 00:14:12.690 clat (usec): min=237, max=41443, avg=1383.00, stdev=6522.54 00:14:12.690 lat (usec): min=244, max=53025, avg=1397.15, stdev=6560.93 00:14:12.690 clat percentiles (usec): 00:14:12.690 | 1.00th=[ 251], 5.00th=[ 260], 10.00th=[ 265], 20.00th=[ 273], 00:14:12.690 | 30.00th=[ 281], 40.00th=[ 289], 50.00th=[ 302], 60.00th=[ 314], 00:14:12.690 | 70.00th=[ 326], 80.00th=[ 338], 90.00th=[ 363], 95.00th=[ 379], 00:14:12.690 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41681], 99.95th=[41681], 00:14:12.690 | 99.99th=[41681] 00:14:12.690 bw ( KiB/s): min= 128, max=12768, per=10.71%, avg=3012.00, stdev=5069.37, samples=6 00:14:12.690 iops : min= 32, max= 3192, avg=753.00, stdev=1267.34, samples=6 00:14:12.690 lat (usec) : 250=0.75%, 500=95.49%, 750=0.80%, 1000=0.22% 00:14:12.690 lat (msec) : 2=0.04%, 50=2.65% 00:14:12.690 cpu : usr=0.50%, sys=0.88%, ctx=2265, majf=0, minf=1 00:14:12.690 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:12.690 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:12.690 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:12.690 issued rwts: total=2264,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:12.690 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:12.690 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1443353: Sat Apr 27 03:25:37 2024 00:14:12.690 read: IOPS=3300, BW=12.9MiB/s (13.5MB/s)(37.1MiB/2881msec) 00:14:12.690 slat (nsec): min=5275, max=62769, avg=10336.61, stdev=5163.52 00:14:12.690 clat (usec): min=221, max=1018, avg=287.50, stdev=38.40 00:14:12.690 lat (usec): min=226, max=1036, avg=297.83, stdev=40.42 00:14:12.690 clat percentiles (usec): 00:14:12.690 | 1.00th=[ 237], 5.00th=[ 243], 10.00th=[ 247], 20.00th=[ 255], 00:14:12.690 | 30.00th=[ 265], 40.00th=[ 277], 50.00th=[ 285], 60.00th=[ 293], 00:14:12.690 | 70.00th=[ 302], 80.00th=[ 314], 90.00th=[ 330], 95.00th=[ 343], 00:14:12.690 | 99.00th=[ 383], 99.50th=[ 429], 99.90th=[ 586], 99.95th=[ 799], 00:14:12.690 | 99.99th=[ 1020] 00:14:12.690 bw ( KiB/s): min=12168, max=14984, per=46.90%, avg=13193.60, stdev=1082.71, samples=5 00:14:12.690 iops : min= 3042, max= 3746, avg=3298.40, stdev=270.68, samples=5 00:14:12.690 lat (usec) : 250=14.77%, 500=84.93%, 750=0.22%, 1000=0.05% 00:14:12.690 lat (msec) : 2=0.01% 00:14:12.690 cpu : usr=2.08%, sys=5.59%, ctx=9510, majf=0, minf=1 00:14:12.690 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:12.690 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:12.690 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:12.690 issued rwts: total=9510,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:12.690 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:12.690 00:14:12.690 Run status group 0 (all jobs): 00:14:12.690 READ: bw=27.5MiB/s (28.8MB/s), 2833KiB/s-12.9MiB/s (2901kB/s-13.5MB/s), io=102MiB (107MB), run=2881-3705msec 00:14:12.690 00:14:12.690 Disk stats (read/write): 00:14:12.690 nvme0n1: ios=10135/0, merge=0/0, ticks=3148/0, in_queue=3148, util=94.97% 00:14:12.690 nvme0n2: ios=4197/0, merge=0/0, ticks=3851/0, in_queue=3851, util=98.47% 00:14:12.690 nvme0n3: ios=2261/0, merge=0/0, ticks=3026/0, in_queue=3026, util=96.34% 00:14:12.690 nvme0n4: ios=9453/0, merge=0/0, ticks=2590/0, in_queue=2590, util=96.70% 00:14:12.949 03:25:37 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:12.949 03:25:37 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:14:13.206 03:25:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:13.207 03:25:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:14:13.463 03:25:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:13.463 03:25:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:14:13.720 03:25:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:13.720 03:25:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:14:13.977 03:25:38 -- target/fio.sh@69 -- # fio_status=0 00:14:13.977 03:25:38 -- target/fio.sh@70 -- # wait 1443156 00:14:13.977 03:25:38 -- target/fio.sh@70 -- # fio_status=4 00:14:13.977 03:25:38 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:14.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:14.236 03:25:38 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:14.236 03:25:38 -- common/autotest_common.sh@1205 -- # local i=0 00:14:14.236 03:25:38 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:14.236 03:25:38 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:14.236 03:25:38 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:14.236 03:25:38 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:14.236 03:25:38 -- common/autotest_common.sh@1217 -- # return 0 00:14:14.236 03:25:38 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:14:14.236 03:25:38 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:14:14.236 nvmf hotplug test: fio failed as expected 00:14:14.236 03:25:38 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:14.495 03:25:39 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:14:14.495 03:25:39 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:14:14.495 03:25:39 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:14:14.495 03:25:39 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:14:14.495 03:25:39 -- target/fio.sh@91 -- # nvmftestfini 00:14:14.495 03:25:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:14.495 03:25:39 -- nvmf/common.sh@117 -- # sync 00:14:14.495 03:25:39 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:14:14.495 03:25:39 -- nvmf/common.sh@120 -- # set +e 00:14:14.495 03:25:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:14.495 03:25:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:14:14.495 rmmod nvme_tcp 00:14:14.495 rmmod nvme_fabrics 00:14:14.495 rmmod nvme_keyring 00:14:14.495 03:25:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:14.495 03:25:39 -- nvmf/common.sh@124 -- # set -e 00:14:14.495 03:25:39 -- nvmf/common.sh@125 -- # return 0 00:14:14.495 03:25:39 -- nvmf/common.sh@478 -- # '[' -n 1441103 ']' 00:14:14.495 03:25:39 -- nvmf/common.sh@479 -- # killprocess 1441103 00:14:14.495 03:25:39 -- common/autotest_common.sh@936 -- # '[' -z 1441103 ']' 00:14:14.495 03:25:39 -- common/autotest_common.sh@940 -- # kill -0 1441103 00:14:14.495 03:25:39 -- common/autotest_common.sh@941 -- # uname 00:14:14.495 03:25:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:14.495 03:25:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1441103 00:14:14.495 03:25:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:14.495 03:25:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:14.495 03:25:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1441103' 00:14:14.495 killing process with pid 1441103 00:14:14.495 03:25:39 -- common/autotest_common.sh@955 -- # kill 1441103 00:14:14.495 03:25:39 -- common/autotest_common.sh@960 -- # wait 1441103 00:14:14.754 03:25:39 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:14.754 03:25:39 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:14:14.754 03:25:39 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:14:14.754 03:25:39 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:14.754 03:25:39 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:14:14.754 03:25:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:14.754 03:25:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:14.754 03:25:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:17.283 03:25:41 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:14:17.283 00:14:17.283 real 0m24.014s 00:14:17.283 user 1m23.980s 00:14:17.283 sys 0m7.047s 00:14:17.283 03:25:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:17.283 03:25:41 -- common/autotest_common.sh@10 -- # set +x 00:14:17.283 ************************************ 00:14:17.283 END TEST nvmf_fio_target 00:14:17.283 ************************************ 00:14:17.283 03:25:41 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:14:17.283 03:25:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:17.283 03:25:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:17.283 03:25:41 -- common/autotest_common.sh@10 -- # set +x 00:14:17.283 ************************************ 00:14:17.283 START TEST nvmf_bdevio 00:14:17.283 ************************************ 00:14:17.283 03:25:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:14:17.283 * Looking for test storage... 00:14:17.283 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:17.283 03:25:41 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:17.283 03:25:41 -- nvmf/common.sh@7 -- # uname -s 00:14:17.283 03:25:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:17.283 03:25:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:17.283 03:25:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:17.283 03:25:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:17.283 03:25:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:17.283 03:25:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:17.283 03:25:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:17.283 03:25:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:17.283 03:25:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:17.283 03:25:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:17.283 03:25:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:14:17.283 03:25:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:14:17.283 03:25:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:17.283 03:25:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:17.283 03:25:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:17.283 03:25:41 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:17.283 03:25:41 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:17.283 03:25:41 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:17.283 03:25:41 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:17.283 03:25:41 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:17.283 03:25:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.283 03:25:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.283 03:25:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.283 03:25:41 -- paths/export.sh@5 -- # export PATH 00:14:17.283 03:25:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.283 03:25:41 -- nvmf/common.sh@47 -- # : 0 00:14:17.283 03:25:41 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:17.283 03:25:41 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:17.283 03:25:41 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:17.284 03:25:41 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:17.284 03:25:41 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:17.284 03:25:41 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:17.284 03:25:41 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:17.284 03:25:41 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:17.284 03:25:41 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:17.284 03:25:41 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:17.284 03:25:41 -- target/bdevio.sh@14 -- # nvmftestinit 00:14:17.284 03:25:41 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:14:17.284 03:25:41 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:17.284 03:25:41 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:17.284 03:25:41 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:17.284 03:25:41 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:17.284 03:25:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:17.284 03:25:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:17.284 03:25:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:17.284 03:25:41 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:17.284 03:25:41 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:17.284 03:25:41 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:17.284 03:25:41 -- common/autotest_common.sh@10 -- # set +x 00:14:19.184 03:25:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:19.184 03:25:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:19.184 03:25:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:19.184 03:25:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:19.184 03:25:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:19.184 03:25:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:19.184 03:25:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:19.184 03:25:43 -- nvmf/common.sh@295 -- # net_devs=() 00:14:19.184 03:25:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:19.184 03:25:43 -- nvmf/common.sh@296 -- # e810=() 00:14:19.184 03:25:43 -- nvmf/common.sh@296 -- # local -ga e810 00:14:19.184 03:25:43 -- nvmf/common.sh@297 -- # x722=() 00:14:19.184 03:25:43 -- nvmf/common.sh@297 -- # local -ga x722 00:14:19.184 03:25:43 -- nvmf/common.sh@298 -- # mlx=() 00:14:19.184 03:25:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:19.184 03:25:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:19.184 03:25:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:19.184 03:25:43 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:14:19.184 03:25:43 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:19.184 03:25:43 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:19.184 03:25:43 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:19.184 03:25:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:19.184 03:25:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:19.184 03:25:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:14:19.184 Found 0000:09:00.0 (0x8086 - 0x159b) 00:14:19.184 03:25:43 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:19.184 03:25:43 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:19.184 03:25:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:19.184 03:25:43 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:19.185 03:25:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:14:19.185 Found 0000:09:00.1 (0x8086 - 0x159b) 00:14:19.185 03:25:43 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:19.185 03:25:43 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:19.185 03:25:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:19.185 03:25:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:19.185 03:25:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:19.185 03:25:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:14:19.185 Found net devices under 0000:09:00.0: cvl_0_0 00:14:19.185 03:25:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:19.185 03:25:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:19.185 03:25:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:19.185 03:25:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:19.185 03:25:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:19.185 03:25:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:14:19.185 Found net devices under 0000:09:00.1: cvl_0_1 00:14:19.185 03:25:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:19.185 03:25:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:19.185 03:25:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:19.185 03:25:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:14:19.185 03:25:43 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:19.185 03:25:43 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:19.185 03:25:43 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:19.185 03:25:43 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:14:19.185 03:25:43 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:19.185 03:25:43 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:19.185 03:25:43 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:14:19.185 03:25:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:19.185 03:25:43 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:19.185 03:25:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:14:19.185 03:25:43 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:14:19.185 03:25:43 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:14:19.185 03:25:43 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:19.185 03:25:43 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:19.185 03:25:43 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:19.185 03:25:43 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:14:19.185 03:25:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:19.185 03:25:43 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:19.185 03:25:43 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:19.185 03:25:43 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:14:19.185 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:19.185 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:14:19.185 00:14:19.185 --- 10.0.0.2 ping statistics --- 00:14:19.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:19.185 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:14:19.185 03:25:43 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:19.185 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:19.185 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:14:19.185 00:14:19.185 --- 10.0.0.1 ping statistics --- 00:14:19.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:19.185 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:14:19.185 03:25:43 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:19.185 03:25:43 -- nvmf/common.sh@411 -- # return 0 00:14:19.185 03:25:43 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:19.185 03:25:43 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:19.185 03:25:43 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:14:19.185 03:25:43 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:19.185 03:25:43 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:14:19.185 03:25:43 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:14:19.185 03:25:43 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:14:19.185 03:25:43 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:19.185 03:25:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:19.185 03:25:43 -- common/autotest_common.sh@10 -- # set +x 00:14:19.185 03:25:43 -- nvmf/common.sh@470 -- # nvmfpid=1445976 00:14:19.185 03:25:43 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:14:19.185 03:25:43 -- nvmf/common.sh@471 -- # waitforlisten 1445976 00:14:19.185 03:25:43 -- common/autotest_common.sh@817 -- # '[' -z 1445976 ']' 00:14:19.185 03:25:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:19.185 03:25:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:19.185 03:25:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:19.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:19.185 03:25:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:19.185 03:25:43 -- common/autotest_common.sh@10 -- # set +x 00:14:19.185 [2024-04-27 03:25:44.011990] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:14:19.185 [2024-04-27 03:25:44.012070] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:19.185 EAL: No free 2048 kB hugepages reported on node 1 00:14:19.185 [2024-04-27 03:25:44.086854] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:19.443 [2024-04-27 03:25:44.207735] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:19.443 [2024-04-27 03:25:44.207820] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:19.443 [2024-04-27 03:25:44.207837] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:19.443 [2024-04-27 03:25:44.207852] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:19.443 [2024-04-27 03:25:44.207864] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:19.443 [2024-04-27 03:25:44.207948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:19.443 [2024-04-27 03:25:44.208002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:19.443 [2024-04-27 03:25:44.208032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:19.443 [2024-04-27 03:25:44.208035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:20.376 03:25:44 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:20.376 03:25:44 -- common/autotest_common.sh@850 -- # return 0 00:14:20.376 03:25:44 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:20.376 03:25:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:20.376 03:25:44 -- common/autotest_common.sh@10 -- # set +x 00:14:20.376 03:25:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:20.376 03:25:45 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:20.376 03:25:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.376 03:25:45 -- common/autotest_common.sh@10 -- # set +x 00:14:20.376 [2024-04-27 03:25:45.018212] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:20.376 03:25:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.376 03:25:45 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:20.376 03:25:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.376 03:25:45 -- common/autotest_common.sh@10 -- # set +x 00:14:20.376 Malloc0 00:14:20.376 03:25:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.376 03:25:45 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:20.376 03:25:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.376 03:25:45 -- common/autotest_common.sh@10 -- # set +x 00:14:20.376 03:25:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.376 03:25:45 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:20.376 03:25:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.376 03:25:45 -- common/autotest_common.sh@10 -- # set +x 00:14:20.376 03:25:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.376 03:25:45 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:20.376 03:25:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.376 03:25:45 -- common/autotest_common.sh@10 -- # set +x 00:14:20.376 [2024-04-27 03:25:45.069032] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:20.376 03:25:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.376 03:25:45 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:14:20.376 03:25:45 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:14:20.376 03:25:45 -- nvmf/common.sh@521 -- # config=() 00:14:20.376 03:25:45 -- nvmf/common.sh@521 -- # local subsystem config 00:14:20.376 03:25:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:20.376 03:25:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:20.376 { 00:14:20.376 "params": { 00:14:20.376 "name": "Nvme$subsystem", 00:14:20.376 "trtype": "$TEST_TRANSPORT", 00:14:20.376 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:20.376 "adrfam": "ipv4", 00:14:20.376 "trsvcid": "$NVMF_PORT", 00:14:20.376 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:20.376 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:20.376 "hdgst": ${hdgst:-false}, 00:14:20.376 "ddgst": ${ddgst:-false} 00:14:20.376 }, 00:14:20.376 "method": "bdev_nvme_attach_controller" 00:14:20.376 } 00:14:20.376 EOF 00:14:20.376 )") 00:14:20.376 03:25:45 -- nvmf/common.sh@543 -- # cat 00:14:20.376 03:25:45 -- nvmf/common.sh@545 -- # jq . 00:14:20.376 03:25:45 -- nvmf/common.sh@546 -- # IFS=, 00:14:20.376 03:25:45 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:20.376 "params": { 00:14:20.376 "name": "Nvme1", 00:14:20.376 "trtype": "tcp", 00:14:20.376 "traddr": "10.0.0.2", 00:14:20.376 "adrfam": "ipv4", 00:14:20.376 "trsvcid": "4420", 00:14:20.376 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:20.376 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:20.376 "hdgst": false, 00:14:20.376 "ddgst": false 00:14:20.376 }, 00:14:20.376 "method": "bdev_nvme_attach_controller" 00:14:20.376 }' 00:14:20.376 [2024-04-27 03:25:45.110623] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:14:20.376 [2024-04-27 03:25:45.110695] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1446135 ] 00:14:20.376 EAL: No free 2048 kB hugepages reported on node 1 00:14:20.376 [2024-04-27 03:25:45.171348] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:20.376 [2024-04-27 03:25:45.278406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:20.376 [2024-04-27 03:25:45.278455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:20.376 [2024-04-27 03:25:45.278458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:20.635 I/O targets: 00:14:20.635 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:14:20.635 00:14:20.635 00:14:20.635 CUnit - A unit testing framework for C - Version 2.1-3 00:14:20.635 http://cunit.sourceforge.net/ 00:14:20.635 00:14:20.635 00:14:20.635 Suite: bdevio tests on: Nvme1n1 00:14:20.635 Test: blockdev write read block ...passed 00:14:20.635 Test: blockdev write zeroes read block ...passed 00:14:20.635 Test: blockdev write zeroes read no split ...passed 00:14:20.635 Test: blockdev write zeroes read split ...passed 00:14:20.635 Test: blockdev write zeroes read split partial ...passed 00:14:20.635 Test: blockdev reset ...[2024-04-27 03:25:45.608009] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:14:20.635 [2024-04-27 03:25:45.608121] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x179fc40 (9): Bad file descriptor 00:14:20.893 [2024-04-27 03:25:45.700984] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:20.893 passed 00:14:20.893 Test: blockdev write read 8 blocks ...passed 00:14:20.893 Test: blockdev write read size > 128k ...passed 00:14:20.893 Test: blockdev write read invalid size ...passed 00:14:20.893 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:14:20.893 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:14:20.893 Test: blockdev write read max offset ...passed 00:14:20.893 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:14:20.893 Test: blockdev writev readv 8 blocks ...passed 00:14:21.154 Test: blockdev writev readv 30 x 1block ...passed 00:14:21.154 Test: blockdev writev readv block ...passed 00:14:21.154 Test: blockdev writev readv size > 128k ...passed 00:14:21.154 Test: blockdev writev readv size > 128k in two iovs ...passed 00:14:21.154 Test: blockdev comparev and writev ...[2024-04-27 03:25:45.917743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:21.154 [2024-04-27 03:25:45.917785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:14:21.154 [2024-04-27 03:25:45.917811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:21.154 [2024-04-27 03:25:45.917829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:14:21.154 [2024-04-27 03:25:45.918223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:21.154 [2024-04-27 03:25:45.918254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:14:21.154 [2024-04-27 03:25:45.918279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:21.154 [2024-04-27 03:25:45.918295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:14:21.154 [2024-04-27 03:25:45.918640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:21.154 [2024-04-27 03:25:45.918663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:14:21.154 [2024-04-27 03:25:45.918684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:21.154 [2024-04-27 03:25:45.918700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:14:21.154 [2024-04-27 03:25:45.919035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:21.154 [2024-04-27 03:25:45.919058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:14:21.154 [2024-04-27 03:25:45.919080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:21.154 [2024-04-27 03:25:45.919096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:14:21.154 passed 00:14:21.154 Test: blockdev nvme passthru rw ...passed 00:14:21.154 Test: blockdev nvme passthru vendor specific ...[2024-04-27 03:25:46.003544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:14:21.154 [2024-04-27 03:25:46.003572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:14:21.154 [2024-04-27 03:25:46.003747] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:14:21.154 [2024-04-27 03:25:46.003770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:14:21.154 [2024-04-27 03:25:46.003940] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:14:21.154 [2024-04-27 03:25:46.003963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:14:21.154 [2024-04-27 03:25:46.004134] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:14:21.154 [2024-04-27 03:25:46.004157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:14:21.154 passed 00:14:21.154 Test: blockdev nvme admin passthru ...passed 00:14:21.154 Test: blockdev copy ...passed 00:14:21.154 00:14:21.154 Run Summary: Type Total Ran Passed Failed Inactive 00:14:21.154 suites 1 1 n/a 0 0 00:14:21.154 tests 23 23 23 0 0 00:14:21.154 asserts 152 152 152 0 n/a 00:14:21.154 00:14:21.154 Elapsed time = 1.222 seconds 00:14:21.413 03:25:46 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:21.413 03:25:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:21.413 03:25:46 -- common/autotest_common.sh@10 -- # set +x 00:14:21.413 03:25:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:21.413 03:25:46 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:14:21.413 03:25:46 -- target/bdevio.sh@30 -- # nvmftestfini 00:14:21.413 03:25:46 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:21.413 03:25:46 -- nvmf/common.sh@117 -- # sync 00:14:21.413 03:25:46 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:14:21.413 03:25:46 -- nvmf/common.sh@120 -- # set +e 00:14:21.413 03:25:46 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:21.413 03:25:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:14:21.413 rmmod nvme_tcp 00:14:21.413 rmmod nvme_fabrics 00:14:21.413 rmmod nvme_keyring 00:14:21.413 03:25:46 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:21.413 03:25:46 -- nvmf/common.sh@124 -- # set -e 00:14:21.413 03:25:46 -- nvmf/common.sh@125 -- # return 0 00:14:21.413 03:25:46 -- nvmf/common.sh@478 -- # '[' -n 1445976 ']' 00:14:21.413 03:25:46 -- nvmf/common.sh@479 -- # killprocess 1445976 00:14:21.413 03:25:46 -- common/autotest_common.sh@936 -- # '[' -z 1445976 ']' 00:14:21.413 03:25:46 -- common/autotest_common.sh@940 -- # kill -0 1445976 00:14:21.413 03:25:46 -- common/autotest_common.sh@941 -- # uname 00:14:21.413 03:25:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:21.413 03:25:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1445976 00:14:21.671 03:25:46 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:14:21.671 03:25:46 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:14:21.671 03:25:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1445976' 00:14:21.671 killing process with pid 1445976 00:14:21.671 03:25:46 -- common/autotest_common.sh@955 -- # kill 1445976 00:14:21.671 03:25:46 -- common/autotest_common.sh@960 -- # wait 1445976 00:14:21.930 03:25:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:21.930 03:25:46 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:14:21.930 03:25:46 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:14:21.930 03:25:46 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:21.930 03:25:46 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:14:21.930 03:25:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:21.930 03:25:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:21.930 03:25:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:23.866 03:25:48 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:14:23.866 00:14:23.866 real 0m6.966s 00:14:23.866 user 0m12.821s 00:14:23.866 sys 0m2.113s 00:14:23.866 03:25:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:23.866 03:25:48 -- common/autotest_common.sh@10 -- # set +x 00:14:23.866 ************************************ 00:14:23.866 END TEST nvmf_bdevio 00:14:23.866 ************************************ 00:14:23.866 03:25:48 -- nvmf/nvmf.sh@58 -- # '[' tcp = tcp ']' 00:14:23.866 03:25:48 -- nvmf/nvmf.sh@59 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:14:23.866 03:25:48 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:14:23.866 03:25:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:23.866 03:25:48 -- common/autotest_common.sh@10 -- # set +x 00:14:24.125 ************************************ 00:14:24.125 START TEST nvmf_bdevio_no_huge 00:14:24.125 ************************************ 00:14:24.125 03:25:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:14:24.125 * Looking for test storage... 00:14:24.125 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:24.125 03:25:48 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:24.125 03:25:48 -- nvmf/common.sh@7 -- # uname -s 00:14:24.125 03:25:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:24.125 03:25:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:24.125 03:25:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:24.125 03:25:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:24.125 03:25:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:24.125 03:25:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:24.125 03:25:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:24.125 03:25:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:24.125 03:25:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:24.125 03:25:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:24.125 03:25:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:14:24.125 03:25:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:14:24.125 03:25:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:24.125 03:25:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:24.125 03:25:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:24.125 03:25:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:24.125 03:25:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:24.125 03:25:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:24.125 03:25:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:24.125 03:25:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:24.125 03:25:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.125 03:25:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.125 03:25:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.125 03:25:48 -- paths/export.sh@5 -- # export PATH 00:14:24.125 03:25:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.125 03:25:48 -- nvmf/common.sh@47 -- # : 0 00:14:24.125 03:25:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:24.125 03:25:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:24.125 03:25:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:24.125 03:25:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:24.125 03:25:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:24.125 03:25:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:24.125 03:25:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:24.125 03:25:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:24.125 03:25:48 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:24.125 03:25:48 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:24.125 03:25:48 -- target/bdevio.sh@14 -- # nvmftestinit 00:14:24.125 03:25:48 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:14:24.125 03:25:48 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:24.125 03:25:48 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:24.125 03:25:48 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:24.125 03:25:48 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:24.125 03:25:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:24.125 03:25:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:24.125 03:25:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:24.125 03:25:48 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:24.125 03:25:48 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:24.125 03:25:48 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:24.125 03:25:48 -- common/autotest_common.sh@10 -- # set +x 00:14:26.028 03:25:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:26.028 03:25:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:26.028 03:25:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:26.028 03:25:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:26.028 03:25:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:26.028 03:25:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:26.028 03:25:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:26.028 03:25:50 -- nvmf/common.sh@295 -- # net_devs=() 00:14:26.028 03:25:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:26.028 03:25:50 -- nvmf/common.sh@296 -- # e810=() 00:14:26.028 03:25:50 -- nvmf/common.sh@296 -- # local -ga e810 00:14:26.028 03:25:50 -- nvmf/common.sh@297 -- # x722=() 00:14:26.028 03:25:50 -- nvmf/common.sh@297 -- # local -ga x722 00:14:26.028 03:25:50 -- nvmf/common.sh@298 -- # mlx=() 00:14:26.028 03:25:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:26.028 03:25:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:26.028 03:25:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:26.028 03:25:50 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:26.028 03:25:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:26.028 03:25:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:26.028 03:25:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:14:26.028 Found 0000:09:00.0 (0x8086 - 0x159b) 00:14:26.028 03:25:50 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:26.028 03:25:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:14:26.028 Found 0000:09:00.1 (0x8086 - 0x159b) 00:14:26.028 03:25:50 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:26.028 03:25:50 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:26.028 03:25:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:26.028 03:25:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:26.028 03:25:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:26.028 03:25:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:14:26.028 Found net devices under 0000:09:00.0: cvl_0_0 00:14:26.028 03:25:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:26.028 03:25:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:26.028 03:25:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:26.028 03:25:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:26.028 03:25:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:26.028 03:25:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:14:26.028 Found net devices under 0000:09:00.1: cvl_0_1 00:14:26.028 03:25:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:26.028 03:25:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:26.028 03:25:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:26.028 03:25:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:14:26.028 03:25:50 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:26.028 03:25:50 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:26.028 03:25:50 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:26.028 03:25:50 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:14:26.028 03:25:50 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:26.028 03:25:50 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:26.028 03:25:50 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:14:26.028 03:25:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:26.028 03:25:50 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:26.028 03:25:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:14:26.028 03:25:50 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:14:26.028 03:25:50 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:14:26.028 03:25:50 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:26.028 03:25:50 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:26.028 03:25:50 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:26.028 03:25:50 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:14:26.028 03:25:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:26.028 03:25:50 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:26.028 03:25:50 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:26.028 03:25:50 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:14:26.028 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:26.028 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:14:26.028 00:14:26.028 --- 10.0.0.2 ping statistics --- 00:14:26.028 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:26.028 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:14:26.028 03:25:50 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:26.028 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:26.028 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.137 ms 00:14:26.028 00:14:26.028 --- 10.0.0.1 ping statistics --- 00:14:26.028 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:26.028 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:14:26.028 03:25:50 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:26.028 03:25:50 -- nvmf/common.sh@411 -- # return 0 00:14:26.028 03:25:50 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:26.028 03:25:50 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:26.028 03:25:50 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:14:26.028 03:25:50 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:26.028 03:25:50 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:14:26.029 03:25:50 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:14:26.029 03:25:50 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:14:26.029 03:25:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:26.029 03:25:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:26.029 03:25:50 -- common/autotest_common.sh@10 -- # set +x 00:14:26.029 03:25:50 -- nvmf/common.sh@470 -- # nvmfpid=1448213 00:14:26.029 03:25:50 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:14:26.029 03:25:50 -- nvmf/common.sh@471 -- # waitforlisten 1448213 00:14:26.029 03:25:50 -- common/autotest_common.sh@817 -- # '[' -z 1448213 ']' 00:14:26.029 03:25:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:26.029 03:25:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:26.029 03:25:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:26.029 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:26.029 03:25:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:26.029 03:25:50 -- common/autotest_common.sh@10 -- # set +x 00:14:26.287 [2024-04-27 03:25:51.012729] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:14:26.287 [2024-04-27 03:25:51.012832] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:14:26.287 [2024-04-27 03:25:51.098676] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:26.287 [2024-04-27 03:25:51.206907] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:26.287 [2024-04-27 03:25:51.206961] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:26.287 [2024-04-27 03:25:51.206986] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:26.287 [2024-04-27 03:25:51.207005] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:26.287 [2024-04-27 03:25:51.207037] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:26.287 [2024-04-27 03:25:51.207190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:26.287 [2024-04-27 03:25:51.207260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:26.287 [2024-04-27 03:25:51.207324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:26.287 [2024-04-27 03:25:51.207333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:27.220 03:25:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:27.220 03:25:51 -- common/autotest_common.sh@850 -- # return 0 00:14:27.220 03:25:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:27.220 03:25:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:27.220 03:25:51 -- common/autotest_common.sh@10 -- # set +x 00:14:27.220 03:25:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:27.220 03:25:51 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:27.220 03:25:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:27.220 03:25:51 -- common/autotest_common.sh@10 -- # set +x 00:14:27.220 [2024-04-27 03:25:52.002745] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:27.220 03:25:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:27.220 03:25:52 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:27.220 03:25:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:27.220 03:25:52 -- common/autotest_common.sh@10 -- # set +x 00:14:27.220 Malloc0 00:14:27.220 03:25:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:27.220 03:25:52 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:27.220 03:25:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:27.220 03:25:52 -- common/autotest_common.sh@10 -- # set +x 00:14:27.220 03:25:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:27.220 03:25:52 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:27.220 03:25:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:27.220 03:25:52 -- common/autotest_common.sh@10 -- # set +x 00:14:27.220 03:25:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:27.220 03:25:52 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:27.220 03:25:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:27.220 03:25:52 -- common/autotest_common.sh@10 -- # set +x 00:14:27.220 [2024-04-27 03:25:52.040931] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:27.220 03:25:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:27.220 03:25:52 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:14:27.220 03:25:52 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:14:27.220 03:25:52 -- nvmf/common.sh@521 -- # config=() 00:14:27.220 03:25:52 -- nvmf/common.sh@521 -- # local subsystem config 00:14:27.220 03:25:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:27.220 03:25:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:27.220 { 00:14:27.220 "params": { 00:14:27.220 "name": "Nvme$subsystem", 00:14:27.220 "trtype": "$TEST_TRANSPORT", 00:14:27.220 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:27.220 "adrfam": "ipv4", 00:14:27.220 "trsvcid": "$NVMF_PORT", 00:14:27.220 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:27.220 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:27.220 "hdgst": ${hdgst:-false}, 00:14:27.220 "ddgst": ${ddgst:-false} 00:14:27.220 }, 00:14:27.220 "method": "bdev_nvme_attach_controller" 00:14:27.220 } 00:14:27.220 EOF 00:14:27.220 )") 00:14:27.220 03:25:52 -- nvmf/common.sh@543 -- # cat 00:14:27.220 03:25:52 -- nvmf/common.sh@545 -- # jq . 00:14:27.220 03:25:52 -- nvmf/common.sh@546 -- # IFS=, 00:14:27.220 03:25:52 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:27.220 "params": { 00:14:27.220 "name": "Nvme1", 00:14:27.220 "trtype": "tcp", 00:14:27.220 "traddr": "10.0.0.2", 00:14:27.220 "adrfam": "ipv4", 00:14:27.220 "trsvcid": "4420", 00:14:27.220 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:27.220 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:27.220 "hdgst": false, 00:14:27.220 "ddgst": false 00:14:27.220 }, 00:14:27.220 "method": "bdev_nvme_attach_controller" 00:14:27.220 }' 00:14:27.220 [2024-04-27 03:25:52.087813] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:14:27.220 [2024-04-27 03:25:52.087881] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1448370 ] 00:14:27.220 [2024-04-27 03:25:52.150720] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:27.478 [2024-04-27 03:25:52.264664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:27.478 [2024-04-27 03:25:52.264714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:27.478 [2024-04-27 03:25:52.264717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:27.478 I/O targets: 00:14:27.478 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:14:27.478 00:14:27.478 00:14:27.478 CUnit - A unit testing framework for C - Version 2.1-3 00:14:27.478 http://cunit.sourceforge.net/ 00:14:27.478 00:14:27.478 00:14:27.478 Suite: bdevio tests on: Nvme1n1 00:14:27.736 Test: blockdev write read block ...passed 00:14:27.736 Test: blockdev write zeroes read block ...passed 00:14:27.736 Test: blockdev write zeroes read no split ...passed 00:14:27.736 Test: blockdev write zeroes read split ...passed 00:14:27.736 Test: blockdev write zeroes read split partial ...passed 00:14:27.736 Test: blockdev reset ...[2024-04-27 03:25:52.629704] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:14:27.736 [2024-04-27 03:25:52.629809] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17dc620 (9): Bad file descriptor 00:14:27.736 [2024-04-27 03:25:52.685202] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:27.736 passed 00:14:27.736 Test: blockdev write read 8 blocks ...passed 00:14:27.736 Test: blockdev write read size > 128k ...passed 00:14:27.736 Test: blockdev write read invalid size ...passed 00:14:27.994 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:14:27.994 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:14:27.994 Test: blockdev write read max offset ...passed 00:14:27.994 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:14:27.994 Test: blockdev writev readv 8 blocks ...passed 00:14:27.994 Test: blockdev writev readv 30 x 1block ...passed 00:14:27.994 Test: blockdev writev readv block ...passed 00:14:27.994 Test: blockdev writev readv size > 128k ...passed 00:14:27.994 Test: blockdev writev readv size > 128k in two iovs ...passed 00:14:27.994 Test: blockdev comparev and writev ...[2024-04-27 03:25:52.938749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:27.994 [2024-04-27 03:25:52.938783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:14:27.994 [2024-04-27 03:25:52.938808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:27.994 [2024-04-27 03:25:52.938825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:14:27.994 [2024-04-27 03:25:52.939185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:27.994 [2024-04-27 03:25:52.939209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:14:27.994 [2024-04-27 03:25:52.939230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:27.994 [2024-04-27 03:25:52.939255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:14:27.994 [2024-04-27 03:25:52.939621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:27.994 [2024-04-27 03:25:52.939644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:14:27.994 [2024-04-27 03:25:52.939666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:27.994 [2024-04-27 03:25:52.939681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:14:27.994 [2024-04-27 03:25:52.940024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:27.994 [2024-04-27 03:25:52.940047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:14:27.994 [2024-04-27 03:25:52.940068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:27.994 [2024-04-27 03:25:52.940084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:14:28.252 passed 00:14:28.252 Test: blockdev nvme passthru rw ...passed 00:14:28.252 Test: blockdev nvme passthru vendor specific ...[2024-04-27 03:25:53.022532] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:14:28.252 [2024-04-27 03:25:53.022569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:14:28.252 [2024-04-27 03:25:53.022730] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:14:28.252 [2024-04-27 03:25:53.022754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:14:28.252 [2024-04-27 03:25:53.022909] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:14:28.252 [2024-04-27 03:25:53.022932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:14:28.252 [2024-04-27 03:25:53.023089] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:14:28.252 [2024-04-27 03:25:53.023112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:14:28.252 passed 00:14:28.252 Test: blockdev nvme admin passthru ...passed 00:14:28.252 Test: blockdev copy ...passed 00:14:28.252 00:14:28.252 Run Summary: Type Total Ran Passed Failed Inactive 00:14:28.252 suites 1 1 n/a 0 0 00:14:28.252 tests 23 23 23 0 0 00:14:28.252 asserts 152 152 152 0 n/a 00:14:28.252 00:14:28.252 Elapsed time = 1.312 seconds 00:14:28.510 03:25:53 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:28.510 03:25:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:28.510 03:25:53 -- common/autotest_common.sh@10 -- # set +x 00:14:28.510 03:25:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:28.510 03:25:53 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:14:28.510 03:25:53 -- target/bdevio.sh@30 -- # nvmftestfini 00:14:28.510 03:25:53 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:28.510 03:25:53 -- nvmf/common.sh@117 -- # sync 00:14:28.510 03:25:53 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:14:28.510 03:25:53 -- nvmf/common.sh@120 -- # set +e 00:14:28.510 03:25:53 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:28.510 03:25:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:14:28.510 rmmod nvme_tcp 00:14:28.510 rmmod nvme_fabrics 00:14:28.510 rmmod nvme_keyring 00:14:28.768 03:25:53 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:28.768 03:25:53 -- nvmf/common.sh@124 -- # set -e 00:14:28.768 03:25:53 -- nvmf/common.sh@125 -- # return 0 00:14:28.768 03:25:53 -- nvmf/common.sh@478 -- # '[' -n 1448213 ']' 00:14:28.768 03:25:53 -- nvmf/common.sh@479 -- # killprocess 1448213 00:14:28.768 03:25:53 -- common/autotest_common.sh@936 -- # '[' -z 1448213 ']' 00:14:28.768 03:25:53 -- common/autotest_common.sh@940 -- # kill -0 1448213 00:14:28.768 03:25:53 -- common/autotest_common.sh@941 -- # uname 00:14:28.768 03:25:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:28.768 03:25:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1448213 00:14:28.768 03:25:53 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:14:28.768 03:25:53 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:14:28.768 03:25:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1448213' 00:14:28.768 killing process with pid 1448213 00:14:28.768 03:25:53 -- common/autotest_common.sh@955 -- # kill 1448213 00:14:28.768 03:25:53 -- common/autotest_common.sh@960 -- # wait 1448213 00:14:29.027 03:25:53 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:29.027 03:25:53 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:14:29.027 03:25:53 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:14:29.027 03:25:53 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:29.027 03:25:53 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:14:29.027 03:25:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:29.027 03:25:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:29.027 03:25:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:31.562 03:25:55 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:14:31.562 00:14:31.562 real 0m7.132s 00:14:31.562 user 0m13.645s 00:14:31.562 sys 0m2.472s 00:14:31.562 03:25:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:31.562 03:25:55 -- common/autotest_common.sh@10 -- # set +x 00:14:31.562 ************************************ 00:14:31.562 END TEST nvmf_bdevio_no_huge 00:14:31.562 ************************************ 00:14:31.562 03:25:56 -- nvmf/nvmf.sh@60 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:14:31.562 03:25:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:31.562 03:25:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:31.562 03:25:56 -- common/autotest_common.sh@10 -- # set +x 00:14:31.562 ************************************ 00:14:31.562 START TEST nvmf_tls 00:14:31.562 ************************************ 00:14:31.562 03:25:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:14:31.562 * Looking for test storage... 00:14:31.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:31.562 03:25:56 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:31.562 03:25:56 -- nvmf/common.sh@7 -- # uname -s 00:14:31.562 03:25:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:31.562 03:25:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:31.562 03:25:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:31.562 03:25:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:31.562 03:25:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:31.562 03:25:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:31.562 03:25:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:31.562 03:25:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:31.562 03:25:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:31.562 03:25:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:31.562 03:25:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:14:31.562 03:25:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:14:31.562 03:25:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:31.562 03:25:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:31.562 03:25:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:31.562 03:25:56 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:31.562 03:25:56 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:31.562 03:25:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:31.562 03:25:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:31.562 03:25:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:31.562 03:25:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.562 03:25:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.563 03:25:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.563 03:25:56 -- paths/export.sh@5 -- # export PATH 00:14:31.563 03:25:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.563 03:25:56 -- nvmf/common.sh@47 -- # : 0 00:14:31.563 03:25:56 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:31.563 03:25:56 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:31.563 03:25:56 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:31.563 03:25:56 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:31.563 03:25:56 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:31.563 03:25:56 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:31.563 03:25:56 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:31.563 03:25:56 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:31.563 03:25:56 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:31.563 03:25:56 -- target/tls.sh@62 -- # nvmftestinit 00:14:31.563 03:25:56 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:14:31.563 03:25:56 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:31.563 03:25:56 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:31.563 03:25:56 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:31.563 03:25:56 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:31.563 03:25:56 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:31.563 03:25:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:31.563 03:25:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:31.563 03:25:56 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:31.563 03:25:56 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:31.563 03:25:56 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:31.563 03:25:56 -- common/autotest_common.sh@10 -- # set +x 00:14:33.464 03:25:58 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:33.464 03:25:58 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:33.464 03:25:58 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:33.464 03:25:58 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:33.464 03:25:58 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:33.464 03:25:58 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:33.464 03:25:58 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:33.464 03:25:58 -- nvmf/common.sh@295 -- # net_devs=() 00:14:33.464 03:25:58 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:33.464 03:25:58 -- nvmf/common.sh@296 -- # e810=() 00:14:33.464 03:25:58 -- nvmf/common.sh@296 -- # local -ga e810 00:14:33.464 03:25:58 -- nvmf/common.sh@297 -- # x722=() 00:14:33.464 03:25:58 -- nvmf/common.sh@297 -- # local -ga x722 00:14:33.464 03:25:58 -- nvmf/common.sh@298 -- # mlx=() 00:14:33.464 03:25:58 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:33.464 03:25:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:33.464 03:25:58 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:33.464 03:25:58 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:14:33.464 03:25:58 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:33.464 03:25:58 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:33.464 03:25:58 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:33.464 03:25:58 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:33.464 03:25:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:33.464 03:25:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:14:33.464 Found 0000:09:00.0 (0x8086 - 0x159b) 00:14:33.464 03:25:58 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:33.464 03:25:58 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:33.464 03:25:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:33.464 03:25:58 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:33.464 03:25:58 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:33.464 03:25:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:33.464 03:25:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:14:33.464 Found 0000:09:00.1 (0x8086 - 0x159b) 00:14:33.465 03:25:58 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:33.465 03:25:58 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:33.465 03:25:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:33.465 03:25:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:33.465 03:25:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:33.465 03:25:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:14:33.465 Found net devices under 0000:09:00.0: cvl_0_0 00:14:33.465 03:25:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:33.465 03:25:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:33.465 03:25:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:33.465 03:25:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:33.465 03:25:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:33.465 03:25:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:14:33.465 Found net devices under 0000:09:00.1: cvl_0_1 00:14:33.465 03:25:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:33.465 03:25:58 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:33.465 03:25:58 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:33.465 03:25:58 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:14:33.465 03:25:58 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:33.465 03:25:58 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:33.465 03:25:58 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:33.465 03:25:58 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:14:33.465 03:25:58 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:33.465 03:25:58 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:33.465 03:25:58 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:14:33.465 03:25:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:33.465 03:25:58 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:33.465 03:25:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:14:33.465 03:25:58 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:14:33.465 03:25:58 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:14:33.465 03:25:58 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:33.465 03:25:58 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:33.465 03:25:58 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:33.465 03:25:58 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:14:33.465 03:25:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:33.465 03:25:58 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:33.465 03:25:58 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:33.465 03:25:58 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:14:33.465 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:33.465 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.149 ms 00:14:33.465 00:14:33.465 --- 10.0.0.2 ping statistics --- 00:14:33.465 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:33.465 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:14:33.465 03:25:58 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:33.465 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:33.465 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:14:33.465 00:14:33.465 --- 10.0.0.1 ping statistics --- 00:14:33.465 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:33.465 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:14:33.465 03:25:58 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:33.465 03:25:58 -- nvmf/common.sh@411 -- # return 0 00:14:33.465 03:25:58 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:33.465 03:25:58 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:33.465 03:25:58 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:14:33.465 03:25:58 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:33.465 03:25:58 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:14:33.465 03:25:58 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:14:33.465 03:25:58 -- target/tls.sh@63 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:14:33.465 03:25:58 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:33.465 03:25:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:33.465 03:25:58 -- common/autotest_common.sh@10 -- # set +x 00:14:33.465 03:25:58 -- nvmf/common.sh@470 -- # nvmfpid=1450455 00:14:33.465 03:25:58 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:14:33.465 03:25:58 -- nvmf/common.sh@471 -- # waitforlisten 1450455 00:14:33.465 03:25:58 -- common/autotest_common.sh@817 -- # '[' -z 1450455 ']' 00:14:33.465 03:25:58 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:33.465 03:25:58 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:33.465 03:25:58 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:33.465 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:33.465 03:25:58 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:33.465 03:25:58 -- common/autotest_common.sh@10 -- # set +x 00:14:33.465 [2024-04-27 03:25:58.380623] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:14:33.465 [2024-04-27 03:25:58.380703] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:33.465 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.723 [2024-04-27 03:25:58.457196] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:33.723 [2024-04-27 03:25:58.572670] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:33.723 [2024-04-27 03:25:58.572737] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:33.723 [2024-04-27 03:25:58.572765] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:33.723 [2024-04-27 03:25:58.572776] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:33.723 [2024-04-27 03:25:58.572786] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:33.723 [2024-04-27 03:25:58.572830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:33.723 03:25:58 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:33.723 03:25:58 -- common/autotest_common.sh@850 -- # return 0 00:14:33.723 03:25:58 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:33.723 03:25:58 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:33.723 03:25:58 -- common/autotest_common.sh@10 -- # set +x 00:14:33.723 03:25:58 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:33.723 03:25:58 -- target/tls.sh@65 -- # '[' tcp '!=' tcp ']' 00:14:33.723 03:25:58 -- target/tls.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:14:33.981 true 00:14:33.981 03:25:58 -- target/tls.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:14:33.981 03:25:58 -- target/tls.sh@73 -- # jq -r .tls_version 00:14:34.239 03:25:59 -- target/tls.sh@73 -- # version=0 00:14:34.239 03:25:59 -- target/tls.sh@74 -- # [[ 0 != \0 ]] 00:14:34.239 03:25:59 -- target/tls.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:14:34.498 03:25:59 -- target/tls.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:14:34.498 03:25:59 -- target/tls.sh@81 -- # jq -r .tls_version 00:14:34.756 03:25:59 -- target/tls.sh@81 -- # version=13 00:14:34.756 03:25:59 -- target/tls.sh@82 -- # [[ 13 != \1\3 ]] 00:14:34.756 03:25:59 -- target/tls.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:14:35.014 03:25:59 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:14:35.014 03:25:59 -- target/tls.sh@89 -- # jq -r .tls_version 00:14:35.272 03:26:00 -- target/tls.sh@89 -- # version=7 00:14:35.272 03:26:00 -- target/tls.sh@90 -- # [[ 7 != \7 ]] 00:14:35.272 03:26:00 -- target/tls.sh@96 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:14:35.272 03:26:00 -- target/tls.sh@96 -- # jq -r .enable_ktls 00:14:35.531 03:26:00 -- target/tls.sh@96 -- # ktls=false 00:14:35.531 03:26:00 -- target/tls.sh@97 -- # [[ false != \f\a\l\s\e ]] 00:14:35.531 03:26:00 -- target/tls.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:14:35.790 03:26:00 -- target/tls.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:14:35.790 03:26:00 -- target/tls.sh@104 -- # jq -r .enable_ktls 00:14:36.355 03:26:01 -- target/tls.sh@104 -- # ktls=true 00:14:36.355 03:26:01 -- target/tls.sh@105 -- # [[ true != \t\r\u\e ]] 00:14:36.355 03:26:01 -- target/tls.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:14:36.355 03:26:01 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:14:36.355 03:26:01 -- target/tls.sh@112 -- # jq -r .enable_ktls 00:14:36.613 03:26:01 -- target/tls.sh@112 -- # ktls=false 00:14:36.613 03:26:01 -- target/tls.sh@113 -- # [[ false != \f\a\l\s\e ]] 00:14:36.613 03:26:01 -- target/tls.sh@118 -- # format_interchange_psk 00112233445566778899aabbccddeeff 1 00:14:36.613 03:26:01 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff 1 00:14:36.613 03:26:01 -- nvmf/common.sh@691 -- # local prefix key digest 00:14:36.613 03:26:01 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:14:36.613 03:26:01 -- nvmf/common.sh@693 -- # key=00112233445566778899aabbccddeeff 00:14:36.613 03:26:01 -- nvmf/common.sh@693 -- # digest=1 00:14:36.613 03:26:01 -- nvmf/common.sh@694 -- # python - 00:14:36.613 03:26:01 -- target/tls.sh@118 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:14:36.613 03:26:01 -- target/tls.sh@119 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 1 00:14:36.613 03:26:01 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 ffeeddccbbaa99887766554433221100 1 00:14:36.613 03:26:01 -- nvmf/common.sh@691 -- # local prefix key digest 00:14:36.613 03:26:01 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:14:36.613 03:26:01 -- nvmf/common.sh@693 -- # key=ffeeddccbbaa99887766554433221100 00:14:36.613 03:26:01 -- nvmf/common.sh@693 -- # digest=1 00:14:36.613 03:26:01 -- nvmf/common.sh@694 -- # python - 00:14:36.871 03:26:01 -- target/tls.sh@119 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:14:36.871 03:26:01 -- target/tls.sh@121 -- # mktemp 00:14:36.871 03:26:01 -- target/tls.sh@121 -- # key_path=/tmp/tmp.brEa19Xrfq 00:14:36.871 03:26:01 -- target/tls.sh@122 -- # mktemp 00:14:36.871 03:26:01 -- target/tls.sh@122 -- # key_2_path=/tmp/tmp.10tZZVMq7R 00:14:36.871 03:26:01 -- target/tls.sh@124 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:14:36.871 03:26:01 -- target/tls.sh@125 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:14:36.871 03:26:01 -- target/tls.sh@127 -- # chmod 0600 /tmp/tmp.brEa19Xrfq 00:14:36.871 03:26:01 -- target/tls.sh@128 -- # chmod 0600 /tmp/tmp.10tZZVMq7R 00:14:36.871 03:26:01 -- target/tls.sh@130 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:14:37.128 03:26:01 -- target/tls.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:14:37.386 03:26:02 -- target/tls.sh@133 -- # setup_nvmf_tgt /tmp/tmp.brEa19Xrfq 00:14:37.386 03:26:02 -- target/tls.sh@49 -- # local key=/tmp/tmp.brEa19Xrfq 00:14:37.386 03:26:02 -- target/tls.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:14:37.643 [2024-04-27 03:26:02.453319] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:37.643 03:26:02 -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:14:37.901 03:26:02 -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:14:38.166 [2024-04-27 03:26:03.026843] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:14:38.166 [2024-04-27 03:26:03.027082] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:38.166 03:26:03 -- target/tls.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:14:38.433 malloc0 00:14:38.433 03:26:03 -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:14:38.691 03:26:03 -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.brEa19Xrfq 00:14:38.949 [2024-04-27 03:26:03.859582] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:14:38.949 03:26:03 -- target/tls.sh@137 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /tmp/tmp.brEa19Xrfq 00:14:38.949 EAL: No free 2048 kB hugepages reported on node 1 00:14:51.183 Initializing NVMe Controllers 00:14:51.183 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:51.183 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:51.183 Initialization complete. Launching workers. 00:14:51.183 ======================================================== 00:14:51.183 Latency(us) 00:14:51.183 Device Information : IOPS MiB/s Average min max 00:14:51.183 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7721.88 30.16 8290.48 1242.88 9459.95 00:14:51.183 ======================================================== 00:14:51.183 Total : 7721.88 30.16 8290.48 1242.88 9459.95 00:14:51.183 00:14:51.183 03:26:13 -- target/tls.sh@143 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.brEa19Xrfq 00:14:51.183 03:26:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:14:51.183 03:26:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:14:51.183 03:26:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:14:51.183 03:26:13 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.brEa19Xrfq' 00:14:51.183 03:26:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:51.184 03:26:13 -- target/tls.sh@28 -- # bdevperf_pid=1452354 00:14:51.184 03:26:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:14:51.184 03:26:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:14:51.184 03:26:13 -- target/tls.sh@31 -- # waitforlisten 1452354 /var/tmp/bdevperf.sock 00:14:51.184 03:26:13 -- common/autotest_common.sh@817 -- # '[' -z 1452354 ']' 00:14:51.184 03:26:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:51.184 03:26:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:51.184 03:26:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:51.184 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:51.184 03:26:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:51.184 03:26:13 -- common/autotest_common.sh@10 -- # set +x 00:14:51.184 [2024-04-27 03:26:14.027847] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:14:51.184 [2024-04-27 03:26:14.027922] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1452354 ] 00:14:51.184 EAL: No free 2048 kB hugepages reported on node 1 00:14:51.184 [2024-04-27 03:26:14.085590] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:51.184 [2024-04-27 03:26:14.190482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:51.184 03:26:14 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:51.184 03:26:14 -- common/autotest_common.sh@850 -- # return 0 00:14:51.184 03:26:14 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.brEa19Xrfq 00:14:51.184 [2024-04-27 03:26:14.562072] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:14:51.184 [2024-04-27 03:26:14.562199] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:14:51.184 TLSTESTn1 00:14:51.184 03:26:14 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:14:51.184 Running I/O for 10 seconds... 00:15:01.147 00:15:01.147 Latency(us) 00:15:01.147 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.147 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:15:01.147 Verification LBA range: start 0x0 length 0x2000 00:15:01.147 TLSTESTn1 : 10.02 3198.72 12.50 0.00 0.00 39947.28 5801.15 53593.88 00:15:01.147 =================================================================================================================== 00:15:01.147 Total : 3198.72 12.50 0.00 0.00 39947.28 5801.15 53593.88 00:15:01.147 0 00:15:01.147 03:26:24 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:01.147 03:26:24 -- target/tls.sh@45 -- # killprocess 1452354 00:15:01.147 03:26:24 -- common/autotest_common.sh@936 -- # '[' -z 1452354 ']' 00:15:01.147 03:26:24 -- common/autotest_common.sh@940 -- # kill -0 1452354 00:15:01.147 03:26:24 -- common/autotest_common.sh@941 -- # uname 00:15:01.147 03:26:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:01.147 03:26:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1452354 00:15:01.147 03:26:24 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:15:01.147 03:26:24 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:15:01.147 03:26:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1452354' 00:15:01.147 killing process with pid 1452354 00:15:01.147 03:26:24 -- common/autotest_common.sh@955 -- # kill 1452354 00:15:01.147 Received shutdown signal, test time was about 10.000000 seconds 00:15:01.147 00:15:01.147 Latency(us) 00:15:01.147 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.147 =================================================================================================================== 00:15:01.147 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:01.147 [2024-04-27 03:26:24.840785] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:15:01.147 03:26:24 -- common/autotest_common.sh@960 -- # wait 1452354 00:15:01.147 03:26:25 -- target/tls.sh@146 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.10tZZVMq7R 00:15:01.147 03:26:25 -- common/autotest_common.sh@638 -- # local es=0 00:15:01.147 03:26:25 -- common/autotest_common.sh@640 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.10tZZVMq7R 00:15:01.147 03:26:25 -- common/autotest_common.sh@626 -- # local arg=run_bdevperf 00:15:01.147 03:26:25 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:01.147 03:26:25 -- common/autotest_common.sh@630 -- # type -t run_bdevperf 00:15:01.147 03:26:25 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:01.147 03:26:25 -- common/autotest_common.sh@641 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.10tZZVMq7R 00:15:01.147 03:26:25 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:15:01.147 03:26:25 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:15:01.147 03:26:25 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:15:01.147 03:26:25 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.10tZZVMq7R' 00:15:01.147 03:26:25 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:01.147 03:26:25 -- target/tls.sh@28 -- # bdevperf_pid=1453672 00:15:01.147 03:26:25 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:15:01.147 03:26:25 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:15:01.147 03:26:25 -- target/tls.sh@31 -- # waitforlisten 1453672 /var/tmp/bdevperf.sock 00:15:01.147 03:26:25 -- common/autotest_common.sh@817 -- # '[' -z 1453672 ']' 00:15:01.147 03:26:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:01.147 03:26:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:01.147 03:26:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:01.147 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:01.147 03:26:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:01.147 03:26:25 -- common/autotest_common.sh@10 -- # set +x 00:15:01.147 [2024-04-27 03:26:25.129738] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:01.147 [2024-04-27 03:26:25.129812] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1453672 ] 00:15:01.147 EAL: No free 2048 kB hugepages reported on node 1 00:15:01.147 [2024-04-27 03:26:25.188099] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:01.147 [2024-04-27 03:26:25.290240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:01.147 03:26:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:01.147 03:26:25 -- common/autotest_common.sh@850 -- # return 0 00:15:01.147 03:26:25 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.10tZZVMq7R 00:15:01.147 [2024-04-27 03:26:25.663193] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:01.147 [2024-04-27 03:26:25.663351] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:15:01.147 [2024-04-27 03:26:25.668791] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:15:01.147 [2024-04-27 03:26:25.669230] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1073290 (107): Transport endpoint is not connected 00:15:01.147 [2024-04-27 03:26:25.670219] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1073290 (9): Bad file descriptor 00:15:01.147 [2024-04-27 03:26:25.671218] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:15:01.147 [2024-04-27 03:26:25.671258] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:15:01.147 [2024-04-27 03:26:25.671272] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:15:01.147 request: 00:15:01.147 { 00:15:01.147 "name": "TLSTEST", 00:15:01.147 "trtype": "tcp", 00:15:01.147 "traddr": "10.0.0.2", 00:15:01.147 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:01.147 "adrfam": "ipv4", 00:15:01.147 "trsvcid": "4420", 00:15:01.147 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:01.147 "psk": "/tmp/tmp.10tZZVMq7R", 00:15:01.147 "method": "bdev_nvme_attach_controller", 00:15:01.147 "req_id": 1 00:15:01.147 } 00:15:01.147 Got JSON-RPC error response 00:15:01.147 response: 00:15:01.147 { 00:15:01.147 "code": -32602, 00:15:01.147 "message": "Invalid parameters" 00:15:01.147 } 00:15:01.147 03:26:25 -- target/tls.sh@36 -- # killprocess 1453672 00:15:01.147 03:26:25 -- common/autotest_common.sh@936 -- # '[' -z 1453672 ']' 00:15:01.147 03:26:25 -- common/autotest_common.sh@940 -- # kill -0 1453672 00:15:01.147 03:26:25 -- common/autotest_common.sh@941 -- # uname 00:15:01.147 03:26:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:01.147 03:26:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1453672 00:15:01.147 03:26:25 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:15:01.147 03:26:25 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:15:01.147 03:26:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1453672' 00:15:01.147 killing process with pid 1453672 00:15:01.147 03:26:25 -- common/autotest_common.sh@955 -- # kill 1453672 00:15:01.147 Received shutdown signal, test time was about 10.000000 seconds 00:15:01.147 00:15:01.147 Latency(us) 00:15:01.147 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.147 =================================================================================================================== 00:15:01.147 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:15:01.147 [2024-04-27 03:26:25.725426] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:15:01.147 03:26:25 -- common/autotest_common.sh@960 -- # wait 1453672 00:15:01.147 03:26:25 -- target/tls.sh@37 -- # return 1 00:15:01.147 03:26:25 -- common/autotest_common.sh@641 -- # es=1 00:15:01.147 03:26:25 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:15:01.147 03:26:25 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:15:01.147 03:26:25 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:15:01.147 03:26:25 -- target/tls.sh@149 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.brEa19Xrfq 00:15:01.147 03:26:25 -- common/autotest_common.sh@638 -- # local es=0 00:15:01.148 03:26:25 -- common/autotest_common.sh@640 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.brEa19Xrfq 00:15:01.148 03:26:25 -- common/autotest_common.sh@626 -- # local arg=run_bdevperf 00:15:01.148 03:26:25 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:01.148 03:26:25 -- common/autotest_common.sh@630 -- # type -t run_bdevperf 00:15:01.148 03:26:25 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:01.148 03:26:25 -- common/autotest_common.sh@641 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.brEa19Xrfq 00:15:01.148 03:26:25 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:15:01.148 03:26:25 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:15:01.148 03:26:25 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:15:01.148 03:26:25 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.brEa19Xrfq' 00:15:01.148 03:26:25 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:01.148 03:26:25 -- target/tls.sh@28 -- # bdevperf_pid=1453807 00:15:01.148 03:26:25 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:15:01.148 03:26:25 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:15:01.148 03:26:25 -- target/tls.sh@31 -- # waitforlisten 1453807 /var/tmp/bdevperf.sock 00:15:01.148 03:26:25 -- common/autotest_common.sh@817 -- # '[' -z 1453807 ']' 00:15:01.148 03:26:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:01.148 03:26:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:01.148 03:26:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:01.148 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:01.148 03:26:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:01.148 03:26:25 -- common/autotest_common.sh@10 -- # set +x 00:15:01.148 [2024-04-27 03:26:26.013891] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:01.148 [2024-04-27 03:26:26.013966] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1453807 ] 00:15:01.148 EAL: No free 2048 kB hugepages reported on node 1 00:15:01.148 [2024-04-27 03:26:26.077581] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:01.406 [2024-04-27 03:26:26.185321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:01.406 03:26:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:01.406 03:26:26 -- common/autotest_common.sh@850 -- # return 0 00:15:01.406 03:26:26 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /tmp/tmp.brEa19Xrfq 00:15:01.664 [2024-04-27 03:26:26.512810] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:01.664 [2024-04-27 03:26:26.512937] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:15:01.664 [2024-04-27 03:26:26.519153] tcp.c: 878:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:15:01.664 [2024-04-27 03:26:26.519185] posix.c: 588:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:15:01.664 [2024-04-27 03:26:26.519273] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:15:01.664 [2024-04-27 03:26:26.519684] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x623290 (107): Transport endpoint is not connected 00:15:01.664 [2024-04-27 03:26:26.520675] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x623290 (9): Bad file descriptor 00:15:01.664 [2024-04-27 03:26:26.521674] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:15:01.664 [2024-04-27 03:26:26.521694] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:15:01.664 [2024-04-27 03:26:26.521721] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:15:01.664 request: 00:15:01.664 { 00:15:01.664 "name": "TLSTEST", 00:15:01.664 "trtype": "tcp", 00:15:01.664 "traddr": "10.0.0.2", 00:15:01.664 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:15:01.664 "adrfam": "ipv4", 00:15:01.664 "trsvcid": "4420", 00:15:01.664 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:01.664 "psk": "/tmp/tmp.brEa19Xrfq", 00:15:01.664 "method": "bdev_nvme_attach_controller", 00:15:01.664 "req_id": 1 00:15:01.664 } 00:15:01.664 Got JSON-RPC error response 00:15:01.664 response: 00:15:01.664 { 00:15:01.664 "code": -32602, 00:15:01.664 "message": "Invalid parameters" 00:15:01.664 } 00:15:01.664 03:26:26 -- target/tls.sh@36 -- # killprocess 1453807 00:15:01.664 03:26:26 -- common/autotest_common.sh@936 -- # '[' -z 1453807 ']' 00:15:01.664 03:26:26 -- common/autotest_common.sh@940 -- # kill -0 1453807 00:15:01.664 03:26:26 -- common/autotest_common.sh@941 -- # uname 00:15:01.664 03:26:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:01.664 03:26:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1453807 00:15:01.664 03:26:26 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:15:01.664 03:26:26 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:15:01.664 03:26:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1453807' 00:15:01.664 killing process with pid 1453807 00:15:01.664 03:26:26 -- common/autotest_common.sh@955 -- # kill 1453807 00:15:01.664 Received shutdown signal, test time was about 10.000000 seconds 00:15:01.664 00:15:01.664 Latency(us) 00:15:01.664 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.664 =================================================================================================================== 00:15:01.664 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:15:01.664 [2024-04-27 03:26:26.575381] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:15:01.664 03:26:26 -- common/autotest_common.sh@960 -- # wait 1453807 00:15:01.923 03:26:26 -- target/tls.sh@37 -- # return 1 00:15:01.923 03:26:26 -- common/autotest_common.sh@641 -- # es=1 00:15:01.923 03:26:26 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:15:01.923 03:26:26 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:15:01.923 03:26:26 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:15:01.923 03:26:26 -- target/tls.sh@152 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.brEa19Xrfq 00:15:01.923 03:26:26 -- common/autotest_common.sh@638 -- # local es=0 00:15:01.923 03:26:26 -- common/autotest_common.sh@640 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.brEa19Xrfq 00:15:01.923 03:26:26 -- common/autotest_common.sh@626 -- # local arg=run_bdevperf 00:15:01.923 03:26:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:01.923 03:26:26 -- common/autotest_common.sh@630 -- # type -t run_bdevperf 00:15:01.923 03:26:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:01.923 03:26:26 -- common/autotest_common.sh@641 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.brEa19Xrfq 00:15:01.923 03:26:26 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:15:01.923 03:26:26 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:15:01.923 03:26:26 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:15:01.923 03:26:26 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.brEa19Xrfq' 00:15:01.923 03:26:26 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:01.923 03:26:26 -- target/tls.sh@28 -- # bdevperf_pid=1453834 00:15:01.923 03:26:26 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:15:01.923 03:26:26 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:15:01.923 03:26:26 -- target/tls.sh@31 -- # waitforlisten 1453834 /var/tmp/bdevperf.sock 00:15:01.923 03:26:26 -- common/autotest_common.sh@817 -- # '[' -z 1453834 ']' 00:15:01.923 03:26:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:01.923 03:26:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:01.923 03:26:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:01.923 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:01.923 03:26:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:01.923 03:26:26 -- common/autotest_common.sh@10 -- # set +x 00:15:01.923 [2024-04-27 03:26:26.875890] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:01.923 [2024-04-27 03:26:26.875965] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1453834 ] 00:15:02.181 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.181 [2024-04-27 03:26:26.936755] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:02.181 [2024-04-27 03:26:27.036383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:02.181 03:26:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:02.181 03:26:27 -- common/autotest_common.sh@850 -- # return 0 00:15:02.182 03:26:27 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.brEa19Xrfq 00:15:02.439 [2024-04-27 03:26:27.409635] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:02.440 [2024-04-27 03:26:27.409768] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:15:02.698 [2024-04-27 03:26:27.421530] tcp.c: 878:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:15:02.698 [2024-04-27 03:26:27.421576] posix.c: 588:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:15:02.698 [2024-04-27 03:26:27.421615] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:15:02.698 [2024-04-27 03:26:27.421732] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6fc290 (107): Transport endpoint is not connected 00:15:02.698 [2024-04-27 03:26:27.422723] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6fc290 (9): Bad file descriptor 00:15:02.698 [2024-04-27 03:26:27.423722] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:15:02.698 [2024-04-27 03:26:27.423741] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:15:02.698 [2024-04-27 03:26:27.423769] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:15:02.698 request: 00:15:02.698 { 00:15:02.698 "name": "TLSTEST", 00:15:02.698 "trtype": "tcp", 00:15:02.698 "traddr": "10.0.0.2", 00:15:02.698 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:02.698 "adrfam": "ipv4", 00:15:02.698 "trsvcid": "4420", 00:15:02.698 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:15:02.698 "psk": "/tmp/tmp.brEa19Xrfq", 00:15:02.698 "method": "bdev_nvme_attach_controller", 00:15:02.698 "req_id": 1 00:15:02.698 } 00:15:02.698 Got JSON-RPC error response 00:15:02.698 response: 00:15:02.698 { 00:15:02.698 "code": -32602, 00:15:02.698 "message": "Invalid parameters" 00:15:02.698 } 00:15:02.698 03:26:27 -- target/tls.sh@36 -- # killprocess 1453834 00:15:02.698 03:26:27 -- common/autotest_common.sh@936 -- # '[' -z 1453834 ']' 00:15:02.698 03:26:27 -- common/autotest_common.sh@940 -- # kill -0 1453834 00:15:02.698 03:26:27 -- common/autotest_common.sh@941 -- # uname 00:15:02.698 03:26:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:02.698 03:26:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1453834 00:15:02.698 03:26:27 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:15:02.698 03:26:27 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:15:02.698 03:26:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1453834' 00:15:02.698 killing process with pid 1453834 00:15:02.698 03:26:27 -- common/autotest_common.sh@955 -- # kill 1453834 00:15:02.698 Received shutdown signal, test time was about 10.000000 seconds 00:15:02.698 00:15:02.698 Latency(us) 00:15:02.698 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:02.698 =================================================================================================================== 00:15:02.698 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:15:02.698 [2024-04-27 03:26:27.467752] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:15:02.698 03:26:27 -- common/autotest_common.sh@960 -- # wait 1453834 00:15:02.956 03:26:27 -- target/tls.sh@37 -- # return 1 00:15:02.956 03:26:27 -- common/autotest_common.sh@641 -- # es=1 00:15:02.956 03:26:27 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:15:02.956 03:26:27 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:15:02.956 03:26:27 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:15:02.956 03:26:27 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:15:02.956 03:26:27 -- common/autotest_common.sh@638 -- # local es=0 00:15:02.956 03:26:27 -- common/autotest_common.sh@640 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:15:02.956 03:26:27 -- common/autotest_common.sh@626 -- # local arg=run_bdevperf 00:15:02.956 03:26:27 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:02.956 03:26:27 -- common/autotest_common.sh@630 -- # type -t run_bdevperf 00:15:02.956 03:26:27 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:02.956 03:26:27 -- common/autotest_common.sh@641 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:15:02.956 03:26:27 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:15:02.956 03:26:27 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:15:02.956 03:26:27 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:15:02.956 03:26:27 -- target/tls.sh@23 -- # psk= 00:15:02.956 03:26:27 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:02.956 03:26:27 -- target/tls.sh@28 -- # bdevperf_pid=1453974 00:15:02.956 03:26:27 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:15:02.956 03:26:27 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:15:02.956 03:26:27 -- target/tls.sh@31 -- # waitforlisten 1453974 /var/tmp/bdevperf.sock 00:15:02.956 03:26:27 -- common/autotest_common.sh@817 -- # '[' -z 1453974 ']' 00:15:02.956 03:26:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:02.956 03:26:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:02.956 03:26:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:02.956 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:02.956 03:26:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:02.956 03:26:27 -- common/autotest_common.sh@10 -- # set +x 00:15:02.956 [2024-04-27 03:26:27.769706] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:02.956 [2024-04-27 03:26:27.769779] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1453974 ] 00:15:02.956 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.956 [2024-04-27 03:26:27.827130] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:02.956 [2024-04-27 03:26:27.930520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:03.214 03:26:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:03.214 03:26:28 -- common/autotest_common.sh@850 -- # return 0 00:15:03.214 03:26:28 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:15:03.472 [2024-04-27 03:26:28.313930] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:15:03.472 [2024-04-27 03:26:28.315290] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa34c20 (9): Bad file descriptor 00:15:03.472 [2024-04-27 03:26:28.316284] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:15:03.472 [2024-04-27 03:26:28.316303] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:15:03.472 [2024-04-27 03:26:28.316316] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:15:03.472 request: 00:15:03.472 { 00:15:03.472 "name": "TLSTEST", 00:15:03.472 "trtype": "tcp", 00:15:03.472 "traddr": "10.0.0.2", 00:15:03.472 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:03.472 "adrfam": "ipv4", 00:15:03.472 "trsvcid": "4420", 00:15:03.472 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:03.472 "method": "bdev_nvme_attach_controller", 00:15:03.472 "req_id": 1 00:15:03.472 } 00:15:03.472 Got JSON-RPC error response 00:15:03.472 response: 00:15:03.472 { 00:15:03.472 "code": -32602, 00:15:03.472 "message": "Invalid parameters" 00:15:03.472 } 00:15:03.472 03:26:28 -- target/tls.sh@36 -- # killprocess 1453974 00:15:03.472 03:26:28 -- common/autotest_common.sh@936 -- # '[' -z 1453974 ']' 00:15:03.472 03:26:28 -- common/autotest_common.sh@940 -- # kill -0 1453974 00:15:03.472 03:26:28 -- common/autotest_common.sh@941 -- # uname 00:15:03.472 03:26:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:03.472 03:26:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1453974 00:15:03.472 03:26:28 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:15:03.472 03:26:28 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:15:03.472 03:26:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1453974' 00:15:03.472 killing process with pid 1453974 00:15:03.473 03:26:28 -- common/autotest_common.sh@955 -- # kill 1453974 00:15:03.473 Received shutdown signal, test time was about 10.000000 seconds 00:15:03.473 00:15:03.473 Latency(us) 00:15:03.473 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:03.473 =================================================================================================================== 00:15:03.473 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:15:03.473 03:26:28 -- common/autotest_common.sh@960 -- # wait 1453974 00:15:03.730 03:26:28 -- target/tls.sh@37 -- # return 1 00:15:03.730 03:26:28 -- common/autotest_common.sh@641 -- # es=1 00:15:03.730 03:26:28 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:15:03.730 03:26:28 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:15:03.730 03:26:28 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:15:03.730 03:26:28 -- target/tls.sh@158 -- # killprocess 1450455 00:15:03.730 03:26:28 -- common/autotest_common.sh@936 -- # '[' -z 1450455 ']' 00:15:03.730 03:26:28 -- common/autotest_common.sh@940 -- # kill -0 1450455 00:15:03.730 03:26:28 -- common/autotest_common.sh@941 -- # uname 00:15:03.730 03:26:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:03.730 03:26:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1450455 00:15:03.730 03:26:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:03.730 03:26:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:03.730 03:26:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1450455' 00:15:03.730 killing process with pid 1450455 00:15:03.730 03:26:28 -- common/autotest_common.sh@955 -- # kill 1450455 00:15:03.730 [2024-04-27 03:26:28.642977] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:15:03.730 03:26:28 -- common/autotest_common.sh@960 -- # wait 1450455 00:15:03.989 03:26:28 -- target/tls.sh@159 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 2 00:15:03.989 03:26:28 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff0011223344556677 2 00:15:03.989 03:26:28 -- nvmf/common.sh@691 -- # local prefix key digest 00:15:03.989 03:26:28 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:15:03.989 03:26:28 -- nvmf/common.sh@693 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:15:03.989 03:26:28 -- nvmf/common.sh@693 -- # digest=2 00:15:03.989 03:26:28 -- nvmf/common.sh@694 -- # python - 00:15:04.248 03:26:28 -- target/tls.sh@159 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:15:04.248 03:26:28 -- target/tls.sh@160 -- # mktemp 00:15:04.248 03:26:28 -- target/tls.sh@160 -- # key_long_path=/tmp/tmp.AqN4fFpAuw 00:15:04.248 03:26:28 -- target/tls.sh@161 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:15:04.248 03:26:28 -- target/tls.sh@162 -- # chmod 0600 /tmp/tmp.AqN4fFpAuw 00:15:04.248 03:26:28 -- target/tls.sh@163 -- # nvmfappstart -m 0x2 00:15:04.248 03:26:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:04.248 03:26:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:04.248 03:26:28 -- common/autotest_common.sh@10 -- # set +x 00:15:04.248 03:26:28 -- nvmf/common.sh@470 -- # nvmfpid=1454120 00:15:04.248 03:26:28 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:04.248 03:26:28 -- nvmf/common.sh@471 -- # waitforlisten 1454120 00:15:04.248 03:26:28 -- common/autotest_common.sh@817 -- # '[' -z 1454120 ']' 00:15:04.248 03:26:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:04.248 03:26:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:04.248 03:26:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:04.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:04.248 03:26:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:04.248 03:26:28 -- common/autotest_common.sh@10 -- # set +x 00:15:04.248 [2024-04-27 03:26:29.040478] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:04.248 [2024-04-27 03:26:29.040567] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:04.248 EAL: No free 2048 kB hugepages reported on node 1 00:15:04.248 [2024-04-27 03:26:29.108763] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:04.248 [2024-04-27 03:26:29.218828] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:04.248 [2024-04-27 03:26:29.218885] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:04.248 [2024-04-27 03:26:29.218916] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:04.248 [2024-04-27 03:26:29.218929] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:04.248 [2024-04-27 03:26:29.218950] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:04.248 [2024-04-27 03:26:29.218985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:04.509 03:26:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:04.509 03:26:29 -- common/autotest_common.sh@850 -- # return 0 00:15:04.509 03:26:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:04.509 03:26:29 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:04.509 03:26:29 -- common/autotest_common.sh@10 -- # set +x 00:15:04.509 03:26:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:04.509 03:26:29 -- target/tls.sh@165 -- # setup_nvmf_tgt /tmp/tmp.AqN4fFpAuw 00:15:04.509 03:26:29 -- target/tls.sh@49 -- # local key=/tmp/tmp.AqN4fFpAuw 00:15:04.509 03:26:29 -- target/tls.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:15:04.768 [2024-04-27 03:26:29.631900] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:04.768 03:26:29 -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:15:05.026 03:26:29 -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:15:05.284 [2024-04-27 03:26:30.117272] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:15:05.284 [2024-04-27 03:26:30.117564] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:05.284 03:26:30 -- target/tls.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:15:05.542 malloc0 00:15:05.542 03:26:30 -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:05.799 03:26:30 -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.AqN4fFpAuw 00:15:06.057 [2024-04-27 03:26:30.951510] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:15:06.058 03:26:30 -- target/tls.sh@167 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.AqN4fFpAuw 00:15:06.058 03:26:30 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:15:06.058 03:26:30 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:15:06.058 03:26:30 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:15:06.058 03:26:30 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.AqN4fFpAuw' 00:15:06.058 03:26:30 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:06.058 03:26:30 -- target/tls.sh@28 -- # bdevperf_pid=1454409 00:15:06.058 03:26:30 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:15:06.058 03:26:30 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:15:06.058 03:26:30 -- target/tls.sh@31 -- # waitforlisten 1454409 /var/tmp/bdevperf.sock 00:15:06.058 03:26:30 -- common/autotest_common.sh@817 -- # '[' -z 1454409 ']' 00:15:06.058 03:26:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:06.058 03:26:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:06.058 03:26:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:06.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:06.058 03:26:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:06.058 03:26:30 -- common/autotest_common.sh@10 -- # set +x 00:15:06.058 [2024-04-27 03:26:31.008499] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:06.058 [2024-04-27 03:26:31.008578] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1454409 ] 00:15:06.316 EAL: No free 2048 kB hugepages reported on node 1 00:15:06.316 [2024-04-27 03:26:31.081917] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:06.316 [2024-04-27 03:26:31.210720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:06.575 03:26:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:06.575 03:26:31 -- common/autotest_common.sh@850 -- # return 0 00:15:06.575 03:26:31 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.AqN4fFpAuw 00:15:06.832 [2024-04-27 03:26:31.577309] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:06.832 [2024-04-27 03:26:31.577449] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:15:06.832 TLSTESTn1 00:15:06.832 03:26:31 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:15:06.832 Running I/O for 10 seconds... 00:15:19.027 00:15:19.027 Latency(us) 00:15:19.027 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:19.027 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:15:19.027 Verification LBA range: start 0x0 length 0x2000 00:15:19.027 TLSTESTn1 : 10.03 2706.41 10.57 0.00 0.00 47201.68 9466.31 46991.74 00:15:19.027 =================================================================================================================== 00:15:19.027 Total : 2706.41 10.57 0.00 0.00 47201.68 9466.31 46991.74 00:15:19.027 0 00:15:19.027 03:26:41 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:19.027 03:26:41 -- target/tls.sh@45 -- # killprocess 1454409 00:15:19.027 03:26:41 -- common/autotest_common.sh@936 -- # '[' -z 1454409 ']' 00:15:19.027 03:26:41 -- common/autotest_common.sh@940 -- # kill -0 1454409 00:15:19.027 03:26:41 -- common/autotest_common.sh@941 -- # uname 00:15:19.027 03:26:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:19.027 03:26:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1454409 00:15:19.027 03:26:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:15:19.027 03:26:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:15:19.027 03:26:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1454409' 00:15:19.027 killing process with pid 1454409 00:15:19.027 03:26:41 -- common/autotest_common.sh@955 -- # kill 1454409 00:15:19.027 Received shutdown signal, test time was about 10.000000 seconds 00:15:19.027 00:15:19.027 Latency(us) 00:15:19.027 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:19.027 =================================================================================================================== 00:15:19.027 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:19.027 [2024-04-27 03:26:41.875713] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:15:19.027 03:26:41 -- common/autotest_common.sh@960 -- # wait 1454409 00:15:19.027 03:26:42 -- target/tls.sh@170 -- # chmod 0666 /tmp/tmp.AqN4fFpAuw 00:15:19.027 03:26:42 -- target/tls.sh@171 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.AqN4fFpAuw 00:15:19.027 03:26:42 -- common/autotest_common.sh@638 -- # local es=0 00:15:19.027 03:26:42 -- common/autotest_common.sh@640 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.AqN4fFpAuw 00:15:19.027 03:26:42 -- common/autotest_common.sh@626 -- # local arg=run_bdevperf 00:15:19.027 03:26:42 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:19.027 03:26:42 -- common/autotest_common.sh@630 -- # type -t run_bdevperf 00:15:19.027 03:26:42 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:19.027 03:26:42 -- common/autotest_common.sh@641 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.AqN4fFpAuw 00:15:19.027 03:26:42 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:15:19.027 03:26:42 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:15:19.027 03:26:42 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:15:19.027 03:26:42 -- target/tls.sh@23 -- # psk='--psk /tmp/tmp.AqN4fFpAuw' 00:15:19.027 03:26:42 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:19.027 03:26:42 -- target/tls.sh@28 -- # bdevperf_pid=1455724 00:15:19.027 03:26:42 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:15:19.027 03:26:42 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:15:19.027 03:26:42 -- target/tls.sh@31 -- # waitforlisten 1455724 /var/tmp/bdevperf.sock 00:15:19.027 03:26:42 -- common/autotest_common.sh@817 -- # '[' -z 1455724 ']' 00:15:19.027 03:26:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:19.027 03:26:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:19.027 03:26:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:19.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:19.027 03:26:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:19.027 03:26:42 -- common/autotest_common.sh@10 -- # set +x 00:15:19.027 [2024-04-27 03:26:42.191882] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:19.027 [2024-04-27 03:26:42.191963] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1455724 ] 00:15:19.027 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.027 [2024-04-27 03:26:42.249311] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:19.027 [2024-04-27 03:26:42.347932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:19.027 03:26:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:19.027 03:26:42 -- common/autotest_common.sh@850 -- # return 0 00:15:19.027 03:26:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.AqN4fFpAuw 00:15:19.027 [2024-04-27 03:26:42.668666] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:19.027 [2024-04-27 03:26:42.668772] bdev_nvme.c:6071:bdev_nvme_load_psk: *ERROR*: Incorrect permissions for PSK file 00:15:19.027 [2024-04-27 03:26:42.668786] bdev_nvme.c:6180:bdev_nvme_create: *ERROR*: Could not load PSK from /tmp/tmp.AqN4fFpAuw 00:15:19.027 request: 00:15:19.027 { 00:15:19.027 "name": "TLSTEST", 00:15:19.027 "trtype": "tcp", 00:15:19.027 "traddr": "10.0.0.2", 00:15:19.027 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:19.027 "adrfam": "ipv4", 00:15:19.027 "trsvcid": "4420", 00:15:19.027 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:19.027 "psk": "/tmp/tmp.AqN4fFpAuw", 00:15:19.027 "method": "bdev_nvme_attach_controller", 00:15:19.027 "req_id": 1 00:15:19.027 } 00:15:19.027 Got JSON-RPC error response 00:15:19.027 response: 00:15:19.027 { 00:15:19.027 "code": -1, 00:15:19.027 "message": "Operation not permitted" 00:15:19.027 } 00:15:19.027 03:26:42 -- target/tls.sh@36 -- # killprocess 1455724 00:15:19.027 03:26:42 -- common/autotest_common.sh@936 -- # '[' -z 1455724 ']' 00:15:19.027 03:26:42 -- common/autotest_common.sh@940 -- # kill -0 1455724 00:15:19.027 03:26:42 -- common/autotest_common.sh@941 -- # uname 00:15:19.027 03:26:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:19.027 03:26:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1455724 00:15:19.027 03:26:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:15:19.027 03:26:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:15:19.027 03:26:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1455724' 00:15:19.027 killing process with pid 1455724 00:15:19.027 03:26:42 -- common/autotest_common.sh@955 -- # kill 1455724 00:15:19.027 Received shutdown signal, test time was about 10.000000 seconds 00:15:19.027 00:15:19.027 Latency(us) 00:15:19.027 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:19.027 =================================================================================================================== 00:15:19.027 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:15:19.027 03:26:42 -- common/autotest_common.sh@960 -- # wait 1455724 00:15:19.027 03:26:42 -- target/tls.sh@37 -- # return 1 00:15:19.027 03:26:42 -- common/autotest_common.sh@641 -- # es=1 00:15:19.027 03:26:42 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:15:19.027 03:26:42 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:15:19.027 03:26:42 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:15:19.027 03:26:42 -- target/tls.sh@174 -- # killprocess 1454120 00:15:19.027 03:26:42 -- common/autotest_common.sh@936 -- # '[' -z 1454120 ']' 00:15:19.027 03:26:42 -- common/autotest_common.sh@940 -- # kill -0 1454120 00:15:19.027 03:26:42 -- common/autotest_common.sh@941 -- # uname 00:15:19.027 03:26:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:19.027 03:26:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1454120 00:15:19.027 03:26:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:19.027 03:26:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:19.027 03:26:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1454120' 00:15:19.027 killing process with pid 1454120 00:15:19.027 03:26:42 -- common/autotest_common.sh@955 -- # kill 1454120 00:15:19.027 [2024-04-27 03:26:42.994432] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:15:19.027 03:26:42 -- common/autotest_common.sh@960 -- # wait 1454120 00:15:19.027 03:26:43 -- target/tls.sh@175 -- # nvmfappstart -m 0x2 00:15:19.027 03:26:43 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:19.027 03:26:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:19.027 03:26:43 -- common/autotest_common.sh@10 -- # set +x 00:15:19.027 03:26:43 -- nvmf/common.sh@470 -- # nvmfpid=1455870 00:15:19.027 03:26:43 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:19.027 03:26:43 -- nvmf/common.sh@471 -- # waitforlisten 1455870 00:15:19.027 03:26:43 -- common/autotest_common.sh@817 -- # '[' -z 1455870 ']' 00:15:19.027 03:26:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:19.027 03:26:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:19.027 03:26:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:19.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:19.027 03:26:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:19.027 03:26:43 -- common/autotest_common.sh@10 -- # set +x 00:15:19.027 [2024-04-27 03:26:43.307738] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:19.028 [2024-04-27 03:26:43.307810] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:19.028 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.028 [2024-04-27 03:26:43.368862] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:19.028 [2024-04-27 03:26:43.468887] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:19.028 [2024-04-27 03:26:43.468946] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:19.028 [2024-04-27 03:26:43.468974] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:19.028 [2024-04-27 03:26:43.468985] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:19.028 [2024-04-27 03:26:43.468995] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:19.028 [2024-04-27 03:26:43.469024] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:19.028 03:26:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:19.028 03:26:43 -- common/autotest_common.sh@850 -- # return 0 00:15:19.028 03:26:43 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:19.028 03:26:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:19.028 03:26:43 -- common/autotest_common.sh@10 -- # set +x 00:15:19.028 03:26:43 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:19.028 03:26:43 -- target/tls.sh@177 -- # NOT setup_nvmf_tgt /tmp/tmp.AqN4fFpAuw 00:15:19.028 03:26:43 -- common/autotest_common.sh@638 -- # local es=0 00:15:19.028 03:26:43 -- common/autotest_common.sh@640 -- # valid_exec_arg setup_nvmf_tgt /tmp/tmp.AqN4fFpAuw 00:15:19.028 03:26:43 -- common/autotest_common.sh@626 -- # local arg=setup_nvmf_tgt 00:15:19.028 03:26:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:19.028 03:26:43 -- common/autotest_common.sh@630 -- # type -t setup_nvmf_tgt 00:15:19.028 03:26:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:19.028 03:26:43 -- common/autotest_common.sh@641 -- # setup_nvmf_tgt /tmp/tmp.AqN4fFpAuw 00:15:19.028 03:26:43 -- target/tls.sh@49 -- # local key=/tmp/tmp.AqN4fFpAuw 00:15:19.028 03:26:43 -- target/tls.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:15:19.028 [2024-04-27 03:26:43.864347] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:19.028 03:26:43 -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:15:19.285 03:26:44 -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:15:19.542 [2024-04-27 03:26:44.441840] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:15:19.542 [2024-04-27 03:26:44.442088] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:19.542 03:26:44 -- target/tls.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:15:19.800 malloc0 00:15:19.800 03:26:44 -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:20.058 03:26:44 -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.AqN4fFpAuw 00:15:20.317 [2024-04-27 03:26:45.259471] tcp.c:3562:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:15:20.317 [2024-04-27 03:26:45.259521] tcp.c:3648:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:15:20.317 [2024-04-27 03:26:45.259552] subsystem.c: 971:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:15:20.317 request: 00:15:20.317 { 00:15:20.317 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:20.317 "host": "nqn.2016-06.io.spdk:host1", 00:15:20.317 "psk": "/tmp/tmp.AqN4fFpAuw", 00:15:20.317 "method": "nvmf_subsystem_add_host", 00:15:20.317 "req_id": 1 00:15:20.318 } 00:15:20.318 Got JSON-RPC error response 00:15:20.318 response: 00:15:20.318 { 00:15:20.318 "code": -32603, 00:15:20.318 "message": "Internal error" 00:15:20.318 } 00:15:20.318 03:26:45 -- common/autotest_common.sh@641 -- # es=1 00:15:20.318 03:26:45 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:15:20.318 03:26:45 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:15:20.318 03:26:45 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:15:20.318 03:26:45 -- target/tls.sh@180 -- # killprocess 1455870 00:15:20.318 03:26:45 -- common/autotest_common.sh@936 -- # '[' -z 1455870 ']' 00:15:20.318 03:26:45 -- common/autotest_common.sh@940 -- # kill -0 1455870 00:15:20.318 03:26:45 -- common/autotest_common.sh@941 -- # uname 00:15:20.318 03:26:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:20.318 03:26:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1455870 00:15:20.576 03:26:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:20.576 03:26:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:20.576 03:26:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1455870' 00:15:20.576 killing process with pid 1455870 00:15:20.576 03:26:45 -- common/autotest_common.sh@955 -- # kill 1455870 00:15:20.576 03:26:45 -- common/autotest_common.sh@960 -- # wait 1455870 00:15:20.835 03:26:45 -- target/tls.sh@181 -- # chmod 0600 /tmp/tmp.AqN4fFpAuw 00:15:20.835 03:26:45 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:15:20.835 03:26:45 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:20.835 03:26:45 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:20.835 03:26:45 -- common/autotest_common.sh@10 -- # set +x 00:15:20.835 03:26:45 -- nvmf/common.sh@470 -- # nvmfpid=1456163 00:15:20.835 03:26:45 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:20.835 03:26:45 -- nvmf/common.sh@471 -- # waitforlisten 1456163 00:15:20.835 03:26:45 -- common/autotest_common.sh@817 -- # '[' -z 1456163 ']' 00:15:20.835 03:26:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:20.835 03:26:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:20.835 03:26:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:20.835 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:20.835 03:26:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:20.835 03:26:45 -- common/autotest_common.sh@10 -- # set +x 00:15:20.835 [2024-04-27 03:26:45.668683] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:20.835 [2024-04-27 03:26:45.668767] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:20.835 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.835 [2024-04-27 03:26:45.739586] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:21.093 [2024-04-27 03:26:45.849922] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:21.093 [2024-04-27 03:26:45.849975] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:21.093 [2024-04-27 03:26:45.849990] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:21.093 [2024-04-27 03:26:45.850003] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:21.093 [2024-04-27 03:26:45.850013] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:21.093 [2024-04-27 03:26:45.850056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:21.659 03:26:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:21.659 03:26:46 -- common/autotest_common.sh@850 -- # return 0 00:15:21.659 03:26:46 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:21.659 03:26:46 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:21.659 03:26:46 -- common/autotest_common.sh@10 -- # set +x 00:15:21.659 03:26:46 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:21.659 03:26:46 -- target/tls.sh@185 -- # setup_nvmf_tgt /tmp/tmp.AqN4fFpAuw 00:15:21.659 03:26:46 -- target/tls.sh@49 -- # local key=/tmp/tmp.AqN4fFpAuw 00:15:21.659 03:26:46 -- target/tls.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:15:21.917 [2024-04-27 03:26:46.840549] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:21.917 03:26:46 -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:15:22.174 03:26:47 -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:15:22.460 [2024-04-27 03:26:47.333863] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:15:22.460 [2024-04-27 03:26:47.334133] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:22.460 03:26:47 -- target/tls.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:15:22.719 malloc0 00:15:22.719 03:26:47 -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:22.977 03:26:47 -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.AqN4fFpAuw 00:15:23.236 [2024-04-27 03:26:48.063884] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:15:23.236 03:26:48 -- target/tls.sh@188 -- # bdevperf_pid=1456463 00:15:23.236 03:26:48 -- target/tls.sh@187 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:15:23.236 03:26:48 -- target/tls.sh@190 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:15:23.236 03:26:48 -- target/tls.sh@191 -- # waitforlisten 1456463 /var/tmp/bdevperf.sock 00:15:23.236 03:26:48 -- common/autotest_common.sh@817 -- # '[' -z 1456463 ']' 00:15:23.236 03:26:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:23.236 03:26:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:23.236 03:26:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:23.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:23.236 03:26:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:23.236 03:26:48 -- common/autotest_common.sh@10 -- # set +x 00:15:23.236 [2024-04-27 03:26:48.126897] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:23.236 [2024-04-27 03:26:48.126976] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1456463 ] 00:15:23.236 EAL: No free 2048 kB hugepages reported on node 1 00:15:23.236 [2024-04-27 03:26:48.185787] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:23.494 [2024-04-27 03:26:48.290627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:23.494 03:26:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:23.494 03:26:48 -- common/autotest_common.sh@850 -- # return 0 00:15:23.494 03:26:48 -- target/tls.sh@192 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.AqN4fFpAuw 00:15:23.752 [2024-04-27 03:26:48.637432] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:23.752 [2024-04-27 03:26:48.637580] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:15:23.752 TLSTESTn1 00:15:23.752 03:26:48 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:15:24.319 03:26:49 -- target/tls.sh@196 -- # tgtconf='{ 00:15:24.319 "subsystems": [ 00:15:24.319 { 00:15:24.319 "subsystem": "keyring", 00:15:24.319 "config": [] 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "subsystem": "iobuf", 00:15:24.319 "config": [ 00:15:24.319 { 00:15:24.319 "method": "iobuf_set_options", 00:15:24.319 "params": { 00:15:24.319 "small_pool_count": 8192, 00:15:24.319 "large_pool_count": 1024, 00:15:24.319 "small_bufsize": 8192, 00:15:24.319 "large_bufsize": 135168 00:15:24.319 } 00:15:24.319 } 00:15:24.319 ] 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "subsystem": "sock", 00:15:24.319 "config": [ 00:15:24.319 { 00:15:24.319 "method": "sock_impl_set_options", 00:15:24.319 "params": { 00:15:24.319 "impl_name": "posix", 00:15:24.319 "recv_buf_size": 2097152, 00:15:24.319 "send_buf_size": 2097152, 00:15:24.319 "enable_recv_pipe": true, 00:15:24.319 "enable_quickack": false, 00:15:24.319 "enable_placement_id": 0, 00:15:24.319 "enable_zerocopy_send_server": true, 00:15:24.319 "enable_zerocopy_send_client": false, 00:15:24.319 "zerocopy_threshold": 0, 00:15:24.319 "tls_version": 0, 00:15:24.319 "enable_ktls": false 00:15:24.319 } 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "method": "sock_impl_set_options", 00:15:24.319 "params": { 00:15:24.319 "impl_name": "ssl", 00:15:24.319 "recv_buf_size": 4096, 00:15:24.319 "send_buf_size": 4096, 00:15:24.319 "enable_recv_pipe": true, 00:15:24.319 "enable_quickack": false, 00:15:24.319 "enable_placement_id": 0, 00:15:24.319 "enable_zerocopy_send_server": true, 00:15:24.319 "enable_zerocopy_send_client": false, 00:15:24.319 "zerocopy_threshold": 0, 00:15:24.319 "tls_version": 0, 00:15:24.319 "enable_ktls": false 00:15:24.319 } 00:15:24.319 } 00:15:24.319 ] 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "subsystem": "vmd", 00:15:24.319 "config": [] 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "subsystem": "accel", 00:15:24.319 "config": [ 00:15:24.319 { 00:15:24.319 "method": "accel_set_options", 00:15:24.319 "params": { 00:15:24.319 "small_cache_size": 128, 00:15:24.319 "large_cache_size": 16, 00:15:24.319 "task_count": 2048, 00:15:24.319 "sequence_count": 2048, 00:15:24.319 "buf_count": 2048 00:15:24.319 } 00:15:24.319 } 00:15:24.319 ] 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "subsystem": "bdev", 00:15:24.319 "config": [ 00:15:24.319 { 00:15:24.319 "method": "bdev_set_options", 00:15:24.319 "params": { 00:15:24.319 "bdev_io_pool_size": 65535, 00:15:24.319 "bdev_io_cache_size": 256, 00:15:24.319 "bdev_auto_examine": true, 00:15:24.319 "iobuf_small_cache_size": 128, 00:15:24.319 "iobuf_large_cache_size": 16 00:15:24.319 } 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "method": "bdev_raid_set_options", 00:15:24.319 "params": { 00:15:24.319 "process_window_size_kb": 1024 00:15:24.319 } 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "method": "bdev_iscsi_set_options", 00:15:24.319 "params": { 00:15:24.319 "timeout_sec": 30 00:15:24.319 } 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "method": "bdev_nvme_set_options", 00:15:24.319 "params": { 00:15:24.319 "action_on_timeout": "none", 00:15:24.319 "timeout_us": 0, 00:15:24.319 "timeout_admin_us": 0, 00:15:24.319 "keep_alive_timeout_ms": 10000, 00:15:24.319 "arbitration_burst": 0, 00:15:24.319 "low_priority_weight": 0, 00:15:24.319 "medium_priority_weight": 0, 00:15:24.319 "high_priority_weight": 0, 00:15:24.319 "nvme_adminq_poll_period_us": 10000, 00:15:24.319 "nvme_ioq_poll_period_us": 0, 00:15:24.319 "io_queue_requests": 0, 00:15:24.319 "delay_cmd_submit": true, 00:15:24.319 "transport_retry_count": 4, 00:15:24.319 "bdev_retry_count": 3, 00:15:24.319 "transport_ack_timeout": 0, 00:15:24.319 "ctrlr_loss_timeout_sec": 0, 00:15:24.319 "reconnect_delay_sec": 0, 00:15:24.319 "fast_io_fail_timeout_sec": 0, 00:15:24.319 "disable_auto_failback": false, 00:15:24.319 "generate_uuids": false, 00:15:24.319 "transport_tos": 0, 00:15:24.319 "nvme_error_stat": false, 00:15:24.319 "rdma_srq_size": 0, 00:15:24.319 "io_path_stat": false, 00:15:24.319 "allow_accel_sequence": false, 00:15:24.319 "rdma_max_cq_size": 0, 00:15:24.319 "rdma_cm_event_timeout_ms": 0, 00:15:24.319 "dhchap_digests": [ 00:15:24.319 "sha256", 00:15:24.319 "sha384", 00:15:24.319 "sha512" 00:15:24.319 ], 00:15:24.319 "dhchap_dhgroups": [ 00:15:24.319 "null", 00:15:24.319 "ffdhe2048", 00:15:24.319 "ffdhe3072", 00:15:24.319 "ffdhe4096", 00:15:24.319 "ffdhe6144", 00:15:24.319 "ffdhe8192" 00:15:24.319 ] 00:15:24.319 } 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "method": "bdev_nvme_set_hotplug", 00:15:24.319 "params": { 00:15:24.319 "period_us": 100000, 00:15:24.319 "enable": false 00:15:24.319 } 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "method": "bdev_malloc_create", 00:15:24.319 "params": { 00:15:24.319 "name": "malloc0", 00:15:24.319 "num_blocks": 8192, 00:15:24.319 "block_size": 4096, 00:15:24.319 "physical_block_size": 4096, 00:15:24.319 "uuid": "e43d3c02-abf8-4df7-afa3-8c140fdeee13", 00:15:24.319 "optimal_io_boundary": 0 00:15:24.319 } 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "method": "bdev_wait_for_examine" 00:15:24.319 } 00:15:24.319 ] 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "subsystem": "nbd", 00:15:24.319 "config": [] 00:15:24.319 }, 00:15:24.319 { 00:15:24.319 "subsystem": "scheduler", 00:15:24.319 "config": [ 00:15:24.319 { 00:15:24.319 "method": "framework_set_scheduler", 00:15:24.319 "params": { 00:15:24.319 "name": "static" 00:15:24.319 } 00:15:24.319 } 00:15:24.319 ] 00:15:24.320 }, 00:15:24.320 { 00:15:24.320 "subsystem": "nvmf", 00:15:24.320 "config": [ 00:15:24.320 { 00:15:24.320 "method": "nvmf_set_config", 00:15:24.320 "params": { 00:15:24.320 "discovery_filter": "match_any", 00:15:24.320 "admin_cmd_passthru": { 00:15:24.320 "identify_ctrlr": false 00:15:24.320 } 00:15:24.320 } 00:15:24.320 }, 00:15:24.320 { 00:15:24.320 "method": "nvmf_set_max_subsystems", 00:15:24.320 "params": { 00:15:24.320 "max_subsystems": 1024 00:15:24.320 } 00:15:24.320 }, 00:15:24.320 { 00:15:24.320 "method": "nvmf_set_crdt", 00:15:24.320 "params": { 00:15:24.320 "crdt1": 0, 00:15:24.320 "crdt2": 0, 00:15:24.320 "crdt3": 0 00:15:24.320 } 00:15:24.320 }, 00:15:24.320 { 00:15:24.320 "method": "nvmf_create_transport", 00:15:24.320 "params": { 00:15:24.320 "trtype": "TCP", 00:15:24.320 "max_queue_depth": 128, 00:15:24.320 "max_io_qpairs_per_ctrlr": 127, 00:15:24.320 "in_capsule_data_size": 4096, 00:15:24.320 "max_io_size": 131072, 00:15:24.320 "io_unit_size": 131072, 00:15:24.320 "max_aq_depth": 128, 00:15:24.320 "num_shared_buffers": 511, 00:15:24.320 "buf_cache_size": 4294967295, 00:15:24.320 "dif_insert_or_strip": false, 00:15:24.320 "zcopy": false, 00:15:24.320 "c2h_success": false, 00:15:24.320 "sock_priority": 0, 00:15:24.320 "abort_timeout_sec": 1, 00:15:24.320 "ack_timeout": 0, 00:15:24.320 "data_wr_pool_size": 0 00:15:24.320 } 00:15:24.320 }, 00:15:24.320 { 00:15:24.320 "method": "nvmf_create_subsystem", 00:15:24.320 "params": { 00:15:24.320 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:24.320 "allow_any_host": false, 00:15:24.320 "serial_number": "SPDK00000000000001", 00:15:24.320 "model_number": "SPDK bdev Controller", 00:15:24.320 "max_namespaces": 10, 00:15:24.320 "min_cntlid": 1, 00:15:24.320 "max_cntlid": 65519, 00:15:24.320 "ana_reporting": false 00:15:24.320 } 00:15:24.320 }, 00:15:24.320 { 00:15:24.320 "method": "nvmf_subsystem_add_host", 00:15:24.320 "params": { 00:15:24.320 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:24.320 "host": "nqn.2016-06.io.spdk:host1", 00:15:24.320 "psk": "/tmp/tmp.AqN4fFpAuw" 00:15:24.320 } 00:15:24.320 }, 00:15:24.320 { 00:15:24.320 "method": "nvmf_subsystem_add_ns", 00:15:24.320 "params": { 00:15:24.320 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:24.320 "namespace": { 00:15:24.320 "nsid": 1, 00:15:24.320 "bdev_name": "malloc0", 00:15:24.320 "nguid": "E43D3C02ABF84DF7AFA38C140FDEEE13", 00:15:24.320 "uuid": "e43d3c02-abf8-4df7-afa3-8c140fdeee13", 00:15:24.320 "no_auto_visible": false 00:15:24.320 } 00:15:24.320 } 00:15:24.320 }, 00:15:24.320 { 00:15:24.320 "method": "nvmf_subsystem_add_listener", 00:15:24.320 "params": { 00:15:24.320 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:24.320 "listen_address": { 00:15:24.320 "trtype": "TCP", 00:15:24.320 "adrfam": "IPv4", 00:15:24.320 "traddr": "10.0.0.2", 00:15:24.320 "trsvcid": "4420" 00:15:24.320 }, 00:15:24.320 "secure_channel": true 00:15:24.320 } 00:15:24.320 } 00:15:24.320 ] 00:15:24.320 } 00:15:24.320 ] 00:15:24.320 }' 00:15:24.320 03:26:49 -- target/tls.sh@197 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:15:24.579 03:26:49 -- target/tls.sh@197 -- # bdevperfconf='{ 00:15:24.579 "subsystems": [ 00:15:24.579 { 00:15:24.579 "subsystem": "keyring", 00:15:24.579 "config": [] 00:15:24.579 }, 00:15:24.579 { 00:15:24.579 "subsystem": "iobuf", 00:15:24.579 "config": [ 00:15:24.579 { 00:15:24.579 "method": "iobuf_set_options", 00:15:24.579 "params": { 00:15:24.579 "small_pool_count": 8192, 00:15:24.579 "large_pool_count": 1024, 00:15:24.579 "small_bufsize": 8192, 00:15:24.579 "large_bufsize": 135168 00:15:24.579 } 00:15:24.579 } 00:15:24.579 ] 00:15:24.579 }, 00:15:24.579 { 00:15:24.579 "subsystem": "sock", 00:15:24.579 "config": [ 00:15:24.579 { 00:15:24.579 "method": "sock_impl_set_options", 00:15:24.579 "params": { 00:15:24.579 "impl_name": "posix", 00:15:24.579 "recv_buf_size": 2097152, 00:15:24.579 "send_buf_size": 2097152, 00:15:24.579 "enable_recv_pipe": true, 00:15:24.579 "enable_quickack": false, 00:15:24.579 "enable_placement_id": 0, 00:15:24.579 "enable_zerocopy_send_server": true, 00:15:24.579 "enable_zerocopy_send_client": false, 00:15:24.579 "zerocopy_threshold": 0, 00:15:24.580 "tls_version": 0, 00:15:24.580 "enable_ktls": false 00:15:24.580 } 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "method": "sock_impl_set_options", 00:15:24.580 "params": { 00:15:24.580 "impl_name": "ssl", 00:15:24.580 "recv_buf_size": 4096, 00:15:24.580 "send_buf_size": 4096, 00:15:24.580 "enable_recv_pipe": true, 00:15:24.580 "enable_quickack": false, 00:15:24.580 "enable_placement_id": 0, 00:15:24.580 "enable_zerocopy_send_server": true, 00:15:24.580 "enable_zerocopy_send_client": false, 00:15:24.580 "zerocopy_threshold": 0, 00:15:24.580 "tls_version": 0, 00:15:24.580 "enable_ktls": false 00:15:24.580 } 00:15:24.580 } 00:15:24.580 ] 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "subsystem": "vmd", 00:15:24.580 "config": [] 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "subsystem": "accel", 00:15:24.580 "config": [ 00:15:24.580 { 00:15:24.580 "method": "accel_set_options", 00:15:24.580 "params": { 00:15:24.580 "small_cache_size": 128, 00:15:24.580 "large_cache_size": 16, 00:15:24.580 "task_count": 2048, 00:15:24.580 "sequence_count": 2048, 00:15:24.580 "buf_count": 2048 00:15:24.580 } 00:15:24.580 } 00:15:24.580 ] 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "subsystem": "bdev", 00:15:24.580 "config": [ 00:15:24.580 { 00:15:24.580 "method": "bdev_set_options", 00:15:24.580 "params": { 00:15:24.580 "bdev_io_pool_size": 65535, 00:15:24.580 "bdev_io_cache_size": 256, 00:15:24.580 "bdev_auto_examine": true, 00:15:24.580 "iobuf_small_cache_size": 128, 00:15:24.580 "iobuf_large_cache_size": 16 00:15:24.580 } 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "method": "bdev_raid_set_options", 00:15:24.580 "params": { 00:15:24.580 "process_window_size_kb": 1024 00:15:24.580 } 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "method": "bdev_iscsi_set_options", 00:15:24.580 "params": { 00:15:24.580 "timeout_sec": 30 00:15:24.580 } 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "method": "bdev_nvme_set_options", 00:15:24.580 "params": { 00:15:24.580 "action_on_timeout": "none", 00:15:24.580 "timeout_us": 0, 00:15:24.580 "timeout_admin_us": 0, 00:15:24.580 "keep_alive_timeout_ms": 10000, 00:15:24.580 "arbitration_burst": 0, 00:15:24.580 "low_priority_weight": 0, 00:15:24.580 "medium_priority_weight": 0, 00:15:24.580 "high_priority_weight": 0, 00:15:24.580 "nvme_adminq_poll_period_us": 10000, 00:15:24.580 "nvme_ioq_poll_period_us": 0, 00:15:24.580 "io_queue_requests": 512, 00:15:24.580 "delay_cmd_submit": true, 00:15:24.580 "transport_retry_count": 4, 00:15:24.580 "bdev_retry_count": 3, 00:15:24.580 "transport_ack_timeout": 0, 00:15:24.580 "ctrlr_loss_timeout_sec": 0, 00:15:24.580 "reconnect_delay_sec": 0, 00:15:24.580 "fast_io_fail_timeout_sec": 0, 00:15:24.580 "disable_auto_failback": false, 00:15:24.580 "generate_uuids": false, 00:15:24.580 "transport_tos": 0, 00:15:24.580 "nvme_error_stat": false, 00:15:24.580 "rdma_srq_size": 0, 00:15:24.580 "io_path_stat": false, 00:15:24.580 "allow_accel_sequence": false, 00:15:24.580 "rdma_max_cq_size": 0, 00:15:24.580 "rdma_cm_event_timeout_ms": 0, 00:15:24.580 "dhchap_digests": [ 00:15:24.580 "sha256", 00:15:24.580 "sha384", 00:15:24.580 "sha512" 00:15:24.580 ], 00:15:24.580 "dhchap_dhgroups": [ 00:15:24.580 "null", 00:15:24.580 "ffdhe2048", 00:15:24.580 "ffdhe3072", 00:15:24.580 "ffdhe4096", 00:15:24.580 "ffdhe6144", 00:15:24.580 "ffdhe8192" 00:15:24.580 ] 00:15:24.580 } 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "method": "bdev_nvme_attach_controller", 00:15:24.580 "params": { 00:15:24.580 "name": "TLSTEST", 00:15:24.580 "trtype": "TCP", 00:15:24.580 "adrfam": "IPv4", 00:15:24.580 "traddr": "10.0.0.2", 00:15:24.580 "trsvcid": "4420", 00:15:24.580 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:24.580 "prchk_reftag": false, 00:15:24.580 "prchk_guard": false, 00:15:24.580 "ctrlr_loss_timeout_sec": 0, 00:15:24.580 "reconnect_delay_sec": 0, 00:15:24.580 "fast_io_fail_timeout_sec": 0, 00:15:24.580 "psk": "/tmp/tmp.AqN4fFpAuw", 00:15:24.580 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:24.580 "hdgst": false, 00:15:24.580 "ddgst": false 00:15:24.580 } 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "method": "bdev_nvme_set_hotplug", 00:15:24.580 "params": { 00:15:24.580 "period_us": 100000, 00:15:24.580 "enable": false 00:15:24.580 } 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "method": "bdev_wait_for_examine" 00:15:24.580 } 00:15:24.580 ] 00:15:24.580 }, 00:15:24.580 { 00:15:24.580 "subsystem": "nbd", 00:15:24.580 "config": [] 00:15:24.580 } 00:15:24.580 ] 00:15:24.580 }' 00:15:24.580 03:26:49 -- target/tls.sh@199 -- # killprocess 1456463 00:15:24.580 03:26:49 -- common/autotest_common.sh@936 -- # '[' -z 1456463 ']' 00:15:24.580 03:26:49 -- common/autotest_common.sh@940 -- # kill -0 1456463 00:15:24.580 03:26:49 -- common/autotest_common.sh@941 -- # uname 00:15:24.580 03:26:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:24.580 03:26:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1456463 00:15:24.580 03:26:49 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:15:24.580 03:26:49 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:15:24.580 03:26:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1456463' 00:15:24.580 killing process with pid 1456463 00:15:24.580 03:26:49 -- common/autotest_common.sh@955 -- # kill 1456463 00:15:24.580 Received shutdown signal, test time was about 10.000000 seconds 00:15:24.580 00:15:24.580 Latency(us) 00:15:24.580 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:24.580 =================================================================================================================== 00:15:24.580 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:15:24.580 [2024-04-27 03:26:49.391647] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:15:24.580 03:26:49 -- common/autotest_common.sh@960 -- # wait 1456463 00:15:24.839 03:26:49 -- target/tls.sh@200 -- # killprocess 1456163 00:15:24.839 03:26:49 -- common/autotest_common.sh@936 -- # '[' -z 1456163 ']' 00:15:24.839 03:26:49 -- common/autotest_common.sh@940 -- # kill -0 1456163 00:15:24.839 03:26:49 -- common/autotest_common.sh@941 -- # uname 00:15:24.839 03:26:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:24.839 03:26:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1456163 00:15:24.839 03:26:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:24.839 03:26:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:24.839 03:26:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1456163' 00:15:24.839 killing process with pid 1456163 00:15:24.839 03:26:49 -- common/autotest_common.sh@955 -- # kill 1456163 00:15:24.839 [2024-04-27 03:26:49.684557] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:15:24.839 03:26:49 -- common/autotest_common.sh@960 -- # wait 1456163 00:15:25.098 03:26:49 -- target/tls.sh@203 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:15:25.098 03:26:49 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:25.098 03:26:49 -- target/tls.sh@203 -- # echo '{ 00:15:25.098 "subsystems": [ 00:15:25.098 { 00:15:25.098 "subsystem": "keyring", 00:15:25.098 "config": [] 00:15:25.098 }, 00:15:25.098 { 00:15:25.098 "subsystem": "iobuf", 00:15:25.098 "config": [ 00:15:25.098 { 00:15:25.098 "method": "iobuf_set_options", 00:15:25.098 "params": { 00:15:25.098 "small_pool_count": 8192, 00:15:25.098 "large_pool_count": 1024, 00:15:25.098 "small_bufsize": 8192, 00:15:25.098 "large_bufsize": 135168 00:15:25.098 } 00:15:25.098 } 00:15:25.098 ] 00:15:25.098 }, 00:15:25.098 { 00:15:25.098 "subsystem": "sock", 00:15:25.098 "config": [ 00:15:25.098 { 00:15:25.098 "method": "sock_impl_set_options", 00:15:25.098 "params": { 00:15:25.098 "impl_name": "posix", 00:15:25.098 "recv_buf_size": 2097152, 00:15:25.098 "send_buf_size": 2097152, 00:15:25.098 "enable_recv_pipe": true, 00:15:25.098 "enable_quickack": false, 00:15:25.098 "enable_placement_id": 0, 00:15:25.098 "enable_zerocopy_send_server": true, 00:15:25.098 "enable_zerocopy_send_client": false, 00:15:25.098 "zerocopy_threshold": 0, 00:15:25.098 "tls_version": 0, 00:15:25.098 "enable_ktls": false 00:15:25.098 } 00:15:25.098 }, 00:15:25.098 { 00:15:25.098 "method": "sock_impl_set_options", 00:15:25.098 "params": { 00:15:25.098 "impl_name": "ssl", 00:15:25.098 "recv_buf_size": 4096, 00:15:25.098 "send_buf_size": 4096, 00:15:25.098 "enable_recv_pipe": true, 00:15:25.098 "enable_quickack": false, 00:15:25.098 "enable_placement_id": 0, 00:15:25.098 "enable_zerocopy_send_server": true, 00:15:25.098 "enable_zerocopy_send_client": false, 00:15:25.098 "zerocopy_threshold": 0, 00:15:25.098 "tls_version": 0, 00:15:25.098 "enable_ktls": false 00:15:25.098 } 00:15:25.098 } 00:15:25.098 ] 00:15:25.098 }, 00:15:25.098 { 00:15:25.098 "subsystem": "vmd", 00:15:25.098 "config": [] 00:15:25.098 }, 00:15:25.098 { 00:15:25.098 "subsystem": "accel", 00:15:25.098 "config": [ 00:15:25.098 { 00:15:25.098 "method": "accel_set_options", 00:15:25.098 "params": { 00:15:25.098 "small_cache_size": 128, 00:15:25.098 "large_cache_size": 16, 00:15:25.098 "task_count": 2048, 00:15:25.098 "sequence_count": 2048, 00:15:25.098 "buf_count": 2048 00:15:25.098 } 00:15:25.098 } 00:15:25.098 ] 00:15:25.098 }, 00:15:25.098 { 00:15:25.098 "subsystem": "bdev", 00:15:25.098 "config": [ 00:15:25.098 { 00:15:25.098 "method": "bdev_set_options", 00:15:25.098 "params": { 00:15:25.098 "bdev_io_pool_size": 65535, 00:15:25.098 "bdev_io_cache_size": 256, 00:15:25.098 "bdev_auto_examine": true, 00:15:25.098 "iobuf_small_cache_size": 128, 00:15:25.098 "iobuf_large_cache_size": 16 00:15:25.098 } 00:15:25.098 }, 00:15:25.098 { 00:15:25.098 "method": "bdev_raid_set_options", 00:15:25.098 "params": { 00:15:25.098 "process_window_size_kb": 1024 00:15:25.098 } 00:15:25.098 }, 00:15:25.098 { 00:15:25.098 "method": "bdev_iscsi_set_options", 00:15:25.098 "params": { 00:15:25.098 "timeout_sec": 30 00:15:25.098 } 00:15:25.098 }, 00:15:25.098 { 00:15:25.098 "method": "bdev_nvme_set_options", 00:15:25.098 "params": { 00:15:25.098 "action_on_timeout": "none", 00:15:25.098 "timeout_us": 0, 00:15:25.098 "timeout_admin_us": 0, 00:15:25.098 "keep_alive_timeout_ms": 10000, 00:15:25.098 "arbitration_burst": 0, 00:15:25.098 "low_priority_weight": 0, 00:15:25.098 "medium_priority_weight": 0, 00:15:25.098 "high_priority_weight": 0, 00:15:25.098 "nvme_adminq_poll_period_us": 10000, 00:15:25.098 "nvme_ioq_poll_period_us": 0, 00:15:25.098 "io_queue_requests": 0, 00:15:25.098 "delay_cmd_submit": true, 00:15:25.098 "transport_retry_count": 4, 00:15:25.098 "bdev_retry_count": 3, 00:15:25.098 "transport_ack_timeout": 0, 00:15:25.098 "ctrlr_loss_timeout_sec": 0, 00:15:25.098 "reconnect_delay_sec": 0, 00:15:25.098 "fast_io_fail_timeout_sec": 0, 00:15:25.098 "disable_auto_failback": false, 00:15:25.098 "generate_uuids": false, 00:15:25.099 "transport_tos": 0, 00:15:25.099 "nvme_error_stat": false, 00:15:25.099 "rdma_srq_size": 0, 00:15:25.099 "io_path_stat": false, 00:15:25.099 "allow_accel_sequence": false, 00:15:25.099 "rdma_max_cq_size": 0, 00:15:25.099 "rdma_cm_event_timeout_ms": 0, 00:15:25.099 "dhchap_digests": [ 00:15:25.099 "sha256", 00:15:25.099 "sha384", 00:15:25.099 "sha512" 00:15:25.099 ], 00:15:25.099 "dhchap_dhgroups": [ 00:15:25.099 "null", 00:15:25.099 "ffdhe2048", 00:15:25.099 "ffdhe3072", 00:15:25.099 "ffdhe4096", 00:15:25.099 "ffdhe6144", 00:15:25.099 "ffdhe8192" 00:15:25.099 ] 00:15:25.099 } 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "method": "bdev_nvme_set_hotplug", 00:15:25.099 "params": { 00:15:25.099 "period_us": 100000, 00:15:25.099 "enable": false 00:15:25.099 } 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "method": "bdev_malloc_create", 00:15:25.099 "params": { 00:15:25.099 "name": "malloc0", 00:15:25.099 "num_blocks": 8192, 00:15:25.099 "block_size": 4096, 00:15:25.099 "physical_block_size": 4096, 00:15:25.099 "uuid": "e43d3c02-abf8-4df7-afa3-8c140fdeee13", 00:15:25.099 "optimal_io_boundary": 0 00:15:25.099 } 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "method": "bdev_wait_for_examine" 00:15:25.099 } 00:15:25.099 ] 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "subsystem": "nbd", 00:15:25.099 "config": [] 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "subsystem": "scheduler", 00:15:25.099 "config": [ 00:15:25.099 { 00:15:25.099 "method": "framework_set_scheduler", 00:15:25.099 "params": { 00:15:25.099 "name": "static" 00:15:25.099 } 00:15:25.099 } 00:15:25.099 ] 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "subsystem": "nvmf", 00:15:25.099 "config": [ 00:15:25.099 { 00:15:25.099 "method": "nvmf_set_config", 00:15:25.099 "params": { 00:15:25.099 "discovery_filter": "match_any", 00:15:25.099 "admin_cmd_passthru": { 00:15:25.099 "identify_ctrlr": false 00:15:25.099 } 00:15:25.099 } 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "method": "nvmf_set_max_subsystems", 00:15:25.099 "params": { 00:15:25.099 "max_subsystems": 1024 00:15:25.099 } 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "method": "nvmf_set_crdt", 00:15:25.099 "params": { 00:15:25.099 "crdt1": 0, 00:15:25.099 "crdt2": 0, 00:15:25.099 "crdt3": 0 00:15:25.099 } 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "method": "nvmf_create_transport", 00:15:25.099 "params": { 00:15:25.099 "trtype": "TCP", 00:15:25.099 "max_queue_depth": 128, 00:15:25.099 "max_io_qpairs_per_ctrlr": 127, 00:15:25.099 "in_capsule_data_size": 4096, 00:15:25.099 "max_io_size": 131072, 00:15:25.099 "io_unit_size": 131072, 00:15:25.099 "max_aq_depth": 128, 00:15:25.099 "num_shared_buffers": 511, 00:15:25.099 "buf_cache_size": 4294967295, 00:15:25.099 "dif_insert_or_strip": false, 00:15:25.099 "zcopy": false, 00:15:25.099 "c2h_success": false, 00:15:25.099 "sock_priority": 0, 00:15:25.099 "abort_timeout_sec": 1, 00:15:25.099 "ack_timeout": 0, 00:15:25.099 "data_wr_pool_size": 0 00:15:25.099 } 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "method": "nvmf_create_subsystem", 00:15:25.099 "params": { 00:15:25.099 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.099 "allow_any_host": false, 00:15:25.099 "serial_number": "SPDK00000000000001", 00:15:25.099 "model_number": "SPDK bdev Controller", 00:15:25.099 "max_namespaces": 10, 00:15:25.099 "min_cntlid": 1, 00:15:25.099 "max_cntlid": 65519, 00:15:25.099 "ana_reporting": false 00:15:25.099 } 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "method": "nvmf_subsystem_add_host", 00:15:25.099 "params": { 00:15:25.099 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.099 "host": "nqn.2016-06.io.spdk:host1", 00:15:25.099 "psk": "/tmp/tmp.AqN4fFpAuw" 00:15:25.099 } 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "method": "nvmf_subsystem_add_ns", 00:15:25.099 "params": { 00:15:25.099 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.099 "namespace": { 00:15:25.099 "nsid": 1, 00:15:25.099 "bdev_name": "malloc0", 00:15:25.099 "nguid": "E43D3C02ABF84DF7AFA38C140FDEEE13", 00:15:25.099 "uuid": "e43d3c02-abf8-4df7-afa3-8c140fdeee13", 00:15:25.099 "no_auto_visible": false 00:15:25.099 } 00:15:25.099 } 00:15:25.099 }, 00:15:25.099 { 00:15:25.099 "method": "nvmf_subsystem_add_listener", 00:15:25.099 "params": { 00:15:25.099 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.099 "listen_address": { 00:15:25.099 "trtype": "TCP", 00:15:25.099 "adrfam": "IPv4", 00:15:25.099 "traddr": "10.0.0.2", 00:15:25.099 "trsvcid": "4420" 00:15:25.099 }, 00:15:25.099 "secure_channel": true 00:15:25.099 } 00:15:25.099 } 00:15:25.099 ] 00:15:25.099 } 00:15:25.099 ] 00:15:25.099 }' 00:15:25.099 03:26:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:25.099 03:26:49 -- common/autotest_common.sh@10 -- # set +x 00:15:25.099 03:26:49 -- nvmf/common.sh@470 -- # nvmfpid=1456738 00:15:25.099 03:26:49 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:15:25.099 03:26:49 -- nvmf/common.sh@471 -- # waitforlisten 1456738 00:15:25.099 03:26:49 -- common/autotest_common.sh@817 -- # '[' -z 1456738 ']' 00:15:25.099 03:26:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:25.099 03:26:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:25.099 03:26:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:25.099 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:25.099 03:26:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:25.099 03:26:49 -- common/autotest_common.sh@10 -- # set +x 00:15:25.099 [2024-04-27 03:26:50.030408] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:25.099 [2024-04-27 03:26:50.030495] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:25.099 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.358 [2024-04-27 03:26:50.099822] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:25.358 [2024-04-27 03:26:50.212365] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:25.358 [2024-04-27 03:26:50.212440] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:25.358 [2024-04-27 03:26:50.212468] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:25.358 [2024-04-27 03:26:50.212480] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:25.358 [2024-04-27 03:26:50.212490] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:25.358 [2024-04-27 03:26:50.212621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:25.616 [2024-04-27 03:26:50.441021] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:25.616 [2024-04-27 03:26:50.456981] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:15:25.616 [2024-04-27 03:26:50.473016] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:15:25.616 [2024-04-27 03:26:50.480475] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:26.184 03:26:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:26.184 03:26:51 -- common/autotest_common.sh@850 -- # return 0 00:15:26.184 03:26:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:26.184 03:26:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:26.184 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:15:26.184 03:26:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:26.184 03:26:51 -- target/tls.sh@207 -- # bdevperf_pid=1456888 00:15:26.184 03:26:51 -- target/tls.sh@208 -- # waitforlisten 1456888 /var/tmp/bdevperf.sock 00:15:26.184 03:26:51 -- common/autotest_common.sh@817 -- # '[' -z 1456888 ']' 00:15:26.184 03:26:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:26.184 03:26:51 -- target/tls.sh@204 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:15:26.184 03:26:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:26.184 03:26:51 -- target/tls.sh@204 -- # echo '{ 00:15:26.184 "subsystems": [ 00:15:26.184 { 00:15:26.184 "subsystem": "keyring", 00:15:26.184 "config": [] 00:15:26.184 }, 00:15:26.184 { 00:15:26.184 "subsystem": "iobuf", 00:15:26.184 "config": [ 00:15:26.184 { 00:15:26.184 "method": "iobuf_set_options", 00:15:26.184 "params": { 00:15:26.184 "small_pool_count": 8192, 00:15:26.184 "large_pool_count": 1024, 00:15:26.184 "small_bufsize": 8192, 00:15:26.184 "large_bufsize": 135168 00:15:26.184 } 00:15:26.184 } 00:15:26.184 ] 00:15:26.184 }, 00:15:26.184 { 00:15:26.184 "subsystem": "sock", 00:15:26.184 "config": [ 00:15:26.184 { 00:15:26.184 "method": "sock_impl_set_options", 00:15:26.184 "params": { 00:15:26.184 "impl_name": "posix", 00:15:26.184 "recv_buf_size": 2097152, 00:15:26.184 "send_buf_size": 2097152, 00:15:26.184 "enable_recv_pipe": true, 00:15:26.184 "enable_quickack": false, 00:15:26.184 "enable_placement_id": 0, 00:15:26.184 "enable_zerocopy_send_server": true, 00:15:26.184 "enable_zerocopy_send_client": false, 00:15:26.184 "zerocopy_threshold": 0, 00:15:26.184 "tls_version": 0, 00:15:26.184 "enable_ktls": false 00:15:26.184 } 00:15:26.184 }, 00:15:26.184 { 00:15:26.184 "method": "sock_impl_set_options", 00:15:26.184 "params": { 00:15:26.184 "impl_name": "ssl", 00:15:26.184 "recv_buf_size": 4096, 00:15:26.184 "send_buf_size": 4096, 00:15:26.184 "enable_recv_pipe": true, 00:15:26.184 "enable_quickack": false, 00:15:26.184 "enable_placement_id": 0, 00:15:26.184 "enable_zerocopy_send_server": true, 00:15:26.184 "enable_zerocopy_send_client": false, 00:15:26.184 "zerocopy_threshold": 0, 00:15:26.184 "tls_version": 0, 00:15:26.184 "enable_ktls": false 00:15:26.184 } 00:15:26.184 } 00:15:26.184 ] 00:15:26.184 }, 00:15:26.184 { 00:15:26.184 "subsystem": "vmd", 00:15:26.184 "config": [] 00:15:26.184 }, 00:15:26.184 { 00:15:26.184 "subsystem": "accel", 00:15:26.184 "config": [ 00:15:26.184 { 00:15:26.184 "method": "accel_set_options", 00:15:26.184 "params": { 00:15:26.184 "small_cache_size": 128, 00:15:26.184 "large_cache_size": 16, 00:15:26.184 "task_count": 2048, 00:15:26.184 "sequence_count": 2048, 00:15:26.184 "buf_count": 2048 00:15:26.184 } 00:15:26.184 } 00:15:26.184 ] 00:15:26.184 }, 00:15:26.184 { 00:15:26.184 "subsystem": "bdev", 00:15:26.184 "config": [ 00:15:26.184 { 00:15:26.184 "method": "bdev_set_options", 00:15:26.184 "params": { 00:15:26.184 "bdev_io_pool_size": 65535, 00:15:26.184 "bdev_io_cache_size": 256, 00:15:26.184 "bdev_auto_examine": true, 00:15:26.184 "iobuf_small_cache_size": 128, 00:15:26.184 "iobuf_large_cache_size": 16 00:15:26.184 } 00:15:26.184 }, 00:15:26.184 { 00:15:26.184 "method": "bdev_raid_set_options", 00:15:26.184 "params": { 00:15:26.184 "process_window_size_kb": 1024 00:15:26.184 } 00:15:26.184 }, 00:15:26.184 { 00:15:26.184 "method": "bdev_iscsi_set_options", 00:15:26.184 "params": { 00:15:26.184 "timeout_sec": 30 00:15:26.184 } 00:15:26.184 }, 00:15:26.184 { 00:15:26.184 "method": "bdev_nvme_set_options", 00:15:26.184 "params": { 00:15:26.184 "action_on_timeout": "none", 00:15:26.184 "timeout_us": 0, 00:15:26.184 "timeout_admin_us": 0, 00:15:26.184 "keep_alive_timeout_ms": 10000, 00:15:26.184 "arbitration_burst": 0, 00:15:26.184 "low_priority_weight": 0, 00:15:26.184 "medium_priority_weight": 0, 00:15:26.184 "high_priority_weight": 0, 00:15:26.184 "nvme_adminq_poll_period_us": 10000, 00:15:26.184 "nvme_ioq_poll_period_us": 0, 00:15:26.184 "io_queue_requests": 512, 00:15:26.184 "delay_cmd_submit": true, 00:15:26.184 "transport_retry_count": 4, 00:15:26.184 "bdev_retry_count": 3, 00:15:26.184 "transport_ack_timeout": 0, 00:15:26.184 "ctrlr_loss_timeout_sec": 0, 00:15:26.184 "reconnect_delay_sec": 0, 00:15:26.184 "fast_io_fail_timeout_sec": 0, 00:15:26.184 "disable_auto_failback": false, 00:15:26.184 "generate_uuids": false, 00:15:26.184 "transport_tos": 0, 00:15:26.184 "nvme_error_stat": false, 00:15:26.184 "rdma_srq_size": 0, 00:15:26.184 "io_path_stat": false, 00:15:26.184 "allow_accel_sequence": false, 00:15:26.184 "rdma_max_cq_size": 0, 00:15:26.184 "rdma_cm_event_timeout_ms": 0, 00:15:26.184 "dhchap_digests": [ 00:15:26.184 "sha256", 00:15:26.184 "sha384", 00:15:26.184 "sha512" 00:15:26.184 ], 00:15:26.184 "dhchap_dhgroups": [ 00:15:26.184 "null", 00:15:26.184 "ffdhe2048", 00:15:26.184 "ffdhe3072", 00:15:26.184 "ffdhe4096", 00:15:26.184 "ffdhe6144", 00:15:26.184 "ffdhe8192" 00:15:26.184 ] 00:15:26.184 } 00:15:26.184 }, 00:15:26.184 { 00:15:26.184 "method": "bdev_nvme_attach_controller", 00:15:26.184 "params": { 00:15:26.184 "name": "TLSTEST", 00:15:26.184 "trtype": "TCP", 00:15:26.184 "adrfam": "IPv4", 00:15:26.184 "traddr": "10.0.0.2", 00:15:26.184 "trsvcid": "4420", 00:15:26.184 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:26.184 "prchk_reftag": false, 00:15:26.184 "prchk_guard": false, 00:15:26.184 "ctrlr_loss_timeout_sec": 0, 00:15:26.184 "reconnect_delay_sec": 0, 00:15:26.184 "fast_io_fail_timeout_sec": 0, 00:15:26.185 "psk": "/tmp/tmp.AqN4fFpAuw", 00:15:26.185 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:26.185 "hdgst": false, 00:15:26.185 "ddgst": false 00:15:26.185 } 00:15:26.185 }, 00:15:26.185 { 00:15:26.185 "method": "bdev_nvme_set_hotplug", 00:15:26.185 "params": { 00:15:26.185 "period_us": 100000, 00:15:26.185 "enable": false 00:15:26.185 } 00:15:26.185 }, 00:15:26.185 { 00:15:26.185 "method": "bdev_wait_for_examine" 00:15:26.185 } 00:15:26.185 ] 00:15:26.185 }, 00:15:26.185 { 00:15:26.185 "subsystem": "nbd", 00:15:26.185 "config": [] 00:15:26.185 } 00:15:26.185 ] 00:15:26.185 }' 00:15:26.185 03:26:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:26.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:26.185 03:26:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:26.185 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:15:26.185 [2024-04-27 03:26:51.089069] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:26.185 [2024-04-27 03:26:51.089149] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1456888 ] 00:15:26.185 EAL: No free 2048 kB hugepages reported on node 1 00:15:26.185 [2024-04-27 03:26:51.146657] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:26.443 [2024-04-27 03:26:51.250890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:26.443 [2024-04-27 03:26:51.415306] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:26.443 [2024-04-27 03:26:51.415445] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:15:27.378 03:26:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:27.378 03:26:52 -- common/autotest_common.sh@850 -- # return 0 00:15:27.378 03:26:52 -- target/tls.sh@211 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:15:27.378 Running I/O for 10 seconds... 00:15:37.343 00:15:37.343 Latency(us) 00:15:37.343 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:37.343 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:15:37.343 Verification LBA range: start 0x0 length 0x2000 00:15:37.343 TLSTESTn1 : 10.03 2606.41 10.18 0.00 0.00 49021.20 7670.14 59807.67 00:15:37.343 =================================================================================================================== 00:15:37.343 Total : 2606.41 10.18 0.00 0.00 49021.20 7670.14 59807.67 00:15:37.343 0 00:15:37.343 03:27:02 -- target/tls.sh@213 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:37.343 03:27:02 -- target/tls.sh@214 -- # killprocess 1456888 00:15:37.343 03:27:02 -- common/autotest_common.sh@936 -- # '[' -z 1456888 ']' 00:15:37.343 03:27:02 -- common/autotest_common.sh@940 -- # kill -0 1456888 00:15:37.343 03:27:02 -- common/autotest_common.sh@941 -- # uname 00:15:37.343 03:27:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:37.343 03:27:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1456888 00:15:37.343 03:27:02 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:15:37.343 03:27:02 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:15:37.343 03:27:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1456888' 00:15:37.343 killing process with pid 1456888 00:15:37.343 03:27:02 -- common/autotest_common.sh@955 -- # kill 1456888 00:15:37.343 Received shutdown signal, test time was about 10.000000 seconds 00:15:37.343 00:15:37.343 Latency(us) 00:15:37.343 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:37.343 =================================================================================================================== 00:15:37.343 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:37.343 [2024-04-27 03:27:02.286459] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:15:37.343 03:27:02 -- common/autotest_common.sh@960 -- # wait 1456888 00:15:37.601 03:27:02 -- target/tls.sh@215 -- # killprocess 1456738 00:15:37.601 03:27:02 -- common/autotest_common.sh@936 -- # '[' -z 1456738 ']' 00:15:37.601 03:27:02 -- common/autotest_common.sh@940 -- # kill -0 1456738 00:15:37.601 03:27:02 -- common/autotest_common.sh@941 -- # uname 00:15:37.601 03:27:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:37.601 03:27:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1456738 00:15:37.601 03:27:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:37.601 03:27:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:37.601 03:27:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1456738' 00:15:37.601 killing process with pid 1456738 00:15:37.601 03:27:02 -- common/autotest_common.sh@955 -- # kill 1456738 00:15:37.601 [2024-04-27 03:27:02.576713] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:15:37.601 03:27:02 -- common/autotest_common.sh@960 -- # wait 1456738 00:15:38.168 03:27:02 -- target/tls.sh@218 -- # nvmfappstart 00:15:38.168 03:27:02 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:38.168 03:27:02 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:38.168 03:27:02 -- common/autotest_common.sh@10 -- # set +x 00:15:38.168 03:27:02 -- nvmf/common.sh@470 -- # nvmfpid=1458332 00:15:38.168 03:27:02 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:15:38.168 03:27:02 -- nvmf/common.sh@471 -- # waitforlisten 1458332 00:15:38.168 03:27:02 -- common/autotest_common.sh@817 -- # '[' -z 1458332 ']' 00:15:38.168 03:27:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:38.168 03:27:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:38.168 03:27:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:38.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:38.168 03:27:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:38.168 03:27:02 -- common/autotest_common.sh@10 -- # set +x 00:15:38.168 [2024-04-27 03:27:02.910590] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:38.168 [2024-04-27 03:27:02.910666] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:38.168 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.168 [2024-04-27 03:27:02.972895] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:38.168 [2024-04-27 03:27:03.074383] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:38.168 [2024-04-27 03:27:03.074440] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:38.168 [2024-04-27 03:27:03.074453] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:38.168 [2024-04-27 03:27:03.074465] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:38.168 [2024-04-27 03:27:03.074474] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:38.168 [2024-04-27 03:27:03.074502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:38.425 03:27:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:38.425 03:27:03 -- common/autotest_common.sh@850 -- # return 0 00:15:38.425 03:27:03 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:38.425 03:27:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:38.425 03:27:03 -- common/autotest_common.sh@10 -- # set +x 00:15:38.425 03:27:03 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:38.425 03:27:03 -- target/tls.sh@219 -- # setup_nvmf_tgt /tmp/tmp.AqN4fFpAuw 00:15:38.425 03:27:03 -- target/tls.sh@49 -- # local key=/tmp/tmp.AqN4fFpAuw 00:15:38.425 03:27:03 -- target/tls.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:15:38.683 [2024-04-27 03:27:03.436550] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:38.683 03:27:03 -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:15:38.940 03:27:03 -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:15:39.198 [2024-04-27 03:27:03.921852] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:15:39.198 [2024-04-27 03:27:03.922152] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:39.198 03:27:03 -- target/tls.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:15:39.479 malloc0 00:15:39.479 03:27:04 -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:39.737 03:27:04 -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.AqN4fFpAuw 00:15:39.737 [2024-04-27 03:27:04.696390] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:15:39.994 03:27:04 -- target/tls.sh@222 -- # bdevperf_pid=1458614 00:15:39.994 03:27:04 -- target/tls.sh@224 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:15:39.994 03:27:04 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:15:39.994 03:27:04 -- target/tls.sh@225 -- # waitforlisten 1458614 /var/tmp/bdevperf.sock 00:15:39.994 03:27:04 -- common/autotest_common.sh@817 -- # '[' -z 1458614 ']' 00:15:39.994 03:27:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:39.994 03:27:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:39.994 03:27:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:39.994 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:39.994 03:27:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:39.994 03:27:04 -- common/autotest_common.sh@10 -- # set +x 00:15:39.994 [2024-04-27 03:27:04.760159] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:39.994 [2024-04-27 03:27:04.760231] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1458614 ] 00:15:39.994 EAL: No free 2048 kB hugepages reported on node 1 00:15:39.994 [2024-04-27 03:27:04.821867] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:39.994 [2024-04-27 03:27:04.933622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:40.251 03:27:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:40.251 03:27:05 -- common/autotest_common.sh@850 -- # return 0 00:15:40.251 03:27:05 -- target/tls.sh@227 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.AqN4fFpAuw 00:15:40.508 03:27:05 -- target/tls.sh@228 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:15:40.766 [2024-04-27 03:27:05.601832] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:40.766 nvme0n1 00:15:40.766 03:27:05 -- target/tls.sh@232 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:41.023 Running I/O for 1 seconds... 00:15:41.954 00:15:41.954 Latency(us) 00:15:41.954 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:41.954 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:15:41.954 Verification LBA range: start 0x0 length 0x2000 00:15:41.954 nvme0n1 : 1.03 1830.56 7.15 0.00 0.00 69258.72 9466.31 64079.64 00:15:41.954 =================================================================================================================== 00:15:41.954 Total : 1830.56 7.15 0.00 0.00 69258.72 9466.31 64079.64 00:15:41.954 0 00:15:41.954 03:27:06 -- target/tls.sh@234 -- # killprocess 1458614 00:15:41.954 03:27:06 -- common/autotest_common.sh@936 -- # '[' -z 1458614 ']' 00:15:41.954 03:27:06 -- common/autotest_common.sh@940 -- # kill -0 1458614 00:15:41.954 03:27:06 -- common/autotest_common.sh@941 -- # uname 00:15:41.954 03:27:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:41.954 03:27:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1458614 00:15:41.954 03:27:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:41.954 03:27:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:41.954 03:27:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1458614' 00:15:41.954 killing process with pid 1458614 00:15:41.954 03:27:06 -- common/autotest_common.sh@955 -- # kill 1458614 00:15:41.954 Received shutdown signal, test time was about 1.000000 seconds 00:15:41.954 00:15:41.954 Latency(us) 00:15:41.954 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:41.954 =================================================================================================================== 00:15:41.954 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:41.954 03:27:06 -- common/autotest_common.sh@960 -- # wait 1458614 00:15:42.211 03:27:07 -- target/tls.sh@235 -- # killprocess 1458332 00:15:42.211 03:27:07 -- common/autotest_common.sh@936 -- # '[' -z 1458332 ']' 00:15:42.211 03:27:07 -- common/autotest_common.sh@940 -- # kill -0 1458332 00:15:42.211 03:27:07 -- common/autotest_common.sh@941 -- # uname 00:15:42.211 03:27:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:42.211 03:27:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1458332 00:15:42.211 03:27:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:42.211 03:27:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:42.211 03:27:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1458332' 00:15:42.211 killing process with pid 1458332 00:15:42.211 03:27:07 -- common/autotest_common.sh@955 -- # kill 1458332 00:15:42.211 [2024-04-27 03:27:07.184914] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:15:42.211 03:27:07 -- common/autotest_common.sh@960 -- # wait 1458332 00:15:42.776 03:27:07 -- target/tls.sh@238 -- # nvmfappstart 00:15:42.776 03:27:07 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:42.776 03:27:07 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:42.776 03:27:07 -- common/autotest_common.sh@10 -- # set +x 00:15:42.776 03:27:07 -- nvmf/common.sh@470 -- # nvmfpid=1458998 00:15:42.776 03:27:07 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:15:42.776 03:27:07 -- nvmf/common.sh@471 -- # waitforlisten 1458998 00:15:42.776 03:27:07 -- common/autotest_common.sh@817 -- # '[' -z 1458998 ']' 00:15:42.776 03:27:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:42.776 03:27:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:42.776 03:27:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:42.776 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:42.776 03:27:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:42.776 03:27:07 -- common/autotest_common.sh@10 -- # set +x 00:15:42.776 [2024-04-27 03:27:07.530152] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:42.776 [2024-04-27 03:27:07.530229] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:42.776 EAL: No free 2048 kB hugepages reported on node 1 00:15:42.776 [2024-04-27 03:27:07.593323] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:42.776 [2024-04-27 03:27:07.696169] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:42.776 [2024-04-27 03:27:07.696239] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:42.776 [2024-04-27 03:27:07.696266] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:42.776 [2024-04-27 03:27:07.696278] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:42.776 [2024-04-27 03:27:07.696288] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:42.776 [2024-04-27 03:27:07.696321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:43.035 03:27:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:43.035 03:27:07 -- common/autotest_common.sh@850 -- # return 0 00:15:43.035 03:27:07 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:43.035 03:27:07 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:43.035 03:27:07 -- common/autotest_common.sh@10 -- # set +x 00:15:43.035 03:27:07 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:43.035 03:27:07 -- target/tls.sh@239 -- # rpc_cmd 00:15:43.035 03:27:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:43.035 03:27:07 -- common/autotest_common.sh@10 -- # set +x 00:15:43.035 [2024-04-27 03:27:07.840370] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:43.035 malloc0 00:15:43.035 [2024-04-27 03:27:07.871521] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:15:43.035 [2024-04-27 03:27:07.871808] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:43.035 03:27:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:43.035 03:27:07 -- target/tls.sh@252 -- # bdevperf_pid=1459283 00:15:43.035 03:27:07 -- target/tls.sh@254 -- # waitforlisten 1459283 /var/tmp/bdevperf.sock 00:15:43.035 03:27:07 -- target/tls.sh@250 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:15:43.035 03:27:07 -- common/autotest_common.sh@817 -- # '[' -z 1459283 ']' 00:15:43.035 03:27:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:43.035 03:27:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:43.035 03:27:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:43.035 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:43.035 03:27:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:43.035 03:27:07 -- common/autotest_common.sh@10 -- # set +x 00:15:43.035 [2024-04-27 03:27:07.941952] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:43.035 [2024-04-27 03:27:07.942023] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1459283 ] 00:15:43.035 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.035 [2024-04-27 03:27:08.002983] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:43.293 [2024-04-27 03:27:08.120557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:43.293 03:27:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:43.293 03:27:08 -- common/autotest_common.sh@850 -- # return 0 00:15:43.293 03:27:08 -- target/tls.sh@255 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.AqN4fFpAuw 00:15:43.551 03:27:08 -- target/tls.sh@256 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:15:43.807 [2024-04-27 03:27:08.702252] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:43.807 nvme0n1 00:15:44.064 03:27:08 -- target/tls.sh@260 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:44.064 Running I/O for 1 seconds... 00:15:44.997 00:15:44.997 Latency(us) 00:15:44.997 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:44.997 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:15:44.997 Verification LBA range: start 0x0 length 0x2000 00:15:44.997 nvme0n1 : 1.02 3112.25 12.16 0.00 0.00 40714.14 9029.40 40195.41 00:15:44.997 =================================================================================================================== 00:15:44.997 Total : 3112.25 12.16 0.00 0.00 40714.14 9029.40 40195.41 00:15:44.997 0 00:15:44.997 03:27:09 -- target/tls.sh@263 -- # rpc_cmd save_config 00:15:44.997 03:27:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:44.997 03:27:09 -- common/autotest_common.sh@10 -- # set +x 00:15:45.256 03:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:45.256 03:27:10 -- target/tls.sh@263 -- # tgtcfg='{ 00:15:45.256 "subsystems": [ 00:15:45.256 { 00:15:45.256 "subsystem": "keyring", 00:15:45.256 "config": [ 00:15:45.256 { 00:15:45.256 "method": "keyring_file_add_key", 00:15:45.256 "params": { 00:15:45.256 "name": "key0", 00:15:45.256 "path": "/tmp/tmp.AqN4fFpAuw" 00:15:45.256 } 00:15:45.256 } 00:15:45.256 ] 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "subsystem": "iobuf", 00:15:45.256 "config": [ 00:15:45.256 { 00:15:45.256 "method": "iobuf_set_options", 00:15:45.256 "params": { 00:15:45.256 "small_pool_count": 8192, 00:15:45.256 "large_pool_count": 1024, 00:15:45.256 "small_bufsize": 8192, 00:15:45.256 "large_bufsize": 135168 00:15:45.256 } 00:15:45.256 } 00:15:45.256 ] 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "subsystem": "sock", 00:15:45.256 "config": [ 00:15:45.256 { 00:15:45.256 "method": "sock_impl_set_options", 00:15:45.256 "params": { 00:15:45.256 "impl_name": "posix", 00:15:45.256 "recv_buf_size": 2097152, 00:15:45.256 "send_buf_size": 2097152, 00:15:45.256 "enable_recv_pipe": true, 00:15:45.256 "enable_quickack": false, 00:15:45.256 "enable_placement_id": 0, 00:15:45.256 "enable_zerocopy_send_server": true, 00:15:45.256 "enable_zerocopy_send_client": false, 00:15:45.256 "zerocopy_threshold": 0, 00:15:45.256 "tls_version": 0, 00:15:45.256 "enable_ktls": false 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "sock_impl_set_options", 00:15:45.256 "params": { 00:15:45.256 "impl_name": "ssl", 00:15:45.256 "recv_buf_size": 4096, 00:15:45.256 "send_buf_size": 4096, 00:15:45.256 "enable_recv_pipe": true, 00:15:45.256 "enable_quickack": false, 00:15:45.256 "enable_placement_id": 0, 00:15:45.256 "enable_zerocopy_send_server": true, 00:15:45.256 "enable_zerocopy_send_client": false, 00:15:45.256 "zerocopy_threshold": 0, 00:15:45.256 "tls_version": 0, 00:15:45.256 "enable_ktls": false 00:15:45.256 } 00:15:45.256 } 00:15:45.256 ] 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "subsystem": "vmd", 00:15:45.256 "config": [] 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "subsystem": "accel", 00:15:45.256 "config": [ 00:15:45.256 { 00:15:45.256 "method": "accel_set_options", 00:15:45.256 "params": { 00:15:45.256 "small_cache_size": 128, 00:15:45.256 "large_cache_size": 16, 00:15:45.256 "task_count": 2048, 00:15:45.256 "sequence_count": 2048, 00:15:45.256 "buf_count": 2048 00:15:45.256 } 00:15:45.256 } 00:15:45.256 ] 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "subsystem": "bdev", 00:15:45.256 "config": [ 00:15:45.256 { 00:15:45.256 "method": "bdev_set_options", 00:15:45.256 "params": { 00:15:45.256 "bdev_io_pool_size": 65535, 00:15:45.256 "bdev_io_cache_size": 256, 00:15:45.256 "bdev_auto_examine": true, 00:15:45.256 "iobuf_small_cache_size": 128, 00:15:45.256 "iobuf_large_cache_size": 16 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "bdev_raid_set_options", 00:15:45.256 "params": { 00:15:45.256 "process_window_size_kb": 1024 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "bdev_iscsi_set_options", 00:15:45.256 "params": { 00:15:45.256 "timeout_sec": 30 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "bdev_nvme_set_options", 00:15:45.256 "params": { 00:15:45.256 "action_on_timeout": "none", 00:15:45.256 "timeout_us": 0, 00:15:45.256 "timeout_admin_us": 0, 00:15:45.256 "keep_alive_timeout_ms": 10000, 00:15:45.256 "arbitration_burst": 0, 00:15:45.256 "low_priority_weight": 0, 00:15:45.256 "medium_priority_weight": 0, 00:15:45.256 "high_priority_weight": 0, 00:15:45.256 "nvme_adminq_poll_period_us": 10000, 00:15:45.256 "nvme_ioq_poll_period_us": 0, 00:15:45.256 "io_queue_requests": 0, 00:15:45.256 "delay_cmd_submit": true, 00:15:45.256 "transport_retry_count": 4, 00:15:45.256 "bdev_retry_count": 3, 00:15:45.256 "transport_ack_timeout": 0, 00:15:45.256 "ctrlr_loss_timeout_sec": 0, 00:15:45.256 "reconnect_delay_sec": 0, 00:15:45.256 "fast_io_fail_timeout_sec": 0, 00:15:45.256 "disable_auto_failback": false, 00:15:45.256 "generate_uuids": false, 00:15:45.256 "transport_tos": 0, 00:15:45.256 "nvme_error_stat": false, 00:15:45.256 "rdma_srq_size": 0, 00:15:45.256 "io_path_stat": false, 00:15:45.256 "allow_accel_sequence": false, 00:15:45.256 "rdma_max_cq_size": 0, 00:15:45.256 "rdma_cm_event_timeout_ms": 0, 00:15:45.256 "dhchap_digests": [ 00:15:45.256 "sha256", 00:15:45.256 "sha384", 00:15:45.256 "sha512" 00:15:45.256 ], 00:15:45.256 "dhchap_dhgroups": [ 00:15:45.256 "null", 00:15:45.256 "ffdhe2048", 00:15:45.256 "ffdhe3072", 00:15:45.256 "ffdhe4096", 00:15:45.256 "ffdhe6144", 00:15:45.256 "ffdhe8192" 00:15:45.256 ] 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "bdev_nvme_set_hotplug", 00:15:45.256 "params": { 00:15:45.256 "period_us": 100000, 00:15:45.256 "enable": false 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "bdev_malloc_create", 00:15:45.256 "params": { 00:15:45.256 "name": "malloc0", 00:15:45.256 "num_blocks": 8192, 00:15:45.256 "block_size": 4096, 00:15:45.256 "physical_block_size": 4096, 00:15:45.256 "uuid": "71c3abd4-20e8-4056-a058-1b5fb754911a", 00:15:45.256 "optimal_io_boundary": 0 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "bdev_wait_for_examine" 00:15:45.256 } 00:15:45.256 ] 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "subsystem": "nbd", 00:15:45.256 "config": [] 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "subsystem": "scheduler", 00:15:45.256 "config": [ 00:15:45.256 { 00:15:45.256 "method": "framework_set_scheduler", 00:15:45.256 "params": { 00:15:45.256 "name": "static" 00:15:45.256 } 00:15:45.256 } 00:15:45.256 ] 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "subsystem": "nvmf", 00:15:45.256 "config": [ 00:15:45.256 { 00:15:45.256 "method": "nvmf_set_config", 00:15:45.256 "params": { 00:15:45.256 "discovery_filter": "match_any", 00:15:45.256 "admin_cmd_passthru": { 00:15:45.256 "identify_ctrlr": false 00:15:45.256 } 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "nvmf_set_max_subsystems", 00:15:45.256 "params": { 00:15:45.256 "max_subsystems": 1024 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "nvmf_set_crdt", 00:15:45.256 "params": { 00:15:45.256 "crdt1": 0, 00:15:45.256 "crdt2": 0, 00:15:45.256 "crdt3": 0 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "nvmf_create_transport", 00:15:45.256 "params": { 00:15:45.256 "trtype": "TCP", 00:15:45.256 "max_queue_depth": 128, 00:15:45.256 "max_io_qpairs_per_ctrlr": 127, 00:15:45.256 "in_capsule_data_size": 4096, 00:15:45.256 "max_io_size": 131072, 00:15:45.256 "io_unit_size": 131072, 00:15:45.256 "max_aq_depth": 128, 00:15:45.256 "num_shared_buffers": 511, 00:15:45.256 "buf_cache_size": 4294967295, 00:15:45.256 "dif_insert_or_strip": false, 00:15:45.256 "zcopy": false, 00:15:45.256 "c2h_success": false, 00:15:45.256 "sock_priority": 0, 00:15:45.256 "abort_timeout_sec": 1, 00:15:45.256 "ack_timeout": 0, 00:15:45.256 "data_wr_pool_size": 0 00:15:45.256 } 00:15:45.256 }, 00:15:45.256 { 00:15:45.256 "method": "nvmf_create_subsystem", 00:15:45.256 "params": { 00:15:45.256 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:45.256 "allow_any_host": false, 00:15:45.256 "serial_number": "00000000000000000000", 00:15:45.256 "model_number": "SPDK bdev Controller", 00:15:45.256 "max_namespaces": 32, 00:15:45.257 "min_cntlid": 1, 00:15:45.257 "max_cntlid": 65519, 00:15:45.257 "ana_reporting": false 00:15:45.257 } 00:15:45.257 }, 00:15:45.257 { 00:15:45.257 "method": "nvmf_subsystem_add_host", 00:15:45.257 "params": { 00:15:45.257 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:45.257 "host": "nqn.2016-06.io.spdk:host1", 00:15:45.257 "psk": "key0" 00:15:45.257 } 00:15:45.257 }, 00:15:45.257 { 00:15:45.257 "method": "nvmf_subsystem_add_ns", 00:15:45.257 "params": { 00:15:45.257 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:45.257 "namespace": { 00:15:45.257 "nsid": 1, 00:15:45.257 "bdev_name": "malloc0", 00:15:45.257 "nguid": "71C3ABD420E84056A0581B5FB754911A", 00:15:45.257 "uuid": "71c3abd4-20e8-4056-a058-1b5fb754911a", 00:15:45.257 "no_auto_visible": false 00:15:45.257 } 00:15:45.257 } 00:15:45.257 }, 00:15:45.257 { 00:15:45.257 "method": "nvmf_subsystem_add_listener", 00:15:45.257 "params": { 00:15:45.257 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:45.257 "listen_address": { 00:15:45.257 "trtype": "TCP", 00:15:45.257 "adrfam": "IPv4", 00:15:45.257 "traddr": "10.0.0.2", 00:15:45.257 "trsvcid": "4420" 00:15:45.257 }, 00:15:45.257 "secure_channel": true 00:15:45.257 } 00:15:45.257 } 00:15:45.257 ] 00:15:45.257 } 00:15:45.257 ] 00:15:45.257 }' 00:15:45.257 03:27:10 -- target/tls.sh@264 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:15:45.515 03:27:10 -- target/tls.sh@264 -- # bperfcfg='{ 00:15:45.515 "subsystems": [ 00:15:45.515 { 00:15:45.515 "subsystem": "keyring", 00:15:45.515 "config": [ 00:15:45.515 { 00:15:45.515 "method": "keyring_file_add_key", 00:15:45.515 "params": { 00:15:45.515 "name": "key0", 00:15:45.515 "path": "/tmp/tmp.AqN4fFpAuw" 00:15:45.515 } 00:15:45.515 } 00:15:45.515 ] 00:15:45.515 }, 00:15:45.515 { 00:15:45.515 "subsystem": "iobuf", 00:15:45.515 "config": [ 00:15:45.515 { 00:15:45.515 "method": "iobuf_set_options", 00:15:45.515 "params": { 00:15:45.515 "small_pool_count": 8192, 00:15:45.515 "large_pool_count": 1024, 00:15:45.515 "small_bufsize": 8192, 00:15:45.515 "large_bufsize": 135168 00:15:45.515 } 00:15:45.515 } 00:15:45.515 ] 00:15:45.515 }, 00:15:45.515 { 00:15:45.515 "subsystem": "sock", 00:15:45.515 "config": [ 00:15:45.515 { 00:15:45.515 "method": "sock_impl_set_options", 00:15:45.515 "params": { 00:15:45.515 "impl_name": "posix", 00:15:45.515 "recv_buf_size": 2097152, 00:15:45.515 "send_buf_size": 2097152, 00:15:45.515 "enable_recv_pipe": true, 00:15:45.515 "enable_quickack": false, 00:15:45.515 "enable_placement_id": 0, 00:15:45.515 "enable_zerocopy_send_server": true, 00:15:45.515 "enable_zerocopy_send_client": false, 00:15:45.515 "zerocopy_threshold": 0, 00:15:45.515 "tls_version": 0, 00:15:45.515 "enable_ktls": false 00:15:45.515 } 00:15:45.515 }, 00:15:45.515 { 00:15:45.515 "method": "sock_impl_set_options", 00:15:45.515 "params": { 00:15:45.515 "impl_name": "ssl", 00:15:45.515 "recv_buf_size": 4096, 00:15:45.515 "send_buf_size": 4096, 00:15:45.515 "enable_recv_pipe": true, 00:15:45.515 "enable_quickack": false, 00:15:45.515 "enable_placement_id": 0, 00:15:45.515 "enable_zerocopy_send_server": true, 00:15:45.515 "enable_zerocopy_send_client": false, 00:15:45.515 "zerocopy_threshold": 0, 00:15:45.515 "tls_version": 0, 00:15:45.515 "enable_ktls": false 00:15:45.515 } 00:15:45.515 } 00:15:45.515 ] 00:15:45.515 }, 00:15:45.515 { 00:15:45.515 "subsystem": "vmd", 00:15:45.515 "config": [] 00:15:45.515 }, 00:15:45.515 { 00:15:45.515 "subsystem": "accel", 00:15:45.515 "config": [ 00:15:45.515 { 00:15:45.515 "method": "accel_set_options", 00:15:45.515 "params": { 00:15:45.515 "small_cache_size": 128, 00:15:45.515 "large_cache_size": 16, 00:15:45.515 "task_count": 2048, 00:15:45.515 "sequence_count": 2048, 00:15:45.515 "buf_count": 2048 00:15:45.515 } 00:15:45.515 } 00:15:45.515 ] 00:15:45.515 }, 00:15:45.515 { 00:15:45.515 "subsystem": "bdev", 00:15:45.515 "config": [ 00:15:45.515 { 00:15:45.515 "method": "bdev_set_options", 00:15:45.515 "params": { 00:15:45.515 "bdev_io_pool_size": 65535, 00:15:45.515 "bdev_io_cache_size": 256, 00:15:45.515 "bdev_auto_examine": true, 00:15:45.516 "iobuf_small_cache_size": 128, 00:15:45.516 "iobuf_large_cache_size": 16 00:15:45.516 } 00:15:45.516 }, 00:15:45.516 { 00:15:45.516 "method": "bdev_raid_set_options", 00:15:45.516 "params": { 00:15:45.516 "process_window_size_kb": 1024 00:15:45.516 } 00:15:45.516 }, 00:15:45.516 { 00:15:45.516 "method": "bdev_iscsi_set_options", 00:15:45.516 "params": { 00:15:45.516 "timeout_sec": 30 00:15:45.516 } 00:15:45.516 }, 00:15:45.516 { 00:15:45.516 "method": "bdev_nvme_set_options", 00:15:45.516 "params": { 00:15:45.516 "action_on_timeout": "none", 00:15:45.516 "timeout_us": 0, 00:15:45.516 "timeout_admin_us": 0, 00:15:45.516 "keep_alive_timeout_ms": 10000, 00:15:45.516 "arbitration_burst": 0, 00:15:45.516 "low_priority_weight": 0, 00:15:45.516 "medium_priority_weight": 0, 00:15:45.516 "high_priority_weight": 0, 00:15:45.516 "nvme_adminq_poll_period_us": 10000, 00:15:45.516 "nvme_ioq_poll_period_us": 0, 00:15:45.516 "io_queue_requests": 512, 00:15:45.516 "delay_cmd_submit": true, 00:15:45.516 "transport_retry_count": 4, 00:15:45.516 "bdev_retry_count": 3, 00:15:45.516 "transport_ack_timeout": 0, 00:15:45.516 "ctrlr_loss_timeout_sec": 0, 00:15:45.516 "reconnect_delay_sec": 0, 00:15:45.516 "fast_io_fail_timeout_sec": 0, 00:15:45.516 "disable_auto_failback": false, 00:15:45.516 "generate_uuids": false, 00:15:45.516 "transport_tos": 0, 00:15:45.516 "nvme_error_stat": false, 00:15:45.516 "rdma_srq_size": 0, 00:15:45.516 "io_path_stat": false, 00:15:45.516 "allow_accel_sequence": false, 00:15:45.516 "rdma_max_cq_size": 0, 00:15:45.516 "rdma_cm_event_timeout_ms": 0, 00:15:45.516 "dhchap_digests": [ 00:15:45.516 "sha256", 00:15:45.516 "sha384", 00:15:45.516 "sha512" 00:15:45.516 ], 00:15:45.516 "dhchap_dhgroups": [ 00:15:45.516 "null", 00:15:45.516 "ffdhe2048", 00:15:45.516 "ffdhe3072", 00:15:45.516 "ffdhe4096", 00:15:45.516 "ffdhe6144", 00:15:45.516 "ffdhe8192" 00:15:45.516 ] 00:15:45.516 } 00:15:45.516 }, 00:15:45.516 { 00:15:45.516 "method": "bdev_nvme_attach_controller", 00:15:45.516 "params": { 00:15:45.516 "name": "nvme0", 00:15:45.516 "trtype": "TCP", 00:15:45.516 "adrfam": "IPv4", 00:15:45.516 "traddr": "10.0.0.2", 00:15:45.516 "trsvcid": "4420", 00:15:45.516 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:45.516 "prchk_reftag": false, 00:15:45.516 "prchk_guard": false, 00:15:45.516 "ctrlr_loss_timeout_sec": 0, 00:15:45.516 "reconnect_delay_sec": 0, 00:15:45.516 "fast_io_fail_timeout_sec": 0, 00:15:45.516 "psk": "key0", 00:15:45.516 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:45.516 "hdgst": false, 00:15:45.516 "ddgst": false 00:15:45.516 } 00:15:45.516 }, 00:15:45.516 { 00:15:45.516 "method": "bdev_nvme_set_hotplug", 00:15:45.516 "params": { 00:15:45.516 "period_us": 100000, 00:15:45.516 "enable": false 00:15:45.516 } 00:15:45.516 }, 00:15:45.516 { 00:15:45.516 "method": "bdev_enable_histogram", 00:15:45.516 "params": { 00:15:45.516 "name": "nvme0n1", 00:15:45.516 "enable": true 00:15:45.516 } 00:15:45.516 }, 00:15:45.516 { 00:15:45.516 "method": "bdev_wait_for_examine" 00:15:45.516 } 00:15:45.516 ] 00:15:45.516 }, 00:15:45.516 { 00:15:45.516 "subsystem": "nbd", 00:15:45.516 "config": [] 00:15:45.516 } 00:15:45.516 ] 00:15:45.516 }' 00:15:45.516 03:27:10 -- target/tls.sh@266 -- # killprocess 1459283 00:15:45.516 03:27:10 -- common/autotest_common.sh@936 -- # '[' -z 1459283 ']' 00:15:45.516 03:27:10 -- common/autotest_common.sh@940 -- # kill -0 1459283 00:15:45.516 03:27:10 -- common/autotest_common.sh@941 -- # uname 00:15:45.516 03:27:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:45.516 03:27:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1459283 00:15:45.516 03:27:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:45.516 03:27:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:45.516 03:27:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1459283' 00:15:45.516 killing process with pid 1459283 00:15:45.516 03:27:10 -- common/autotest_common.sh@955 -- # kill 1459283 00:15:45.516 Received shutdown signal, test time was about 1.000000 seconds 00:15:45.516 00:15:45.516 Latency(us) 00:15:45.516 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:45.516 =================================================================================================================== 00:15:45.516 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:45.516 03:27:10 -- common/autotest_common.sh@960 -- # wait 1459283 00:15:45.778 03:27:10 -- target/tls.sh@267 -- # killprocess 1458998 00:15:45.778 03:27:10 -- common/autotest_common.sh@936 -- # '[' -z 1458998 ']' 00:15:45.778 03:27:10 -- common/autotest_common.sh@940 -- # kill -0 1458998 00:15:45.778 03:27:10 -- common/autotest_common.sh@941 -- # uname 00:15:45.778 03:27:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:45.778 03:27:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1458998 00:15:45.778 03:27:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:45.778 03:27:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:45.778 03:27:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1458998' 00:15:45.778 killing process with pid 1458998 00:15:45.778 03:27:10 -- common/autotest_common.sh@955 -- # kill 1458998 00:15:45.778 03:27:10 -- common/autotest_common.sh@960 -- # wait 1458998 00:15:46.043 03:27:10 -- target/tls.sh@269 -- # nvmfappstart -c /dev/fd/62 00:15:46.043 03:27:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:46.043 03:27:10 -- target/tls.sh@269 -- # echo '{ 00:15:46.043 "subsystems": [ 00:15:46.043 { 00:15:46.043 "subsystem": "keyring", 00:15:46.043 "config": [ 00:15:46.043 { 00:15:46.043 "method": "keyring_file_add_key", 00:15:46.043 "params": { 00:15:46.043 "name": "key0", 00:15:46.043 "path": "/tmp/tmp.AqN4fFpAuw" 00:15:46.043 } 00:15:46.043 } 00:15:46.043 ] 00:15:46.043 }, 00:15:46.043 { 00:15:46.043 "subsystem": "iobuf", 00:15:46.043 "config": [ 00:15:46.043 { 00:15:46.043 "method": "iobuf_set_options", 00:15:46.043 "params": { 00:15:46.043 "small_pool_count": 8192, 00:15:46.043 "large_pool_count": 1024, 00:15:46.043 "small_bufsize": 8192, 00:15:46.043 "large_bufsize": 135168 00:15:46.043 } 00:15:46.043 } 00:15:46.043 ] 00:15:46.043 }, 00:15:46.043 { 00:15:46.043 "subsystem": "sock", 00:15:46.043 "config": [ 00:15:46.043 { 00:15:46.043 "method": "sock_impl_set_options", 00:15:46.043 "params": { 00:15:46.043 "impl_name": "posix", 00:15:46.043 "recv_buf_size": 2097152, 00:15:46.043 "send_buf_size": 2097152, 00:15:46.043 "enable_recv_pipe": true, 00:15:46.043 "enable_quickack": false, 00:15:46.043 "enable_placement_id": 0, 00:15:46.043 "enable_zerocopy_send_server": true, 00:15:46.043 "enable_zerocopy_send_client": false, 00:15:46.043 "zerocopy_threshold": 0, 00:15:46.043 "tls_version": 0, 00:15:46.043 "enable_ktls": false 00:15:46.043 } 00:15:46.043 }, 00:15:46.043 { 00:15:46.043 "method": "sock_impl_set_options", 00:15:46.043 "params": { 00:15:46.043 "impl_name": "ssl", 00:15:46.043 "recv_buf_size": 4096, 00:15:46.043 "send_buf_size": 4096, 00:15:46.043 "enable_recv_pipe": true, 00:15:46.043 "enable_quickack": false, 00:15:46.043 "enable_placement_id": 0, 00:15:46.043 "enable_zerocopy_send_server": true, 00:15:46.043 "enable_zerocopy_send_client": false, 00:15:46.043 "zerocopy_threshold": 0, 00:15:46.043 "tls_version": 0, 00:15:46.043 "enable_ktls": false 00:15:46.043 } 00:15:46.043 } 00:15:46.043 ] 00:15:46.043 }, 00:15:46.043 { 00:15:46.043 "subsystem": "vmd", 00:15:46.043 "config": [] 00:15:46.043 }, 00:15:46.043 { 00:15:46.043 "subsystem": "accel", 00:15:46.043 "config": [ 00:15:46.043 { 00:15:46.043 "method": "accel_set_options", 00:15:46.043 "params": { 00:15:46.043 "small_cache_size": 128, 00:15:46.043 "large_cache_size": 16, 00:15:46.043 "task_count": 2048, 00:15:46.043 "sequence_count": 2048, 00:15:46.043 "buf_count": 2048 00:15:46.043 } 00:15:46.043 } 00:15:46.043 ] 00:15:46.043 }, 00:15:46.043 { 00:15:46.043 "subsystem": "bdev", 00:15:46.043 "config": [ 00:15:46.043 { 00:15:46.043 "method": "bdev_set_options", 00:15:46.043 "params": { 00:15:46.043 "bdev_io_pool_size": 65535, 00:15:46.043 "bdev_io_cache_size": 256, 00:15:46.043 "bdev_auto_examine": true, 00:15:46.043 "iobuf_small_cache_size": 128, 00:15:46.043 "iobuf_large_cache_size": 16 00:15:46.043 } 00:15:46.043 }, 00:15:46.043 { 00:15:46.043 "method": "bdev_raid_set_options", 00:15:46.043 "params": { 00:15:46.043 "process_window_size_kb": 1024 00:15:46.043 } 00:15:46.043 }, 00:15:46.043 { 00:15:46.043 "method": "bdev_iscsi_set_options", 00:15:46.043 "params": { 00:15:46.043 "timeout_sec": 30 00:15:46.043 } 00:15:46.043 }, 00:15:46.043 { 00:15:46.043 "method": "bdev_nvme_set_options", 00:15:46.043 "params": { 00:15:46.043 "action_on_timeout": "none", 00:15:46.044 "timeout_us": 0, 00:15:46.044 "timeout_admin_us": 0, 00:15:46.044 "keep_alive_timeout_ms": 10000, 00:15:46.044 "arbitration_burst": 0, 00:15:46.044 "low_priority_weight": 0, 00:15:46.044 "medium_priority_weight": 0, 00:15:46.044 "high_priority_weight": 0, 00:15:46.044 "nvme_adminq_poll_period_us": 10000, 00:15:46.044 "nvme_ioq_poll_period_us": 0, 00:15:46.044 "io_queue_requests": 0, 00:15:46.044 "delay_cmd_submit": true, 00:15:46.044 "transport_retry_count": 4, 00:15:46.044 "bdev_retry_count": 3, 00:15:46.044 "transport_ack_timeout": 0, 00:15:46.044 "ctrlr_loss_timeout_sec": 0, 00:15:46.044 "reconnect_delay_sec": 0, 00:15:46.044 "fast_io_fail_timeout_sec": 0, 00:15:46.044 "disable_auto_failback": false, 00:15:46.044 "generate_uuids": false, 00:15:46.044 "transport_tos": 0, 00:15:46.044 "nvme_error_stat": false, 00:15:46.044 "rdma_srq_size": 0, 00:15:46.044 "io_path_stat": false, 00:15:46.044 "allow_accel_sequence": false, 00:15:46.044 "rdma_max_cq_size": 0, 00:15:46.044 "rdma_cm_event_timeout_ms": 0, 00:15:46.044 "dhchap_digests": [ 00:15:46.044 "sha256", 00:15:46.044 "sha384", 00:15:46.044 "sha512" 00:15:46.044 ], 00:15:46.044 "dhchap_dhgroups": [ 00:15:46.044 "null", 00:15:46.044 "ffdhe2048", 00:15:46.044 "ffdhe3072", 00:15:46.044 "ffdhe4096", 00:15:46.044 "ffdhe6144", 00:15:46.044 "ffdhe8192" 00:15:46.044 ] 00:15:46.044 } 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "method": "bdev_nvme_set_hotplug", 00:15:46.044 "params": { 00:15:46.044 "period_us": 100000, 00:15:46.044 "enable": false 00:15:46.044 } 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "method": "bdev_malloc_create", 00:15:46.044 "params": { 00:15:46.044 "name": "malloc0", 00:15:46.044 "num_blocks": 8192, 00:15:46.044 "block_size": 4096, 00:15:46.044 "physical_block_size": 4096, 00:15:46.044 "uuid": "71c3abd4-20e8-4056-a058-1b5fb754911a", 00:15:46.044 "optimal_io_boundary": 0 00:15:46.044 } 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "method": "bdev_wait_for_examine" 00:15:46.044 } 00:15:46.044 ] 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "subsystem": "nbd", 00:15:46.044 "config": [] 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "subsystem": "scheduler", 00:15:46.044 "config": [ 00:15:46.044 { 00:15:46.044 "method": "framework_set_scheduler", 00:15:46.044 "params": { 00:15:46.044 "name": "static" 00:15:46.044 } 00:15:46.044 } 00:15:46.044 ] 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "subsystem": "nvmf", 00:15:46.044 "config": [ 00:15:46.044 { 00:15:46.044 "method": "nvmf_set_config", 00:15:46.044 "params": { 00:15:46.044 "discovery_filter": "match_any", 00:15:46.044 "admin_cmd_passthru": { 00:15:46.044 "identify_ctrlr": false 00:15:46.044 } 00:15:46.044 } 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "method": "nvmf_set_max_subsystems", 00:15:46.044 "params": { 00:15:46.044 "max_subsystems": 1024 00:15:46.044 } 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "method": "nvmf_set_crdt", 00:15:46.044 "params": { 00:15:46.044 "crdt1": 0, 00:15:46.044 "crdt2": 0, 00:15:46.044 "crdt3": 0 00:15:46.044 } 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "method": "nvmf_create_transport", 00:15:46.044 "params": { 00:15:46.044 "trtype": "TCP", 00:15:46.044 "max_queue_depth": 128, 00:15:46.044 "max_io_qpairs_per_ctrlr": 127, 00:15:46.044 "in_capsule_data_size": 4096, 00:15:46.044 "max_io_size": 131072, 00:15:46.044 "io_unit_size": 131072, 00:15:46.044 "max_aq_depth": 128, 00:15:46.044 "num_shared_buffers": 511, 00:15:46.044 "buf_cache_size": 4294967295, 00:15:46.044 "dif_insert_or_strip": false, 00:15:46.044 "zcopy": false, 00:15:46.044 "c2h_success": false, 00:15:46.044 "sock_priority": 0, 00:15:46.044 "abort_timeout_sec": 1, 00:15:46.044 "ack_timeout": 0, 00:15:46.044 "data_wr_pool_size": 0 00:15:46.044 } 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "method": "nvmf_create_subsystem", 00:15:46.044 "params": { 00:15:46.044 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:46.044 "allow_any_host": false, 00:15:46.044 "serial_number": "00000000000000000000", 00:15:46.044 "model_number": "SPDK bdev Controller", 00:15:46.044 "max_namespaces": 32, 00:15:46.044 "min_cntlid": 1, 00:15:46.044 "max_cntlid": 65519, 00:15:46.044 "ana_reporting": false 00:15:46.044 } 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "method": "nvmf_subsystem_add_host", 00:15:46.044 "params": { 00:15:46.044 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:46.044 "host": "nqn.2016-06.io.spdk:host1", 00:15:46.044 "psk": "key0" 00:15:46.044 } 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "method": "nvmf_subsystem_add_ns", 00:15:46.044 "params": { 00:15:46.044 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:46.044 "namespace": { 00:15:46.044 "nsid": 1, 00:15:46.044 "bdev_name": "malloc0", 00:15:46.044 "nguid": "71C3ABD420E84056A0581B5FB754911A", 00:15:46.044 "uuid": "71c3abd4-20e8-4056-a058-1b5fb754911a", 00:15:46.044 "no_auto_visible": false 00:15:46.044 } 00:15:46.044 } 00:15:46.044 }, 00:15:46.044 { 00:15:46.044 "method": "nvmf_subsystem_add_listener", 00:15:46.044 "params": { 00:15:46.044 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:46.044 "listen_address": { 00:15:46.044 "trtype": "TCP", 00:15:46.044 "adrfam": "IPv4", 00:15:46.044 "traddr": "10.0.0.2", 00:15:46.044 "trsvcid": "4420" 00:15:46.044 }, 00:15:46.044 "secure_channel": true 00:15:46.044 } 00:15:46.044 } 00:15:46.044 ] 00:15:46.044 } 00:15:46.044 ] 00:15:46.044 }' 00:15:46.044 03:27:10 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:46.044 03:27:10 -- common/autotest_common.sh@10 -- # set +x 00:15:46.044 03:27:10 -- nvmf/common.sh@470 -- # nvmfpid=1459838 00:15:46.044 03:27:10 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -c /dev/fd/62 00:15:46.044 03:27:10 -- nvmf/common.sh@471 -- # waitforlisten 1459838 00:15:46.044 03:27:10 -- common/autotest_common.sh@817 -- # '[' -z 1459838 ']' 00:15:46.044 03:27:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:46.044 03:27:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:46.044 03:27:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:46.044 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:46.044 03:27:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:46.044 03:27:10 -- common/autotest_common.sh@10 -- # set +x 00:15:46.304 [2024-04-27 03:27:11.020897] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:46.304 [2024-04-27 03:27:11.020974] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:46.304 EAL: No free 2048 kB hugepages reported on node 1 00:15:46.304 [2024-04-27 03:27:11.087373] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:46.304 [2024-04-27 03:27:11.203369] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:46.304 [2024-04-27 03:27:11.203432] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:46.304 [2024-04-27 03:27:11.203448] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:46.304 [2024-04-27 03:27:11.203462] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:46.304 [2024-04-27 03:27:11.203474] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:46.304 [2024-04-27 03:27:11.203575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:46.562 [2024-04-27 03:27:11.443960] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:46.562 [2024-04-27 03:27:11.475967] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:15:46.562 [2024-04-27 03:27:11.494455] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:47.129 03:27:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:47.129 03:27:12 -- common/autotest_common.sh@850 -- # return 0 00:15:47.129 03:27:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:47.129 03:27:12 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:47.129 03:27:12 -- common/autotest_common.sh@10 -- # set +x 00:15:47.129 03:27:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:47.129 03:27:12 -- target/tls.sh@272 -- # bdevperf_pid=1459989 00:15:47.129 03:27:12 -- target/tls.sh@273 -- # waitforlisten 1459989 /var/tmp/bdevperf.sock 00:15:47.129 03:27:12 -- common/autotest_common.sh@817 -- # '[' -z 1459989 ']' 00:15:47.129 03:27:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:47.129 03:27:12 -- target/tls.sh@270 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 -c /dev/fd/63 00:15:47.129 03:27:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:47.129 03:27:12 -- target/tls.sh@270 -- # echo '{ 00:15:47.129 "subsystems": [ 00:15:47.129 { 00:15:47.129 "subsystem": "keyring", 00:15:47.129 "config": [ 00:15:47.129 { 00:15:47.129 "method": "keyring_file_add_key", 00:15:47.129 "params": { 00:15:47.129 "name": "key0", 00:15:47.129 "path": "/tmp/tmp.AqN4fFpAuw" 00:15:47.129 } 00:15:47.129 } 00:15:47.129 ] 00:15:47.129 }, 00:15:47.129 { 00:15:47.129 "subsystem": "iobuf", 00:15:47.129 "config": [ 00:15:47.129 { 00:15:47.129 "method": "iobuf_set_options", 00:15:47.129 "params": { 00:15:47.129 "small_pool_count": 8192, 00:15:47.129 "large_pool_count": 1024, 00:15:47.129 "small_bufsize": 8192, 00:15:47.129 "large_bufsize": 135168 00:15:47.129 } 00:15:47.129 } 00:15:47.129 ] 00:15:47.129 }, 00:15:47.129 { 00:15:47.129 "subsystem": "sock", 00:15:47.129 "config": [ 00:15:47.129 { 00:15:47.129 "method": "sock_impl_set_options", 00:15:47.129 "params": { 00:15:47.129 "impl_name": "posix", 00:15:47.129 "recv_buf_size": 2097152, 00:15:47.129 "send_buf_size": 2097152, 00:15:47.129 "enable_recv_pipe": true, 00:15:47.129 "enable_quickack": false, 00:15:47.129 "enable_placement_id": 0, 00:15:47.129 "enable_zerocopy_send_server": true, 00:15:47.129 "enable_zerocopy_send_client": false, 00:15:47.129 "zerocopy_threshold": 0, 00:15:47.129 "tls_version": 0, 00:15:47.129 "enable_ktls": false 00:15:47.129 } 00:15:47.129 }, 00:15:47.129 { 00:15:47.129 "method": "sock_impl_set_options", 00:15:47.129 "params": { 00:15:47.129 "impl_name": "ssl", 00:15:47.129 "recv_buf_size": 4096, 00:15:47.129 "send_buf_size": 4096, 00:15:47.129 "enable_recv_pipe": true, 00:15:47.129 "enable_quickack": false, 00:15:47.129 "enable_placement_id": 0, 00:15:47.129 "enable_zerocopy_send_server": true, 00:15:47.129 "enable_zerocopy_send_client": false, 00:15:47.129 "zerocopy_threshold": 0, 00:15:47.129 "tls_version": 0, 00:15:47.129 "enable_ktls": false 00:15:47.129 } 00:15:47.129 } 00:15:47.129 ] 00:15:47.129 }, 00:15:47.129 { 00:15:47.129 "subsystem": "vmd", 00:15:47.129 "config": [] 00:15:47.129 }, 00:15:47.129 { 00:15:47.129 "subsystem": "accel", 00:15:47.129 "config": [ 00:15:47.129 { 00:15:47.129 "method": "accel_set_options", 00:15:47.129 "params": { 00:15:47.129 "small_cache_size": 128, 00:15:47.129 "large_cache_size": 16, 00:15:47.129 "task_count": 2048, 00:15:47.129 "sequence_count": 2048, 00:15:47.129 "buf_count": 2048 00:15:47.129 } 00:15:47.129 } 00:15:47.129 ] 00:15:47.129 }, 00:15:47.129 { 00:15:47.129 "subsystem": "bdev", 00:15:47.129 "config": [ 00:15:47.129 { 00:15:47.129 "method": "bdev_set_options", 00:15:47.129 "params": { 00:15:47.129 "bdev_io_pool_size": 65535, 00:15:47.129 "bdev_io_cache_size": 256, 00:15:47.129 "bdev_auto_examine": true, 00:15:47.129 "iobuf_small_cache_size": 128, 00:15:47.129 "iobuf_large_cache_size": 16 00:15:47.129 } 00:15:47.129 }, 00:15:47.129 { 00:15:47.129 "method": "bdev_raid_set_options", 00:15:47.129 "params": { 00:15:47.129 "process_window_size_kb": 1024 00:15:47.129 } 00:15:47.129 }, 00:15:47.129 { 00:15:47.129 "method": "bdev_iscsi_set_options", 00:15:47.129 "params": { 00:15:47.129 "timeout_sec": 30 00:15:47.129 } 00:15:47.129 }, 00:15:47.129 { 00:15:47.129 "method": "bdev_nvme_set_options", 00:15:47.129 "params": { 00:15:47.129 "action_on_timeout": "none", 00:15:47.129 "timeout_us": 0, 00:15:47.129 "timeout_admin_us": 0, 00:15:47.129 "keep_alive_timeout_ms": 10000, 00:15:47.129 "arbitration_burst": 0, 00:15:47.129 "low_priority_weight": 0, 00:15:47.129 "medium_priority_weight": 0, 00:15:47.129 "high_priority_weight": 0, 00:15:47.129 "nvme_adminq_poll_period_us": 10000, 00:15:47.129 "nvme_ioq_poll_period_us": 0, 00:15:47.129 "io_queue_requests": 512, 00:15:47.129 "delay_cmd_submit": true, 00:15:47.129 "transport_retry_count": 4, 00:15:47.129 "bdev_retry_count": 3, 00:15:47.129 "transport_ack_timeout": 0, 00:15:47.129 "ctrlr_loss_timeout_sec": 0, 00:15:47.129 "reconnect_delay_sec": 0, 00:15:47.129 "fast_io_fail_timeout_sec": 0, 00:15:47.129 "disable_auto_failback": false, 00:15:47.129 "generate_uuids": false, 00:15:47.129 "transport_tos": 0, 00:15:47.129 "nvme_error_stat": false, 00:15:47.129 "rdma_srq_size": 0, 00:15:47.129 "io_path_stat": false, 00:15:47.129 "allow_accel_sequence": false, 00:15:47.129 "rdma_max_cq_size": 0, 00:15:47.129 "rdma_cm_event_timeout_ms": 0, 00:15:47.129 "dhchap_digests": [ 00:15:47.129 "sha256", 00:15:47.129 "sha384", 00:15:47.129 "sha512" 00:15:47.129 ], 00:15:47.129 "dhchap_dhgroups": [ 00:15:47.129 "null", 00:15:47.129 "ffdhe2048", 00:15:47.129 "ffdhe3072", 00:15:47.129 "ffdhe4 03:27:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:47.129 096", 00:15:47.129 "ffdhe6144", 00:15:47.129 "ffdhe8192" 00:15:47.129 ] 00:15:47.129 } 00:15:47.129 }, 00:15:47.129 { 00:15:47.129 "method": "bdev_nvme_attach_controller", 00:15:47.129 "params": { 00:15:47.129 "name": "nvme0", 00:15:47.129 "trtype": "TCP", 00:15:47.129 "adrfam": "IPv4", 00:15:47.129 "traddr": "10.0.0.2", 00:15:47.129 "trsvcid": "4420", 00:15:47.129 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:47.129 "prchk_reftag": false, 00:15:47.129 "prchk_guard": false, 00:15:47.129 "ctrlr_loss_timeout_sec": 0, 00:15:47.129 "reconnect_delay_sec": 0, 00:15:47.130 "fast_io_fail_timeout_sec": 0, 00:15:47.130 "psk": "key0", 00:15:47.130 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:47.130 "hdgst": false, 00:15:47.130 "ddgst": false 00:15:47.130 } 00:15:47.130 }, 00:15:47.130 { 00:15:47.130 "method": "bdev_nvme_set_hotplug", 00:15:47.130 "params": { 00:15:47.130 "period_us": 100000, 00:15:47.130 "enable": false 00:15:47.130 } 00:15:47.130 }, 00:15:47.130 { 00:15:47.130 "method": "bdev_enable_histogram", 00:15:47.130 "params": { 00:15:47.130 "name": "nvme0n1", 00:15:47.130 "enable": true 00:15:47.130 } 00:15:47.130 }, 00:15:47.130 { 00:15:47.130 "method": "bdev_wait_for_examine" 00:15:47.130 } 00:15:47.130 ] 00:15:47.130 }, 00:15:47.130 { 00:15:47.130 "subsystem": "nbd", 00:15:47.130 "config": [] 00:15:47.130 } 00:15:47.130 ] 00:15:47.130 }' 00:15:47.130 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:47.130 03:27:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:47.130 03:27:12 -- common/autotest_common.sh@10 -- # set +x 00:15:47.130 [2024-04-27 03:27:12.080692] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:47.130 [2024-04-27 03:27:12.080762] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1459989 ] 00:15:47.390 EAL: No free 2048 kB hugepages reported on node 1 00:15:47.390 [2024-04-27 03:27:12.142632] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:47.390 [2024-04-27 03:27:12.258239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:47.648 [2024-04-27 03:27:12.437860] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:48.214 03:27:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:48.214 03:27:13 -- common/autotest_common.sh@850 -- # return 0 00:15:48.214 03:27:13 -- target/tls.sh@275 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:15:48.214 03:27:13 -- target/tls.sh@275 -- # jq -r '.[].name' 00:15:48.486 03:27:13 -- target/tls.sh@275 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:48.486 03:27:13 -- target/tls.sh@276 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:48.486 Running I/O for 1 seconds... 00:15:49.872 00:15:49.872 Latency(us) 00:15:49.872 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:49.872 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:15:49.872 Verification LBA range: start 0x0 length 0x2000 00:15:49.872 nvme0n1 : 1.02 3242.50 12.67 0.00 0.00 39054.86 6602.15 58254.22 00:15:49.872 =================================================================================================================== 00:15:49.872 Total : 3242.50 12.67 0.00 0.00 39054.86 6602.15 58254.22 00:15:49.872 0 00:15:49.872 03:27:14 -- target/tls.sh@278 -- # trap - SIGINT SIGTERM EXIT 00:15:49.872 03:27:14 -- target/tls.sh@279 -- # cleanup 00:15:49.872 03:27:14 -- target/tls.sh@15 -- # process_shm --id 0 00:15:49.872 03:27:14 -- common/autotest_common.sh@794 -- # type=--id 00:15:49.872 03:27:14 -- common/autotest_common.sh@795 -- # id=0 00:15:49.872 03:27:14 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:15:49.872 03:27:14 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:49.873 03:27:14 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:15:49.873 03:27:14 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:15:49.873 03:27:14 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:15:49.873 03:27:14 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:49.873 nvmf_trace.0 00:15:49.873 03:27:14 -- common/autotest_common.sh@809 -- # return 0 00:15:49.873 03:27:14 -- target/tls.sh@16 -- # killprocess 1459989 00:15:49.873 03:27:14 -- common/autotest_common.sh@936 -- # '[' -z 1459989 ']' 00:15:49.873 03:27:14 -- common/autotest_common.sh@940 -- # kill -0 1459989 00:15:49.873 03:27:14 -- common/autotest_common.sh@941 -- # uname 00:15:49.873 03:27:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:49.873 03:27:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1459989 00:15:49.873 03:27:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:49.873 03:27:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:49.873 03:27:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1459989' 00:15:49.873 killing process with pid 1459989 00:15:49.873 03:27:14 -- common/autotest_common.sh@955 -- # kill 1459989 00:15:49.873 Received shutdown signal, test time was about 1.000000 seconds 00:15:49.873 00:15:49.873 Latency(us) 00:15:49.873 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:49.873 =================================================================================================================== 00:15:49.873 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:49.873 03:27:14 -- common/autotest_common.sh@960 -- # wait 1459989 00:15:49.873 03:27:14 -- target/tls.sh@17 -- # nvmftestfini 00:15:49.873 03:27:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:49.873 03:27:14 -- nvmf/common.sh@117 -- # sync 00:15:49.873 03:27:14 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:15:49.873 03:27:14 -- nvmf/common.sh@120 -- # set +e 00:15:49.873 03:27:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:49.873 03:27:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:15:49.873 rmmod nvme_tcp 00:15:49.873 rmmod nvme_fabrics 00:15:50.134 rmmod nvme_keyring 00:15:50.134 03:27:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:50.135 03:27:14 -- nvmf/common.sh@124 -- # set -e 00:15:50.135 03:27:14 -- nvmf/common.sh@125 -- # return 0 00:15:50.135 03:27:14 -- nvmf/common.sh@478 -- # '[' -n 1459838 ']' 00:15:50.135 03:27:14 -- nvmf/common.sh@479 -- # killprocess 1459838 00:15:50.135 03:27:14 -- common/autotest_common.sh@936 -- # '[' -z 1459838 ']' 00:15:50.135 03:27:14 -- common/autotest_common.sh@940 -- # kill -0 1459838 00:15:50.135 03:27:14 -- common/autotest_common.sh@941 -- # uname 00:15:50.135 03:27:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:50.135 03:27:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1459838 00:15:50.135 03:27:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:50.135 03:27:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:50.135 03:27:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1459838' 00:15:50.135 killing process with pid 1459838 00:15:50.135 03:27:14 -- common/autotest_common.sh@955 -- # kill 1459838 00:15:50.135 03:27:14 -- common/autotest_common.sh@960 -- # wait 1459838 00:15:50.395 03:27:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:50.395 03:27:15 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:15:50.395 03:27:15 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:15:50.395 03:27:15 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:50.395 03:27:15 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:15:50.395 03:27:15 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:50.395 03:27:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:50.395 03:27:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:52.301 03:27:17 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:15:52.301 03:27:17 -- target/tls.sh@18 -- # rm -f /tmp/tmp.brEa19Xrfq /tmp/tmp.10tZZVMq7R /tmp/tmp.AqN4fFpAuw 00:15:52.301 00:15:52.301 real 1m21.140s 00:15:52.301 user 2m6.881s 00:15:52.301 sys 0m28.044s 00:15:52.301 03:27:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:52.301 03:27:17 -- common/autotest_common.sh@10 -- # set +x 00:15:52.301 ************************************ 00:15:52.301 END TEST nvmf_tls 00:15:52.301 ************************************ 00:15:52.301 03:27:17 -- nvmf/nvmf.sh@61 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:15:52.301 03:27:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:52.301 03:27:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:52.301 03:27:17 -- common/autotest_common.sh@10 -- # set +x 00:15:52.560 ************************************ 00:15:52.560 START TEST nvmf_fips 00:15:52.560 ************************************ 00:15:52.560 03:27:17 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:15:52.560 * Looking for test storage... 00:15:52.560 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:15:52.560 03:27:17 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:52.560 03:27:17 -- nvmf/common.sh@7 -- # uname -s 00:15:52.560 03:27:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:52.560 03:27:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:52.560 03:27:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:52.560 03:27:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:52.560 03:27:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:52.560 03:27:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:52.560 03:27:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:52.560 03:27:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:52.560 03:27:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:52.560 03:27:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:52.560 03:27:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:15:52.560 03:27:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:15:52.560 03:27:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:52.560 03:27:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:52.560 03:27:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:52.560 03:27:17 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:52.560 03:27:17 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:52.560 03:27:17 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:52.560 03:27:17 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:52.560 03:27:17 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:52.560 03:27:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.560 03:27:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.560 03:27:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.560 03:27:17 -- paths/export.sh@5 -- # export PATH 00:15:52.560 03:27:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.560 03:27:17 -- nvmf/common.sh@47 -- # : 0 00:15:52.560 03:27:17 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:52.560 03:27:17 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:52.560 03:27:17 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:52.560 03:27:17 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:52.560 03:27:17 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:52.560 03:27:17 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:52.560 03:27:17 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:52.560 03:27:17 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:52.560 03:27:17 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:52.560 03:27:17 -- fips/fips.sh@89 -- # check_openssl_version 00:15:52.560 03:27:17 -- fips/fips.sh@83 -- # local target=3.0.0 00:15:52.560 03:27:17 -- fips/fips.sh@85 -- # openssl version 00:15:52.560 03:27:17 -- fips/fips.sh@85 -- # awk '{print $2}' 00:15:52.560 03:27:17 -- fips/fips.sh@85 -- # ge 3.0.9 3.0.0 00:15:52.560 03:27:17 -- scripts/common.sh@373 -- # cmp_versions 3.0.9 '>=' 3.0.0 00:15:52.560 03:27:17 -- scripts/common.sh@330 -- # local ver1 ver1_l 00:15:52.560 03:27:17 -- scripts/common.sh@331 -- # local ver2 ver2_l 00:15:52.560 03:27:17 -- scripts/common.sh@333 -- # IFS=.-: 00:15:52.560 03:27:17 -- scripts/common.sh@333 -- # read -ra ver1 00:15:52.560 03:27:17 -- scripts/common.sh@334 -- # IFS=.-: 00:15:52.560 03:27:17 -- scripts/common.sh@334 -- # read -ra ver2 00:15:52.560 03:27:17 -- scripts/common.sh@335 -- # local 'op=>=' 00:15:52.560 03:27:17 -- scripts/common.sh@337 -- # ver1_l=3 00:15:52.560 03:27:17 -- scripts/common.sh@338 -- # ver2_l=3 00:15:52.560 03:27:17 -- scripts/common.sh@340 -- # local lt=0 gt=0 eq=0 v 00:15:52.560 03:27:17 -- scripts/common.sh@341 -- # case "$op" in 00:15:52.560 03:27:17 -- scripts/common.sh@345 -- # : 1 00:15:52.560 03:27:17 -- scripts/common.sh@361 -- # (( v = 0 )) 00:15:52.560 03:27:17 -- scripts/common.sh@361 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:52.560 03:27:17 -- scripts/common.sh@362 -- # decimal 3 00:15:52.560 03:27:17 -- scripts/common.sh@350 -- # local d=3 00:15:52.560 03:27:17 -- scripts/common.sh@351 -- # [[ 3 =~ ^[0-9]+$ ]] 00:15:52.560 03:27:17 -- scripts/common.sh@352 -- # echo 3 00:15:52.560 03:27:17 -- scripts/common.sh@362 -- # ver1[v]=3 00:15:52.560 03:27:17 -- scripts/common.sh@363 -- # decimal 3 00:15:52.560 03:27:17 -- scripts/common.sh@350 -- # local d=3 00:15:52.560 03:27:17 -- scripts/common.sh@351 -- # [[ 3 =~ ^[0-9]+$ ]] 00:15:52.560 03:27:17 -- scripts/common.sh@352 -- # echo 3 00:15:52.560 03:27:17 -- scripts/common.sh@363 -- # ver2[v]=3 00:15:52.560 03:27:17 -- scripts/common.sh@364 -- # (( ver1[v] > ver2[v] )) 00:15:52.560 03:27:17 -- scripts/common.sh@365 -- # (( ver1[v] < ver2[v] )) 00:15:52.560 03:27:17 -- scripts/common.sh@361 -- # (( v++ )) 00:15:52.560 03:27:17 -- scripts/common.sh@361 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:52.560 03:27:17 -- scripts/common.sh@362 -- # decimal 0 00:15:52.560 03:27:17 -- scripts/common.sh@350 -- # local d=0 00:15:52.560 03:27:17 -- scripts/common.sh@351 -- # [[ 0 =~ ^[0-9]+$ ]] 00:15:52.561 03:27:17 -- scripts/common.sh@352 -- # echo 0 00:15:52.561 03:27:17 -- scripts/common.sh@362 -- # ver1[v]=0 00:15:52.561 03:27:17 -- scripts/common.sh@363 -- # decimal 0 00:15:52.561 03:27:17 -- scripts/common.sh@350 -- # local d=0 00:15:52.561 03:27:17 -- scripts/common.sh@351 -- # [[ 0 =~ ^[0-9]+$ ]] 00:15:52.561 03:27:17 -- scripts/common.sh@352 -- # echo 0 00:15:52.561 03:27:17 -- scripts/common.sh@363 -- # ver2[v]=0 00:15:52.561 03:27:17 -- scripts/common.sh@364 -- # (( ver1[v] > ver2[v] )) 00:15:52.561 03:27:17 -- scripts/common.sh@365 -- # (( ver1[v] < ver2[v] )) 00:15:52.561 03:27:17 -- scripts/common.sh@361 -- # (( v++ )) 00:15:52.561 03:27:17 -- scripts/common.sh@361 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:52.561 03:27:17 -- scripts/common.sh@362 -- # decimal 9 00:15:52.561 03:27:17 -- scripts/common.sh@350 -- # local d=9 00:15:52.561 03:27:17 -- scripts/common.sh@351 -- # [[ 9 =~ ^[0-9]+$ ]] 00:15:52.561 03:27:17 -- scripts/common.sh@352 -- # echo 9 00:15:52.561 03:27:17 -- scripts/common.sh@362 -- # ver1[v]=9 00:15:52.561 03:27:17 -- scripts/common.sh@363 -- # decimal 0 00:15:52.561 03:27:17 -- scripts/common.sh@350 -- # local d=0 00:15:52.561 03:27:17 -- scripts/common.sh@351 -- # [[ 0 =~ ^[0-9]+$ ]] 00:15:52.561 03:27:17 -- scripts/common.sh@352 -- # echo 0 00:15:52.561 03:27:17 -- scripts/common.sh@363 -- # ver2[v]=0 00:15:52.561 03:27:17 -- scripts/common.sh@364 -- # (( ver1[v] > ver2[v] )) 00:15:52.561 03:27:17 -- scripts/common.sh@364 -- # return 0 00:15:52.561 03:27:17 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:15:52.561 03:27:17 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:15:52.561 03:27:17 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:15:52.561 03:27:17 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:15:52.561 03:27:17 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:15:52.561 03:27:17 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:15:52.561 03:27:17 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:15:52.561 03:27:17 -- fips/fips.sh@113 -- # build_openssl_config 00:15:52.561 03:27:17 -- fips/fips.sh@37 -- # cat 00:15:52.561 03:27:17 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:15:52.561 03:27:17 -- fips/fips.sh@58 -- # cat - 00:15:52.561 03:27:17 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:15:52.561 03:27:17 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:15:52.561 03:27:17 -- fips/fips.sh@116 -- # mapfile -t providers 00:15:52.561 03:27:17 -- fips/fips.sh@116 -- # openssl list -providers 00:15:52.561 03:27:17 -- fips/fips.sh@116 -- # grep name 00:15:52.561 03:27:17 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:15:52.820 03:27:17 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:15:52.820 03:27:17 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:15:52.820 03:27:17 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:15:52.820 03:27:17 -- fips/fips.sh@127 -- # : 00:15:52.820 03:27:17 -- common/autotest_common.sh@638 -- # local es=0 00:15:52.820 03:27:17 -- common/autotest_common.sh@640 -- # valid_exec_arg openssl md5 /dev/fd/62 00:15:52.820 03:27:17 -- common/autotest_common.sh@626 -- # local arg=openssl 00:15:52.820 03:27:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:52.820 03:27:17 -- common/autotest_common.sh@630 -- # type -t openssl 00:15:52.820 03:27:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:52.820 03:27:17 -- common/autotest_common.sh@632 -- # type -P openssl 00:15:52.820 03:27:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:52.820 03:27:17 -- common/autotest_common.sh@632 -- # arg=/usr/bin/openssl 00:15:52.820 03:27:17 -- common/autotest_common.sh@632 -- # [[ -x /usr/bin/openssl ]] 00:15:52.820 03:27:17 -- common/autotest_common.sh@641 -- # openssl md5 /dev/fd/62 00:15:52.820 Error setting digest 00:15:52.820 00320035B87F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:373:Global default library context, Algorithm (MD5 : 97), Properties () 00:15:52.820 00320035B87F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:254: 00:15:52.820 03:27:17 -- common/autotest_common.sh@641 -- # es=1 00:15:52.820 03:27:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:15:52.820 03:27:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:15:52.820 03:27:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:15:52.820 03:27:17 -- fips/fips.sh@130 -- # nvmftestinit 00:15:52.820 03:27:17 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:15:52.820 03:27:17 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:52.820 03:27:17 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:52.820 03:27:17 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:52.820 03:27:17 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:52.820 03:27:17 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:52.820 03:27:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:52.820 03:27:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:52.820 03:27:17 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:52.820 03:27:17 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:52.820 03:27:17 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:52.820 03:27:17 -- common/autotest_common.sh@10 -- # set +x 00:15:54.726 03:27:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:54.726 03:27:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:54.726 03:27:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:54.726 03:27:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:54.726 03:27:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:54.726 03:27:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:54.726 03:27:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:54.726 03:27:19 -- nvmf/common.sh@295 -- # net_devs=() 00:15:54.726 03:27:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:54.726 03:27:19 -- nvmf/common.sh@296 -- # e810=() 00:15:54.726 03:27:19 -- nvmf/common.sh@296 -- # local -ga e810 00:15:54.726 03:27:19 -- nvmf/common.sh@297 -- # x722=() 00:15:54.726 03:27:19 -- nvmf/common.sh@297 -- # local -ga x722 00:15:54.726 03:27:19 -- nvmf/common.sh@298 -- # mlx=() 00:15:54.726 03:27:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:54.726 03:27:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:54.726 03:27:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:54.726 03:27:19 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:15:54.726 03:27:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:54.726 03:27:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:54.726 03:27:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:15:54.726 Found 0000:09:00.0 (0x8086 - 0x159b) 00:15:54.726 03:27:19 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:54.726 03:27:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:15:54.726 Found 0000:09:00.1 (0x8086 - 0x159b) 00:15:54.726 03:27:19 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:54.726 03:27:19 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:15:54.726 03:27:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:54.726 03:27:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:54.726 03:27:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:54.726 03:27:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:54.727 03:27:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:15:54.727 Found net devices under 0000:09:00.0: cvl_0_0 00:15:54.727 03:27:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:54.727 03:27:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:54.727 03:27:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:54.727 03:27:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:54.727 03:27:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:54.727 03:27:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:15:54.727 Found net devices under 0000:09:00.1: cvl_0_1 00:15:54.727 03:27:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:54.727 03:27:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:54.727 03:27:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:54.727 03:27:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:54.727 03:27:19 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:15:54.727 03:27:19 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:15:54.727 03:27:19 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:54.727 03:27:19 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:54.727 03:27:19 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:54.727 03:27:19 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:15:54.727 03:27:19 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:54.727 03:27:19 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:54.727 03:27:19 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:15:54.727 03:27:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:54.727 03:27:19 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:54.727 03:27:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:15:54.727 03:27:19 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:15:54.727 03:27:19 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:15:54.727 03:27:19 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:54.727 03:27:19 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:54.727 03:27:19 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:54.727 03:27:19 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:15:54.727 03:27:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:54.985 03:27:19 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:54.985 03:27:19 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:54.985 03:27:19 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:15:54.985 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:54.985 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:15:54.985 00:15:54.985 --- 10.0.0.2 ping statistics --- 00:15:54.985 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:54.985 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:15:54.985 03:27:19 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:54.985 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:54.985 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:15:54.985 00:15:54.985 --- 10.0.0.1 ping statistics --- 00:15:54.985 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:54.985 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:15:54.986 03:27:19 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:54.986 03:27:19 -- nvmf/common.sh@411 -- # return 0 00:15:54.986 03:27:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:54.986 03:27:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:54.986 03:27:19 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:15:54.986 03:27:19 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:15:54.986 03:27:19 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:54.986 03:27:19 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:15:54.986 03:27:19 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:15:54.986 03:27:19 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:15:54.986 03:27:19 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:54.986 03:27:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:54.986 03:27:19 -- common/autotest_common.sh@10 -- # set +x 00:15:54.986 03:27:19 -- nvmf/common.sh@470 -- # nvmfpid=1462357 00:15:54.986 03:27:19 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:54.986 03:27:19 -- nvmf/common.sh@471 -- # waitforlisten 1462357 00:15:54.986 03:27:19 -- common/autotest_common.sh@817 -- # '[' -z 1462357 ']' 00:15:54.986 03:27:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:54.986 03:27:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:54.986 03:27:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:54.986 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:54.986 03:27:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:54.986 03:27:19 -- common/autotest_common.sh@10 -- # set +x 00:15:54.986 [2024-04-27 03:27:19.851058] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:54.986 [2024-04-27 03:27:19.851143] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:54.986 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.986 [2024-04-27 03:27:19.918651] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:55.246 [2024-04-27 03:27:20.031777] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:55.246 [2024-04-27 03:27:20.031853] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:55.246 [2024-04-27 03:27:20.031880] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:55.246 [2024-04-27 03:27:20.031902] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:55.246 [2024-04-27 03:27:20.031919] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:55.246 [2024-04-27 03:27:20.031961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:55.816 03:27:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:55.816 03:27:20 -- common/autotest_common.sh@850 -- # return 0 00:15:55.816 03:27:20 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:55.816 03:27:20 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:55.816 03:27:20 -- common/autotest_common.sh@10 -- # set +x 00:15:56.078 03:27:20 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:56.078 03:27:20 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:15:56.078 03:27:20 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:15:56.078 03:27:20 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:15:56.078 03:27:20 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:15:56.078 03:27:20 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:15:56.078 03:27:20 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:15:56.078 03:27:20 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:15:56.078 03:27:20 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:56.078 [2024-04-27 03:27:21.020434] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:56.078 [2024-04-27 03:27:21.036420] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:15:56.078 [2024-04-27 03:27:21.036695] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:56.337 [2024-04-27 03:27:21.069141] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:15:56.337 malloc0 00:15:56.337 03:27:21 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:56.337 03:27:21 -- fips/fips.sh@147 -- # bdevperf_pid=1462513 00:15:56.337 03:27:21 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:15:56.337 03:27:21 -- fips/fips.sh@148 -- # waitforlisten 1462513 /var/tmp/bdevperf.sock 00:15:56.337 03:27:21 -- common/autotest_common.sh@817 -- # '[' -z 1462513 ']' 00:15:56.337 03:27:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:56.337 03:27:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:56.337 03:27:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:56.337 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:56.337 03:27:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:56.337 03:27:21 -- common/autotest_common.sh@10 -- # set +x 00:15:56.337 [2024-04-27 03:27:21.160065] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:15:56.337 [2024-04-27 03:27:21.160143] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1462513 ] 00:15:56.337 EAL: No free 2048 kB hugepages reported on node 1 00:15:56.337 [2024-04-27 03:27:21.216918] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:56.596 [2024-04-27 03:27:21.321735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:57.164 03:27:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:57.164 03:27:22 -- common/autotest_common.sh@850 -- # return 0 00:15:57.164 03:27:22 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:15:57.422 [2024-04-27 03:27:22.295011] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:57.422 [2024-04-27 03:27:22.295124] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:15:57.422 TLSTESTn1 00:15:57.422 03:27:22 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:57.683 Running I/O for 10 seconds... 00:16:07.664 00:16:07.664 Latency(us) 00:16:07.664 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:07.664 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:07.664 Verification LBA range: start 0x0 length 0x2000 00:16:07.664 TLSTESTn1 : 10.02 3468.53 13.55 0.00 0.00 36838.77 8980.86 36505.98 00:16:07.664 =================================================================================================================== 00:16:07.664 Total : 3468.53 13.55 0.00 0.00 36838.77 8980.86 36505.98 00:16:07.664 0 00:16:07.664 03:27:32 -- fips/fips.sh@1 -- # cleanup 00:16:07.664 03:27:32 -- fips/fips.sh@15 -- # process_shm --id 0 00:16:07.664 03:27:32 -- common/autotest_common.sh@794 -- # type=--id 00:16:07.664 03:27:32 -- common/autotest_common.sh@795 -- # id=0 00:16:07.664 03:27:32 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:16:07.664 03:27:32 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:16:07.664 03:27:32 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:16:07.664 03:27:32 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:16:07.664 03:27:32 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:16:07.664 03:27:32 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:16:07.664 nvmf_trace.0 00:16:07.664 03:27:32 -- common/autotest_common.sh@809 -- # return 0 00:16:07.664 03:27:32 -- fips/fips.sh@16 -- # killprocess 1462513 00:16:07.664 03:27:32 -- common/autotest_common.sh@936 -- # '[' -z 1462513 ']' 00:16:07.664 03:27:32 -- common/autotest_common.sh@940 -- # kill -0 1462513 00:16:07.664 03:27:32 -- common/autotest_common.sh@941 -- # uname 00:16:07.664 03:27:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:07.664 03:27:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1462513 00:16:07.664 03:27:32 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:16:07.665 03:27:32 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:16:07.665 03:27:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1462513' 00:16:07.665 killing process with pid 1462513 00:16:07.665 03:27:32 -- common/autotest_common.sh@955 -- # kill 1462513 00:16:07.665 Received shutdown signal, test time was about 10.000000 seconds 00:16:07.665 00:16:07.665 Latency(us) 00:16:07.665 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:07.665 =================================================================================================================== 00:16:07.665 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:07.665 [2024-04-27 03:27:32.637233] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:16:07.665 03:27:32 -- common/autotest_common.sh@960 -- # wait 1462513 00:16:07.923 03:27:32 -- fips/fips.sh@17 -- # nvmftestfini 00:16:07.923 03:27:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:07.923 03:27:32 -- nvmf/common.sh@117 -- # sync 00:16:07.923 03:27:32 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:16:07.923 03:27:32 -- nvmf/common.sh@120 -- # set +e 00:16:07.923 03:27:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:07.923 03:27:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:16:07.923 rmmod nvme_tcp 00:16:08.181 rmmod nvme_fabrics 00:16:08.181 rmmod nvme_keyring 00:16:08.181 03:27:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:08.181 03:27:32 -- nvmf/common.sh@124 -- # set -e 00:16:08.181 03:27:32 -- nvmf/common.sh@125 -- # return 0 00:16:08.181 03:27:32 -- nvmf/common.sh@478 -- # '[' -n 1462357 ']' 00:16:08.181 03:27:32 -- nvmf/common.sh@479 -- # killprocess 1462357 00:16:08.181 03:27:32 -- common/autotest_common.sh@936 -- # '[' -z 1462357 ']' 00:16:08.181 03:27:32 -- common/autotest_common.sh@940 -- # kill -0 1462357 00:16:08.181 03:27:32 -- common/autotest_common.sh@941 -- # uname 00:16:08.181 03:27:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:08.181 03:27:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1462357 00:16:08.181 03:27:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:08.181 03:27:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:08.181 03:27:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1462357' 00:16:08.181 killing process with pid 1462357 00:16:08.181 03:27:32 -- common/autotest_common.sh@955 -- # kill 1462357 00:16:08.181 [2024-04-27 03:27:32.984510] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:16:08.181 03:27:32 -- common/autotest_common.sh@960 -- # wait 1462357 00:16:08.438 03:27:33 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:08.438 03:27:33 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:16:08.438 03:27:33 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:16:08.439 03:27:33 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:08.439 03:27:33 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:16:08.439 03:27:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:08.439 03:27:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:08.439 03:27:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:10.346 03:27:35 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:16:10.346 03:27:35 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:16:10.346 00:16:10.346 real 0m17.939s 00:16:10.346 user 0m23.423s 00:16:10.346 sys 0m5.634s 00:16:10.346 03:27:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:10.346 03:27:35 -- common/autotest_common.sh@10 -- # set +x 00:16:10.346 ************************************ 00:16:10.346 END TEST nvmf_fips 00:16:10.346 ************************************ 00:16:10.605 03:27:35 -- nvmf/nvmf.sh@64 -- # '[' 0 -eq 1 ']' 00:16:10.605 03:27:35 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:16:10.605 03:27:35 -- nvmf/nvmf.sh@71 -- # '[' tcp = tcp ']' 00:16:10.605 03:27:35 -- nvmf/nvmf.sh@72 -- # gather_supported_nvmf_pci_devs 00:16:10.605 03:27:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:10.605 03:27:35 -- common/autotest_common.sh@10 -- # set +x 00:16:12.533 03:27:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:12.533 03:27:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:12.533 03:27:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:12.533 03:27:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:12.533 03:27:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:12.533 03:27:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:12.533 03:27:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:12.533 03:27:37 -- nvmf/common.sh@295 -- # net_devs=() 00:16:12.533 03:27:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:12.533 03:27:37 -- nvmf/common.sh@296 -- # e810=() 00:16:12.533 03:27:37 -- nvmf/common.sh@296 -- # local -ga e810 00:16:12.533 03:27:37 -- nvmf/common.sh@297 -- # x722=() 00:16:12.533 03:27:37 -- nvmf/common.sh@297 -- # local -ga x722 00:16:12.533 03:27:37 -- nvmf/common.sh@298 -- # mlx=() 00:16:12.533 03:27:37 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:12.533 03:27:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:12.533 03:27:37 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:12.533 03:27:37 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:12.533 03:27:37 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:12.533 03:27:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:12.533 03:27:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:16:12.533 Found 0000:09:00.0 (0x8086 - 0x159b) 00:16:12.533 03:27:37 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:12.533 03:27:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:16:12.533 Found 0000:09:00.1 (0x8086 - 0x159b) 00:16:12.533 03:27:37 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:12.533 03:27:37 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:16:12.533 03:27:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:12.533 03:27:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:12.533 03:27:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:12.533 03:27:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:12.533 03:27:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:16:12.533 Found net devices under 0000:09:00.0: cvl_0_0 00:16:12.533 03:27:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:12.533 03:27:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:12.533 03:27:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:12.533 03:27:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:12.533 03:27:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:12.533 03:27:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:16:12.533 Found net devices under 0000:09:00.1: cvl_0_1 00:16:12.533 03:27:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:12.533 03:27:37 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:12.533 03:27:37 -- nvmf/nvmf.sh@73 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:12.533 03:27:37 -- nvmf/nvmf.sh@74 -- # (( 2 > 0 )) 00:16:12.533 03:27:37 -- nvmf/nvmf.sh@75 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:16:12.533 03:27:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:12.533 03:27:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:12.533 03:27:37 -- common/autotest_common.sh@10 -- # set +x 00:16:12.533 ************************************ 00:16:12.533 START TEST nvmf_perf_adq 00:16:12.533 ************************************ 00:16:12.533 03:27:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:16:12.533 * Looking for test storage... 00:16:12.533 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:12.533 03:27:37 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:12.533 03:27:37 -- nvmf/common.sh@7 -- # uname -s 00:16:12.794 03:27:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:12.794 03:27:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:12.794 03:27:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:12.794 03:27:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:12.794 03:27:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:12.794 03:27:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:12.794 03:27:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:12.794 03:27:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:12.794 03:27:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:12.794 03:27:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:12.794 03:27:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:16:12.794 03:27:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:16:12.794 03:27:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:12.794 03:27:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:12.794 03:27:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:12.794 03:27:37 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:12.794 03:27:37 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:12.794 03:27:37 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:12.794 03:27:37 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:12.794 03:27:37 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:12.794 03:27:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.794 03:27:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.794 03:27:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.794 03:27:37 -- paths/export.sh@5 -- # export PATH 00:16:12.794 03:27:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.794 03:27:37 -- nvmf/common.sh@47 -- # : 0 00:16:12.794 03:27:37 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:12.794 03:27:37 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:12.794 03:27:37 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:12.794 03:27:37 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:12.794 03:27:37 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:12.794 03:27:37 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:12.794 03:27:37 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:12.794 03:27:37 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:12.794 03:27:37 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:16:12.794 03:27:37 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:12.794 03:27:37 -- common/autotest_common.sh@10 -- # set +x 00:16:14.703 03:27:39 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:14.703 03:27:39 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:14.703 03:27:39 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:14.703 03:27:39 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:14.703 03:27:39 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:14.703 03:27:39 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:14.703 03:27:39 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:14.703 03:27:39 -- nvmf/common.sh@295 -- # net_devs=() 00:16:14.703 03:27:39 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:14.703 03:27:39 -- nvmf/common.sh@296 -- # e810=() 00:16:14.703 03:27:39 -- nvmf/common.sh@296 -- # local -ga e810 00:16:14.703 03:27:39 -- nvmf/common.sh@297 -- # x722=() 00:16:14.703 03:27:39 -- nvmf/common.sh@297 -- # local -ga x722 00:16:14.703 03:27:39 -- nvmf/common.sh@298 -- # mlx=() 00:16:14.703 03:27:39 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:14.703 03:27:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:14.703 03:27:39 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:14.703 03:27:39 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:14.703 03:27:39 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:14.703 03:27:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:14.703 03:27:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:16:14.703 Found 0000:09:00.0 (0x8086 - 0x159b) 00:16:14.703 03:27:39 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:14.703 03:27:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:16:14.703 Found 0000:09:00.1 (0x8086 - 0x159b) 00:16:14.703 03:27:39 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:14.703 03:27:39 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:16:14.703 03:27:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:14.703 03:27:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:14.703 03:27:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:14.703 03:27:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:14.703 03:27:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:16:14.703 Found net devices under 0000:09:00.0: cvl_0_0 00:16:14.703 03:27:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:14.703 03:27:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:14.703 03:27:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:14.703 03:27:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:14.703 03:27:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:14.703 03:27:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:16:14.703 Found net devices under 0000:09:00.1: cvl_0_1 00:16:14.703 03:27:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:14.703 03:27:39 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:14.703 03:27:39 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:14.703 03:27:39 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:16:14.703 03:27:39 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:16:14.703 03:27:39 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:16:14.703 03:27:39 -- target/perf_adq.sh@52 -- # rmmod ice 00:16:15.270 03:27:40 -- target/perf_adq.sh@53 -- # modprobe ice 00:16:17.178 03:27:42 -- target/perf_adq.sh@54 -- # sleep 5 00:16:22.454 03:27:47 -- target/perf_adq.sh@67 -- # nvmftestinit 00:16:22.454 03:27:47 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:16:22.454 03:27:47 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:22.454 03:27:47 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:22.454 03:27:47 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:22.454 03:27:47 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:22.454 03:27:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:22.454 03:27:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:22.454 03:27:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:22.454 03:27:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:22.454 03:27:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:22.454 03:27:47 -- common/autotest_common.sh@10 -- # set +x 00:16:22.454 03:27:47 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:22.454 03:27:47 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:22.454 03:27:47 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:22.454 03:27:47 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:22.454 03:27:47 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:22.454 03:27:47 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:22.454 03:27:47 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:22.454 03:27:47 -- nvmf/common.sh@295 -- # net_devs=() 00:16:22.454 03:27:47 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:22.454 03:27:47 -- nvmf/common.sh@296 -- # e810=() 00:16:22.454 03:27:47 -- nvmf/common.sh@296 -- # local -ga e810 00:16:22.454 03:27:47 -- nvmf/common.sh@297 -- # x722=() 00:16:22.454 03:27:47 -- nvmf/common.sh@297 -- # local -ga x722 00:16:22.454 03:27:47 -- nvmf/common.sh@298 -- # mlx=() 00:16:22.454 03:27:47 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:22.454 03:27:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:22.454 03:27:47 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:22.454 03:27:47 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:22.454 03:27:47 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:22.454 03:27:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:22.454 03:27:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:16:22.454 Found 0000:09:00.0 (0x8086 - 0x159b) 00:16:22.454 03:27:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:22.454 03:27:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:16:22.454 Found 0000:09:00.1 (0x8086 - 0x159b) 00:16:22.454 03:27:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:22.454 03:27:47 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:22.454 03:27:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:22.454 03:27:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:22.454 03:27:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:22.454 03:27:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:16:22.454 Found net devices under 0000:09:00.0: cvl_0_0 00:16:22.454 03:27:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:22.454 03:27:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:22.454 03:27:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:22.454 03:27:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:22.454 03:27:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:22.454 03:27:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:16:22.454 Found net devices under 0000:09:00.1: cvl_0_1 00:16:22.454 03:27:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:22.454 03:27:47 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:22.454 03:27:47 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:22.454 03:27:47 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:16:22.454 03:27:47 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:22.454 03:27:47 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:22.454 03:27:47 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:22.454 03:27:47 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:16:22.454 03:27:47 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:22.454 03:27:47 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:22.454 03:27:47 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:16:22.454 03:27:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:22.454 03:27:47 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:22.454 03:27:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:16:22.454 03:27:47 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:16:22.454 03:27:47 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:16:22.454 03:27:47 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:22.454 03:27:47 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:22.454 03:27:47 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:22.454 03:27:47 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:16:22.454 03:27:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:22.454 03:27:47 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:22.454 03:27:47 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:22.454 03:27:47 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:16:22.454 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:22.454 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:16:22.454 00:16:22.454 --- 10.0.0.2 ping statistics --- 00:16:22.454 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:22.454 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:16:22.454 03:27:47 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:22.454 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:22.454 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.135 ms 00:16:22.454 00:16:22.454 --- 10.0.0.1 ping statistics --- 00:16:22.454 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:22.454 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:16:22.454 03:27:47 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:22.454 03:27:47 -- nvmf/common.sh@411 -- # return 0 00:16:22.454 03:27:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:22.454 03:27:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:22.454 03:27:47 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:16:22.454 03:27:47 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:22.454 03:27:47 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:16:22.454 03:27:47 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:16:22.454 03:27:47 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:16:22.454 03:27:47 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:22.454 03:27:47 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:22.454 03:27:47 -- common/autotest_common.sh@10 -- # set +x 00:16:22.454 03:27:47 -- nvmf/common.sh@470 -- # nvmfpid=1468401 00:16:22.454 03:27:47 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:16:22.454 03:27:47 -- nvmf/common.sh@471 -- # waitforlisten 1468401 00:16:22.455 03:27:47 -- common/autotest_common.sh@817 -- # '[' -z 1468401 ']' 00:16:22.455 03:27:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:22.455 03:27:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:22.455 03:27:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:22.455 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:22.455 03:27:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:22.455 03:27:47 -- common/autotest_common.sh@10 -- # set +x 00:16:22.455 [2024-04-27 03:27:47.267786] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:16:22.455 [2024-04-27 03:27:47.267866] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:22.455 EAL: No free 2048 kB hugepages reported on node 1 00:16:22.455 [2024-04-27 03:27:47.335960] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:22.712 [2024-04-27 03:27:47.454707] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:22.712 [2024-04-27 03:27:47.454770] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:22.712 [2024-04-27 03:27:47.454802] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:22.712 [2024-04-27 03:27:47.454814] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:22.712 [2024-04-27 03:27:47.454825] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:22.712 [2024-04-27 03:27:47.455195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:22.712 [2024-04-27 03:27:47.455295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:22.712 [2024-04-27 03:27:47.455330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:22.712 [2024-04-27 03:27:47.455333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:23.278 03:27:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:23.278 03:27:48 -- common/autotest_common.sh@850 -- # return 0 00:16:23.278 03:27:48 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:23.278 03:27:48 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:23.278 03:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:23.278 03:27:48 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:23.278 03:27:48 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:16:23.278 03:27:48 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:16:23.278 03:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.278 03:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:23.278 03:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.278 03:27:48 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:16:23.278 03:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.278 03:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:23.537 03:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.537 03:27:48 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:16:23.537 03:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.537 03:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:23.537 [2024-04-27 03:27:48.344904] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:23.537 03:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.537 03:27:48 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:16:23.537 03:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.537 03:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:23.537 Malloc1 00:16:23.537 03:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.537 03:27:48 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:23.537 03:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.537 03:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:23.537 03:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.537 03:27:48 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:23.537 03:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.537 03:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:23.537 03:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.537 03:27:48 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:23.537 03:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.537 03:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:23.537 [2024-04-27 03:27:48.395995] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:23.537 03:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.537 03:27:48 -- target/perf_adq.sh@73 -- # perfpid=1468556 00:16:23.537 03:27:48 -- target/perf_adq.sh@74 -- # sleep 2 00:16:23.537 03:27:48 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:16:23.537 EAL: No free 2048 kB hugepages reported on node 1 00:16:25.443 03:27:50 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:16:25.443 03:27:50 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:16:25.443 03:27:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:25.443 03:27:50 -- target/perf_adq.sh@76 -- # wc -l 00:16:25.443 03:27:50 -- common/autotest_common.sh@10 -- # set +x 00:16:25.443 03:27:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:25.700 03:27:50 -- target/perf_adq.sh@76 -- # count=4 00:16:25.700 03:27:50 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:16:25.700 03:27:50 -- target/perf_adq.sh@81 -- # wait 1468556 00:16:33.819 Initializing NVMe Controllers 00:16:33.819 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:33.819 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:16:33.819 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:16:33.819 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:16:33.819 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:16:33.819 Initialization complete. Launching workers. 00:16:33.819 ======================================================== 00:16:33.819 Latency(us) 00:16:33.819 Device Information : IOPS MiB/s Average min max 00:16:33.819 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 9978.67 38.98 6414.85 2056.46 9524.71 00:16:33.819 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10702.07 41.80 5981.83 2760.01 8743.25 00:16:33.819 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 9455.98 36.94 6769.19 2973.89 10174.99 00:16:33.819 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10377.37 40.54 6168.94 3072.63 8493.83 00:16:33.819 ======================================================== 00:16:33.819 Total : 40514.09 158.26 6320.18 2056.46 10174.99 00:16:33.819 00:16:33.819 03:27:58 -- target/perf_adq.sh@82 -- # nvmftestfini 00:16:33.819 03:27:58 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:33.819 03:27:58 -- nvmf/common.sh@117 -- # sync 00:16:33.819 03:27:58 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:16:33.819 03:27:58 -- nvmf/common.sh@120 -- # set +e 00:16:33.819 03:27:58 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:33.819 03:27:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:16:33.819 rmmod nvme_tcp 00:16:33.819 rmmod nvme_fabrics 00:16:33.819 rmmod nvme_keyring 00:16:33.819 03:27:58 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:33.819 03:27:58 -- nvmf/common.sh@124 -- # set -e 00:16:33.819 03:27:58 -- nvmf/common.sh@125 -- # return 0 00:16:33.819 03:27:58 -- nvmf/common.sh@478 -- # '[' -n 1468401 ']' 00:16:33.819 03:27:58 -- nvmf/common.sh@479 -- # killprocess 1468401 00:16:33.819 03:27:58 -- common/autotest_common.sh@936 -- # '[' -z 1468401 ']' 00:16:33.819 03:27:58 -- common/autotest_common.sh@940 -- # kill -0 1468401 00:16:33.819 03:27:58 -- common/autotest_common.sh@941 -- # uname 00:16:33.819 03:27:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:33.819 03:27:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1468401 00:16:33.819 03:27:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:33.819 03:27:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:33.819 03:27:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1468401' 00:16:33.819 killing process with pid 1468401 00:16:33.819 03:27:58 -- common/autotest_common.sh@955 -- # kill 1468401 00:16:33.819 03:27:58 -- common/autotest_common.sh@960 -- # wait 1468401 00:16:34.078 03:27:58 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:34.078 03:27:58 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:16:34.078 03:27:58 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:16:34.078 03:27:58 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:34.078 03:27:58 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:16:34.078 03:27:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:34.078 03:27:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:34.078 03:27:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:36.616 03:28:01 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:16:36.616 03:28:01 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:16:36.616 03:28:01 -- target/perf_adq.sh@52 -- # rmmod ice 00:16:36.876 03:28:01 -- target/perf_adq.sh@53 -- # modprobe ice 00:16:38.778 03:28:03 -- target/perf_adq.sh@54 -- # sleep 5 00:16:44.102 03:28:08 -- target/perf_adq.sh@87 -- # nvmftestinit 00:16:44.102 03:28:08 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:16:44.102 03:28:08 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:44.102 03:28:08 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:44.102 03:28:08 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:44.102 03:28:08 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:44.102 03:28:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:44.102 03:28:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:44.102 03:28:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:44.102 03:28:08 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:44.102 03:28:08 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:44.102 03:28:08 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:44.102 03:28:08 -- common/autotest_common.sh@10 -- # set +x 00:16:44.102 03:28:08 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:44.102 03:28:08 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:44.103 03:28:08 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:44.103 03:28:08 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:44.103 03:28:08 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:44.103 03:28:08 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:44.103 03:28:08 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:44.103 03:28:08 -- nvmf/common.sh@295 -- # net_devs=() 00:16:44.103 03:28:08 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:44.103 03:28:08 -- nvmf/common.sh@296 -- # e810=() 00:16:44.103 03:28:08 -- nvmf/common.sh@296 -- # local -ga e810 00:16:44.103 03:28:08 -- nvmf/common.sh@297 -- # x722=() 00:16:44.103 03:28:08 -- nvmf/common.sh@297 -- # local -ga x722 00:16:44.103 03:28:08 -- nvmf/common.sh@298 -- # mlx=() 00:16:44.103 03:28:08 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:44.103 03:28:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:44.103 03:28:08 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:44.103 03:28:08 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:44.103 03:28:08 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:44.103 03:28:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:44.103 03:28:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:16:44.103 Found 0000:09:00.0 (0x8086 - 0x159b) 00:16:44.103 03:28:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:44.103 03:28:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:16:44.103 Found 0000:09:00.1 (0x8086 - 0x159b) 00:16:44.103 03:28:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:44.103 03:28:08 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:44.103 03:28:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:44.103 03:28:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:44.103 03:28:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:44.103 03:28:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:16:44.103 Found net devices under 0000:09:00.0: cvl_0_0 00:16:44.103 03:28:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:44.103 03:28:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:44.103 03:28:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:44.103 03:28:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:44.103 03:28:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:44.103 03:28:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:16:44.103 Found net devices under 0000:09:00.1: cvl_0_1 00:16:44.103 03:28:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:44.103 03:28:08 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:44.103 03:28:08 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:44.103 03:28:08 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:16:44.103 03:28:08 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:44.103 03:28:08 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:44.103 03:28:08 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:44.103 03:28:08 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:16:44.103 03:28:08 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:44.103 03:28:08 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:44.103 03:28:08 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:16:44.103 03:28:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:44.103 03:28:08 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:44.103 03:28:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:16:44.103 03:28:08 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:16:44.103 03:28:08 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:16:44.103 03:28:08 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:44.103 03:28:08 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:44.103 03:28:08 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:44.103 03:28:08 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:16:44.103 03:28:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:44.103 03:28:08 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:44.103 03:28:08 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:44.103 03:28:08 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:16:44.103 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:44.103 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:16:44.103 00:16:44.103 --- 10.0.0.2 ping statistics --- 00:16:44.103 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:44.103 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:16:44.103 03:28:08 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:44.103 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:44.103 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:16:44.103 00:16:44.103 --- 10.0.0.1 ping statistics --- 00:16:44.103 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:44.103 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:16:44.103 03:28:08 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:44.103 03:28:08 -- nvmf/common.sh@411 -- # return 0 00:16:44.103 03:28:08 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:44.103 03:28:08 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:44.103 03:28:08 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:16:44.103 03:28:08 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:44.103 03:28:08 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:16:44.103 03:28:08 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:16:44.103 03:28:08 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:16:44.103 03:28:08 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:16:44.103 03:28:08 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:16:44.103 03:28:08 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:16:44.103 net.core.busy_poll = 1 00:16:44.103 03:28:08 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:16:44.103 net.core.busy_read = 1 00:16:44.103 03:28:08 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:16:44.103 03:28:08 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:16:44.103 03:28:08 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:16:44.103 03:28:08 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:16:44.103 03:28:08 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:16:44.103 03:28:08 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:16:44.103 03:28:08 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:44.103 03:28:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:44.103 03:28:08 -- common/autotest_common.sh@10 -- # set +x 00:16:44.103 03:28:08 -- nvmf/common.sh@470 -- # nvmfpid=1471195 00:16:44.103 03:28:08 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:16:44.103 03:28:08 -- nvmf/common.sh@471 -- # waitforlisten 1471195 00:16:44.103 03:28:08 -- common/autotest_common.sh@817 -- # '[' -z 1471195 ']' 00:16:44.103 03:28:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:44.103 03:28:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:44.103 03:28:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:44.103 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:44.103 03:28:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:44.103 03:28:08 -- common/autotest_common.sh@10 -- # set +x 00:16:44.103 [2024-04-27 03:28:08.872853] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:16:44.103 [2024-04-27 03:28:08.872944] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:44.103 EAL: No free 2048 kB hugepages reported on node 1 00:16:44.103 [2024-04-27 03:28:08.937417] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:44.103 [2024-04-27 03:28:09.038823] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:44.103 [2024-04-27 03:28:09.038879] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:44.104 [2024-04-27 03:28:09.038909] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:44.104 [2024-04-27 03:28:09.038921] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:44.104 [2024-04-27 03:28:09.038931] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:44.104 [2024-04-27 03:28:09.038982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:44.104 [2024-04-27 03:28:09.039007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:44.104 [2024-04-27 03:28:09.039065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:44.104 [2024-04-27 03:28:09.039067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:44.104 03:28:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:44.104 03:28:09 -- common/autotest_common.sh@850 -- # return 0 00:16:44.104 03:28:09 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:44.104 03:28:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:44.104 03:28:09 -- common/autotest_common.sh@10 -- # set +x 00:16:44.364 03:28:09 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:44.364 03:28:09 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:16:44.364 03:28:09 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:16:44.364 03:28:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.364 03:28:09 -- common/autotest_common.sh@10 -- # set +x 00:16:44.364 03:28:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.364 03:28:09 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:16:44.364 03:28:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.364 03:28:09 -- common/autotest_common.sh@10 -- # set +x 00:16:44.364 03:28:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.364 03:28:09 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:16:44.364 03:28:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.364 03:28:09 -- common/autotest_common.sh@10 -- # set +x 00:16:44.364 [2024-04-27 03:28:09.206103] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:44.364 03:28:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.364 03:28:09 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:16:44.364 03:28:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.364 03:28:09 -- common/autotest_common.sh@10 -- # set +x 00:16:44.364 Malloc1 00:16:44.364 03:28:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.364 03:28:09 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:44.364 03:28:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.364 03:28:09 -- common/autotest_common.sh@10 -- # set +x 00:16:44.364 03:28:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.364 03:28:09 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:44.364 03:28:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.364 03:28:09 -- common/autotest_common.sh@10 -- # set +x 00:16:44.364 03:28:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.364 03:28:09 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:44.364 03:28:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.364 03:28:09 -- common/autotest_common.sh@10 -- # set +x 00:16:44.364 [2024-04-27 03:28:09.259007] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:44.364 03:28:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.364 03:28:09 -- target/perf_adq.sh@94 -- # perfpid=1471322 00:16:44.364 03:28:09 -- target/perf_adq.sh@95 -- # sleep 2 00:16:44.364 03:28:09 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:16:44.364 EAL: No free 2048 kB hugepages reported on node 1 00:16:46.900 03:28:11 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:16:46.900 03:28:11 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:16:46.900 03:28:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:46.900 03:28:11 -- target/perf_adq.sh@97 -- # wc -l 00:16:46.900 03:28:11 -- common/autotest_common.sh@10 -- # set +x 00:16:46.900 03:28:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:46.900 03:28:11 -- target/perf_adq.sh@97 -- # count=2 00:16:46.900 03:28:11 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:16:46.900 03:28:11 -- target/perf_adq.sh@103 -- # wait 1471322 00:16:55.021 Initializing NVMe Controllers 00:16:55.022 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:55.022 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:16:55.022 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:16:55.022 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:16:55.022 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:16:55.022 Initialization complete. Launching workers. 00:16:55.022 ======================================================== 00:16:55.022 Latency(us) 00:16:55.022 Device Information : IOPS MiB/s Average min max 00:16:55.022 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7235.80 28.26 8849.13 1714.11 54954.92 00:16:55.022 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 6307.50 24.64 10149.55 1915.34 59233.17 00:16:55.022 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7079.90 27.66 9043.33 1878.39 55846.29 00:16:55.022 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 6125.50 23.93 10452.59 1778.69 55490.05 00:16:55.022 ======================================================== 00:16:55.022 Total : 26748.70 104.49 9574.38 1714.11 59233.17 00:16:55.022 00:16:55.022 03:28:19 -- target/perf_adq.sh@104 -- # nvmftestfini 00:16:55.022 03:28:19 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:55.022 03:28:19 -- nvmf/common.sh@117 -- # sync 00:16:55.022 03:28:19 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:16:55.022 03:28:19 -- nvmf/common.sh@120 -- # set +e 00:16:55.022 03:28:19 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:55.022 03:28:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:16:55.022 rmmod nvme_tcp 00:16:55.022 rmmod nvme_fabrics 00:16:55.022 rmmod nvme_keyring 00:16:55.022 03:28:19 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:55.022 03:28:19 -- nvmf/common.sh@124 -- # set -e 00:16:55.022 03:28:19 -- nvmf/common.sh@125 -- # return 0 00:16:55.022 03:28:19 -- nvmf/common.sh@478 -- # '[' -n 1471195 ']' 00:16:55.022 03:28:19 -- nvmf/common.sh@479 -- # killprocess 1471195 00:16:55.022 03:28:19 -- common/autotest_common.sh@936 -- # '[' -z 1471195 ']' 00:16:55.022 03:28:19 -- common/autotest_common.sh@940 -- # kill -0 1471195 00:16:55.022 03:28:19 -- common/autotest_common.sh@941 -- # uname 00:16:55.022 03:28:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:55.022 03:28:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1471195 00:16:55.022 03:28:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:55.022 03:28:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:55.022 03:28:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1471195' 00:16:55.022 killing process with pid 1471195 00:16:55.022 03:28:19 -- common/autotest_common.sh@955 -- # kill 1471195 00:16:55.022 03:28:19 -- common/autotest_common.sh@960 -- # wait 1471195 00:16:55.022 03:28:19 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:55.022 03:28:19 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:16:55.022 03:28:19 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:16:55.022 03:28:19 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:55.022 03:28:19 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:16:55.022 03:28:19 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:55.022 03:28:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:55.022 03:28:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:58.312 03:28:22 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:16:58.312 03:28:22 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:16:58.312 00:16:58.312 real 0m45.391s 00:16:58.312 user 2m37.497s 00:16:58.312 sys 0m11.404s 00:16:58.312 03:28:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:58.312 03:28:22 -- common/autotest_common.sh@10 -- # set +x 00:16:58.312 ************************************ 00:16:58.312 END TEST nvmf_perf_adq 00:16:58.312 ************************************ 00:16:58.312 03:28:22 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:16:58.312 03:28:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:58.313 03:28:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:58.313 03:28:22 -- common/autotest_common.sh@10 -- # set +x 00:16:58.313 ************************************ 00:16:58.313 START TEST nvmf_shutdown 00:16:58.313 ************************************ 00:16:58.313 03:28:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:16:58.313 * Looking for test storage... 00:16:58.313 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:58.313 03:28:23 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:58.313 03:28:23 -- nvmf/common.sh@7 -- # uname -s 00:16:58.313 03:28:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:58.313 03:28:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:58.313 03:28:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:58.313 03:28:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:58.313 03:28:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:58.313 03:28:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:58.313 03:28:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:58.313 03:28:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:58.313 03:28:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:58.313 03:28:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:58.313 03:28:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:16:58.313 03:28:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:16:58.313 03:28:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:58.313 03:28:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:58.313 03:28:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:58.313 03:28:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:58.313 03:28:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:58.313 03:28:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:58.313 03:28:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:58.313 03:28:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:58.313 03:28:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.313 03:28:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.313 03:28:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.313 03:28:23 -- paths/export.sh@5 -- # export PATH 00:16:58.313 03:28:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.313 03:28:23 -- nvmf/common.sh@47 -- # : 0 00:16:58.313 03:28:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:58.313 03:28:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:58.313 03:28:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:58.313 03:28:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:58.313 03:28:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:58.313 03:28:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:58.313 03:28:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:58.313 03:28:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:58.313 03:28:23 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:58.313 03:28:23 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:58.313 03:28:23 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:16:58.313 03:28:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:58.313 03:28:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:58.313 03:28:23 -- common/autotest_common.sh@10 -- # set +x 00:16:58.313 ************************************ 00:16:58.313 START TEST nvmf_shutdown_tc1 00:16:58.313 ************************************ 00:16:58.313 03:28:23 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc1 00:16:58.313 03:28:23 -- target/shutdown.sh@74 -- # starttarget 00:16:58.313 03:28:23 -- target/shutdown.sh@15 -- # nvmftestinit 00:16:58.313 03:28:23 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:16:58.313 03:28:23 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:58.313 03:28:23 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:58.313 03:28:23 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:58.313 03:28:23 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:58.313 03:28:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:58.313 03:28:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:58.313 03:28:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:58.313 03:28:23 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:58.313 03:28:23 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:58.313 03:28:23 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:58.313 03:28:23 -- common/autotest_common.sh@10 -- # set +x 00:17:00.214 03:28:25 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:00.214 03:28:25 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:00.214 03:28:25 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:00.214 03:28:25 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:00.214 03:28:25 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:00.214 03:28:25 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:00.214 03:28:25 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:00.214 03:28:25 -- nvmf/common.sh@295 -- # net_devs=() 00:17:00.214 03:28:25 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:00.214 03:28:25 -- nvmf/common.sh@296 -- # e810=() 00:17:00.214 03:28:25 -- nvmf/common.sh@296 -- # local -ga e810 00:17:00.214 03:28:25 -- nvmf/common.sh@297 -- # x722=() 00:17:00.214 03:28:25 -- nvmf/common.sh@297 -- # local -ga x722 00:17:00.215 03:28:25 -- nvmf/common.sh@298 -- # mlx=() 00:17:00.215 03:28:25 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:00.215 03:28:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:00.215 03:28:25 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:00.215 03:28:25 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:00.215 03:28:25 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:00.215 03:28:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:00.215 03:28:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:17:00.215 Found 0000:09:00.0 (0x8086 - 0x159b) 00:17:00.215 03:28:25 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:00.215 03:28:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:17:00.215 Found 0000:09:00.1 (0x8086 - 0x159b) 00:17:00.215 03:28:25 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:00.215 03:28:25 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:00.215 03:28:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:00.215 03:28:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:00.215 03:28:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:00.215 03:28:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:17:00.215 Found net devices under 0000:09:00.0: cvl_0_0 00:17:00.215 03:28:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:00.215 03:28:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:00.215 03:28:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:00.215 03:28:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:00.215 03:28:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:00.215 03:28:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:17:00.215 Found net devices under 0000:09:00.1: cvl_0_1 00:17:00.215 03:28:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:00.215 03:28:25 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:00.215 03:28:25 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:00.215 03:28:25 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:17:00.215 03:28:25 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:17:00.215 03:28:25 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:00.215 03:28:25 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:00.215 03:28:25 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:00.215 03:28:25 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:17:00.215 03:28:25 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:00.215 03:28:25 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:00.215 03:28:25 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:17:00.215 03:28:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:00.215 03:28:25 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:00.215 03:28:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:17:00.215 03:28:25 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:17:00.215 03:28:25 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:17:00.215 03:28:25 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:00.215 03:28:25 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:00.475 03:28:25 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:00.475 03:28:25 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:17:00.475 03:28:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:00.475 03:28:25 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:00.475 03:28:25 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:00.475 03:28:25 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:17:00.475 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:00.475 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.135 ms 00:17:00.475 00:17:00.475 --- 10.0.0.2 ping statistics --- 00:17:00.475 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:00.475 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:17:00.475 03:28:25 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:00.475 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:00.475 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:17:00.475 00:17:00.475 --- 10.0.0.1 ping statistics --- 00:17:00.475 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:00.475 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:17:00.475 03:28:25 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:00.475 03:28:25 -- nvmf/common.sh@411 -- # return 0 00:17:00.475 03:28:25 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:00.475 03:28:25 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:00.475 03:28:25 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:17:00.475 03:28:25 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:17:00.475 03:28:25 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:00.475 03:28:25 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:17:00.475 03:28:25 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:17:00.475 03:28:25 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:17:00.475 03:28:25 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:00.475 03:28:25 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:00.475 03:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.475 03:28:25 -- nvmf/common.sh@470 -- # nvmfpid=1474633 00:17:00.475 03:28:25 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:00.475 03:28:25 -- nvmf/common.sh@471 -- # waitforlisten 1474633 00:17:00.475 03:28:25 -- common/autotest_common.sh@817 -- # '[' -z 1474633 ']' 00:17:00.475 03:28:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:00.475 03:28:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:00.475 03:28:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:00.475 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:00.475 03:28:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:00.475 03:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.475 [2024-04-27 03:28:25.324919] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:00.475 [2024-04-27 03:28:25.325004] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:00.475 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.475 [2024-04-27 03:28:25.390363] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:00.734 [2024-04-27 03:28:25.497860] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:00.734 [2024-04-27 03:28:25.497922] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:00.734 [2024-04-27 03:28:25.497951] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:00.734 [2024-04-27 03:28:25.497971] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:00.734 [2024-04-27 03:28:25.497981] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:00.734 [2024-04-27 03:28:25.498041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:00.734 [2024-04-27 03:28:25.498101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:00.734 [2024-04-27 03:28:25.498168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:00.734 [2024-04-27 03:28:25.498171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:00.734 03:28:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:00.734 03:28:25 -- common/autotest_common.sh@850 -- # return 0 00:17:00.734 03:28:25 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:00.734 03:28:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:00.734 03:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.734 03:28:25 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:00.734 03:28:25 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:00.734 03:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:00.734 03:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.734 [2024-04-27 03:28:25.660975] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:00.734 03:28:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:00.734 03:28:25 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:17:00.734 03:28:25 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:17:00.734 03:28:25 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:00.734 03:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.734 03:28:25 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:00.734 03:28:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:00.734 03:28:25 -- target/shutdown.sh@28 -- # cat 00:17:00.734 03:28:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:00.734 03:28:25 -- target/shutdown.sh@28 -- # cat 00:17:00.734 03:28:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:00.734 03:28:25 -- target/shutdown.sh@28 -- # cat 00:17:00.734 03:28:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:00.734 03:28:25 -- target/shutdown.sh@28 -- # cat 00:17:00.734 03:28:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:00.734 03:28:25 -- target/shutdown.sh@28 -- # cat 00:17:00.734 03:28:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:00.734 03:28:25 -- target/shutdown.sh@28 -- # cat 00:17:00.734 03:28:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:00.734 03:28:25 -- target/shutdown.sh@28 -- # cat 00:17:00.734 03:28:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:00.734 03:28:25 -- target/shutdown.sh@28 -- # cat 00:17:00.734 03:28:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:00.734 03:28:25 -- target/shutdown.sh@28 -- # cat 00:17:00.734 03:28:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:00.734 03:28:25 -- target/shutdown.sh@28 -- # cat 00:17:00.734 03:28:25 -- target/shutdown.sh@35 -- # rpc_cmd 00:17:00.734 03:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:00.734 03:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.992 Malloc1 00:17:00.992 [2024-04-27 03:28:25.750571] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:00.992 Malloc2 00:17:00.992 Malloc3 00:17:00.992 Malloc4 00:17:00.992 Malloc5 00:17:00.992 Malloc6 00:17:01.250 Malloc7 00:17:01.250 Malloc8 00:17:01.250 Malloc9 00:17:01.250 Malloc10 00:17:01.250 03:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:01.250 03:28:26 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:17:01.250 03:28:26 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:01.250 03:28:26 -- common/autotest_common.sh@10 -- # set +x 00:17:01.250 03:28:26 -- target/shutdown.sh@78 -- # perfpid=1474807 00:17:01.250 03:28:26 -- target/shutdown.sh@79 -- # waitforlisten 1474807 /var/tmp/bdevperf.sock 00:17:01.250 03:28:26 -- common/autotest_common.sh@817 -- # '[' -z 1474807 ']' 00:17:01.250 03:28:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:01.250 03:28:26 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:17:01.250 03:28:26 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:17:01.250 03:28:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:01.250 03:28:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:01.250 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:01.250 03:28:26 -- nvmf/common.sh@521 -- # config=() 00:17:01.250 03:28:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:01.250 03:28:26 -- nvmf/common.sh@521 -- # local subsystem config 00:17:01.250 03:28:26 -- common/autotest_common.sh@10 -- # set +x 00:17:01.250 03:28:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:01.250 03:28:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:01.250 { 00:17:01.250 "params": { 00:17:01.250 "name": "Nvme$subsystem", 00:17:01.250 "trtype": "$TEST_TRANSPORT", 00:17:01.250 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.250 "adrfam": "ipv4", 00:17:01.250 "trsvcid": "$NVMF_PORT", 00:17:01.250 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.250 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.250 "hdgst": ${hdgst:-false}, 00:17:01.250 "ddgst": ${ddgst:-false} 00:17:01.250 }, 00:17:01.250 "method": "bdev_nvme_attach_controller" 00:17:01.250 } 00:17:01.250 EOF 00:17:01.250 )") 00:17:01.250 03:28:26 -- nvmf/common.sh@543 -- # cat 00:17:01.250 03:28:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:01.250 03:28:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:01.250 { 00:17:01.250 "params": { 00:17:01.250 "name": "Nvme$subsystem", 00:17:01.250 "trtype": "$TEST_TRANSPORT", 00:17:01.250 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.250 "adrfam": "ipv4", 00:17:01.250 "trsvcid": "$NVMF_PORT", 00:17:01.250 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.250 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.250 "hdgst": ${hdgst:-false}, 00:17:01.250 "ddgst": ${ddgst:-false} 00:17:01.250 }, 00:17:01.250 "method": "bdev_nvme_attach_controller" 00:17:01.250 } 00:17:01.250 EOF 00:17:01.250 )") 00:17:01.250 03:28:26 -- nvmf/common.sh@543 -- # cat 00:17:01.509 03:28:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:01.509 { 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme$subsystem", 00:17:01.509 "trtype": "$TEST_TRANSPORT", 00:17:01.509 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "$NVMF_PORT", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.509 "hdgst": ${hdgst:-false}, 00:17:01.509 "ddgst": ${ddgst:-false} 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 } 00:17:01.509 EOF 00:17:01.509 )") 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # cat 00:17:01.509 03:28:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:01.509 { 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme$subsystem", 00:17:01.509 "trtype": "$TEST_TRANSPORT", 00:17:01.509 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "$NVMF_PORT", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.509 "hdgst": ${hdgst:-false}, 00:17:01.509 "ddgst": ${ddgst:-false} 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 } 00:17:01.509 EOF 00:17:01.509 )") 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # cat 00:17:01.509 03:28:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:01.509 { 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme$subsystem", 00:17:01.509 "trtype": "$TEST_TRANSPORT", 00:17:01.509 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "$NVMF_PORT", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.509 "hdgst": ${hdgst:-false}, 00:17:01.509 "ddgst": ${ddgst:-false} 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 } 00:17:01.509 EOF 00:17:01.509 )") 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # cat 00:17:01.509 03:28:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:01.509 { 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme$subsystem", 00:17:01.509 "trtype": "$TEST_TRANSPORT", 00:17:01.509 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "$NVMF_PORT", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.509 "hdgst": ${hdgst:-false}, 00:17:01.509 "ddgst": ${ddgst:-false} 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 } 00:17:01.509 EOF 00:17:01.509 )") 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # cat 00:17:01.509 03:28:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:01.509 { 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme$subsystem", 00:17:01.509 "trtype": "$TEST_TRANSPORT", 00:17:01.509 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "$NVMF_PORT", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.509 "hdgst": ${hdgst:-false}, 00:17:01.509 "ddgst": ${ddgst:-false} 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 } 00:17:01.509 EOF 00:17:01.509 )") 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # cat 00:17:01.509 03:28:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:01.509 { 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme$subsystem", 00:17:01.509 "trtype": "$TEST_TRANSPORT", 00:17:01.509 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "$NVMF_PORT", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.509 "hdgst": ${hdgst:-false}, 00:17:01.509 "ddgst": ${ddgst:-false} 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 } 00:17:01.509 EOF 00:17:01.509 )") 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # cat 00:17:01.509 03:28:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:01.509 { 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme$subsystem", 00:17:01.509 "trtype": "$TEST_TRANSPORT", 00:17:01.509 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "$NVMF_PORT", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.509 "hdgst": ${hdgst:-false}, 00:17:01.509 "ddgst": ${ddgst:-false} 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 } 00:17:01.509 EOF 00:17:01.509 )") 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # cat 00:17:01.509 03:28:26 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:01.509 { 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme$subsystem", 00:17:01.509 "trtype": "$TEST_TRANSPORT", 00:17:01.509 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "$NVMF_PORT", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.509 "hdgst": ${hdgst:-false}, 00:17:01.509 "ddgst": ${ddgst:-false} 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 } 00:17:01.509 EOF 00:17:01.509 )") 00:17:01.509 03:28:26 -- nvmf/common.sh@543 -- # cat 00:17:01.509 03:28:26 -- nvmf/common.sh@545 -- # jq . 00:17:01.509 03:28:26 -- nvmf/common.sh@546 -- # IFS=, 00:17:01.509 03:28:26 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme1", 00:17:01.509 "trtype": "tcp", 00:17:01.509 "traddr": "10.0.0.2", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "4420", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:01.509 "hdgst": false, 00:17:01.509 "ddgst": false 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 },{ 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme2", 00:17:01.509 "trtype": "tcp", 00:17:01.509 "traddr": "10.0.0.2", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "4420", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:01.509 "hdgst": false, 00:17:01.509 "ddgst": false 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 },{ 00:17:01.509 "params": { 00:17:01.509 "name": "Nvme3", 00:17:01.509 "trtype": "tcp", 00:17:01.509 "traddr": "10.0.0.2", 00:17:01.509 "adrfam": "ipv4", 00:17:01.509 "trsvcid": "4420", 00:17:01.509 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:17:01.509 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:17:01.509 "hdgst": false, 00:17:01.509 "ddgst": false 00:17:01.509 }, 00:17:01.509 "method": "bdev_nvme_attach_controller" 00:17:01.509 },{ 00:17:01.509 "params": { 00:17:01.510 "name": "Nvme4", 00:17:01.510 "trtype": "tcp", 00:17:01.510 "traddr": "10.0.0.2", 00:17:01.510 "adrfam": "ipv4", 00:17:01.510 "trsvcid": "4420", 00:17:01.510 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:17:01.510 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:17:01.510 "hdgst": false, 00:17:01.510 "ddgst": false 00:17:01.510 }, 00:17:01.510 "method": "bdev_nvme_attach_controller" 00:17:01.510 },{ 00:17:01.510 "params": { 00:17:01.510 "name": "Nvme5", 00:17:01.510 "trtype": "tcp", 00:17:01.510 "traddr": "10.0.0.2", 00:17:01.510 "adrfam": "ipv4", 00:17:01.510 "trsvcid": "4420", 00:17:01.510 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:17:01.510 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:17:01.510 "hdgst": false, 00:17:01.510 "ddgst": false 00:17:01.510 }, 00:17:01.510 "method": "bdev_nvme_attach_controller" 00:17:01.510 },{ 00:17:01.510 "params": { 00:17:01.510 "name": "Nvme6", 00:17:01.510 "trtype": "tcp", 00:17:01.510 "traddr": "10.0.0.2", 00:17:01.510 "adrfam": "ipv4", 00:17:01.510 "trsvcid": "4420", 00:17:01.510 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:17:01.510 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:17:01.510 "hdgst": false, 00:17:01.510 "ddgst": false 00:17:01.510 }, 00:17:01.510 "method": "bdev_nvme_attach_controller" 00:17:01.510 },{ 00:17:01.510 "params": { 00:17:01.510 "name": "Nvme7", 00:17:01.510 "trtype": "tcp", 00:17:01.510 "traddr": "10.0.0.2", 00:17:01.510 "adrfam": "ipv4", 00:17:01.510 "trsvcid": "4420", 00:17:01.510 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:17:01.510 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:17:01.510 "hdgst": false, 00:17:01.510 "ddgst": false 00:17:01.510 }, 00:17:01.510 "method": "bdev_nvme_attach_controller" 00:17:01.510 },{ 00:17:01.510 "params": { 00:17:01.510 "name": "Nvme8", 00:17:01.510 "trtype": "tcp", 00:17:01.510 "traddr": "10.0.0.2", 00:17:01.510 "adrfam": "ipv4", 00:17:01.510 "trsvcid": "4420", 00:17:01.510 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:17:01.510 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:17:01.510 "hdgst": false, 00:17:01.510 "ddgst": false 00:17:01.510 }, 00:17:01.510 "method": "bdev_nvme_attach_controller" 00:17:01.510 },{ 00:17:01.510 "params": { 00:17:01.510 "name": "Nvme9", 00:17:01.510 "trtype": "tcp", 00:17:01.510 "traddr": "10.0.0.2", 00:17:01.510 "adrfam": "ipv4", 00:17:01.510 "trsvcid": "4420", 00:17:01.510 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:17:01.510 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:17:01.510 "hdgst": false, 00:17:01.510 "ddgst": false 00:17:01.510 }, 00:17:01.510 "method": "bdev_nvme_attach_controller" 00:17:01.510 },{ 00:17:01.510 "params": { 00:17:01.510 "name": "Nvme10", 00:17:01.510 "trtype": "tcp", 00:17:01.510 "traddr": "10.0.0.2", 00:17:01.510 "adrfam": "ipv4", 00:17:01.510 "trsvcid": "4420", 00:17:01.510 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:17:01.510 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:17:01.510 "hdgst": false, 00:17:01.510 "ddgst": false 00:17:01.510 }, 00:17:01.510 "method": "bdev_nvme_attach_controller" 00:17:01.510 }' 00:17:01.510 [2024-04-27 03:28:26.264122] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:01.510 [2024-04-27 03:28:26.264209] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:17:01.510 EAL: No free 2048 kB hugepages reported on node 1 00:17:01.510 [2024-04-27 03:28:26.333750] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:01.510 [2024-04-27 03:28:26.437997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:03.409 03:28:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:03.409 03:28:28 -- common/autotest_common.sh@850 -- # return 0 00:17:03.409 03:28:28 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:03.409 03:28:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:03.409 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:17:03.409 03:28:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:03.409 03:28:28 -- target/shutdown.sh@83 -- # kill -9 1474807 00:17:03.409 03:28:28 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:17:03.409 03:28:28 -- target/shutdown.sh@87 -- # sleep 1 00:17:04.344 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1474807 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:17:04.344 03:28:29 -- target/shutdown.sh@88 -- # kill -0 1474633 00:17:04.345 03:28:29 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:04.345 03:28:29 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:17:04.345 03:28:29 -- nvmf/common.sh@521 -- # config=() 00:17:04.345 03:28:29 -- nvmf/common.sh@521 -- # local subsystem config 00:17:04.345 03:28:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:04.345 { 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme$subsystem", 00:17:04.345 "trtype": "$TEST_TRANSPORT", 00:17:04.345 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "$NVMF_PORT", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.345 "hdgst": ${hdgst:-false}, 00:17:04.345 "ddgst": ${ddgst:-false} 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 } 00:17:04.345 EOF 00:17:04.345 )") 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # cat 00:17:04.345 03:28:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:04.345 { 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme$subsystem", 00:17:04.345 "trtype": "$TEST_TRANSPORT", 00:17:04.345 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "$NVMF_PORT", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.345 "hdgst": ${hdgst:-false}, 00:17:04.345 "ddgst": ${ddgst:-false} 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 } 00:17:04.345 EOF 00:17:04.345 )") 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # cat 00:17:04.345 03:28:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:04.345 { 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme$subsystem", 00:17:04.345 "trtype": "$TEST_TRANSPORT", 00:17:04.345 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "$NVMF_PORT", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.345 "hdgst": ${hdgst:-false}, 00:17:04.345 "ddgst": ${ddgst:-false} 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 } 00:17:04.345 EOF 00:17:04.345 )") 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # cat 00:17:04.345 03:28:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:04.345 { 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme$subsystem", 00:17:04.345 "trtype": "$TEST_TRANSPORT", 00:17:04.345 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "$NVMF_PORT", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.345 "hdgst": ${hdgst:-false}, 00:17:04.345 "ddgst": ${ddgst:-false} 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 } 00:17:04.345 EOF 00:17:04.345 )") 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # cat 00:17:04.345 03:28:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:04.345 { 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme$subsystem", 00:17:04.345 "trtype": "$TEST_TRANSPORT", 00:17:04.345 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "$NVMF_PORT", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.345 "hdgst": ${hdgst:-false}, 00:17:04.345 "ddgst": ${ddgst:-false} 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 } 00:17:04.345 EOF 00:17:04.345 )") 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # cat 00:17:04.345 03:28:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:04.345 { 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme$subsystem", 00:17:04.345 "trtype": "$TEST_TRANSPORT", 00:17:04.345 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "$NVMF_PORT", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.345 "hdgst": ${hdgst:-false}, 00:17:04.345 "ddgst": ${ddgst:-false} 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 } 00:17:04.345 EOF 00:17:04.345 )") 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # cat 00:17:04.345 03:28:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:04.345 { 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme$subsystem", 00:17:04.345 "trtype": "$TEST_TRANSPORT", 00:17:04.345 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "$NVMF_PORT", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.345 "hdgst": ${hdgst:-false}, 00:17:04.345 "ddgst": ${ddgst:-false} 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 } 00:17:04.345 EOF 00:17:04.345 )") 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # cat 00:17:04.345 03:28:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:04.345 { 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme$subsystem", 00:17:04.345 "trtype": "$TEST_TRANSPORT", 00:17:04.345 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "$NVMF_PORT", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.345 "hdgst": ${hdgst:-false}, 00:17:04.345 "ddgst": ${ddgst:-false} 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 } 00:17:04.345 EOF 00:17:04.345 )") 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # cat 00:17:04.345 03:28:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:04.345 { 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme$subsystem", 00:17:04.345 "trtype": "$TEST_TRANSPORT", 00:17:04.345 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "$NVMF_PORT", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.345 "hdgst": ${hdgst:-false}, 00:17:04.345 "ddgst": ${ddgst:-false} 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 } 00:17:04.345 EOF 00:17:04.345 )") 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # cat 00:17:04.345 03:28:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:04.345 { 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme$subsystem", 00:17:04.345 "trtype": "$TEST_TRANSPORT", 00:17:04.345 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "$NVMF_PORT", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.345 "hdgst": ${hdgst:-false}, 00:17:04.345 "ddgst": ${ddgst:-false} 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 } 00:17:04.345 EOF 00:17:04.345 )") 00:17:04.345 03:28:29 -- nvmf/common.sh@543 -- # cat 00:17:04.345 03:28:29 -- nvmf/common.sh@545 -- # jq . 00:17:04.345 03:28:29 -- nvmf/common.sh@546 -- # IFS=, 00:17:04.345 03:28:29 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme1", 00:17:04.345 "trtype": "tcp", 00:17:04.345 "traddr": "10.0.0.2", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "4420", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:04.345 "hdgst": false, 00:17:04.345 "ddgst": false 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 },{ 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme2", 00:17:04.345 "trtype": "tcp", 00:17:04.345 "traddr": "10.0.0.2", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "4420", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:04.345 "hdgst": false, 00:17:04.345 "ddgst": false 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 },{ 00:17:04.345 "params": { 00:17:04.345 "name": "Nvme3", 00:17:04.345 "trtype": "tcp", 00:17:04.345 "traddr": "10.0.0.2", 00:17:04.345 "adrfam": "ipv4", 00:17:04.345 "trsvcid": "4420", 00:17:04.345 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:17:04.345 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:17:04.345 "hdgst": false, 00:17:04.345 "ddgst": false 00:17:04.345 }, 00:17:04.345 "method": "bdev_nvme_attach_controller" 00:17:04.345 },{ 00:17:04.346 "params": { 00:17:04.346 "name": "Nvme4", 00:17:04.346 "trtype": "tcp", 00:17:04.346 "traddr": "10.0.0.2", 00:17:04.346 "adrfam": "ipv4", 00:17:04.346 "trsvcid": "4420", 00:17:04.346 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:17:04.346 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:17:04.346 "hdgst": false, 00:17:04.346 "ddgst": false 00:17:04.346 }, 00:17:04.346 "method": "bdev_nvme_attach_controller" 00:17:04.346 },{ 00:17:04.346 "params": { 00:17:04.346 "name": "Nvme5", 00:17:04.346 "trtype": "tcp", 00:17:04.346 "traddr": "10.0.0.2", 00:17:04.346 "adrfam": "ipv4", 00:17:04.346 "trsvcid": "4420", 00:17:04.346 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:17:04.346 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:17:04.346 "hdgst": false, 00:17:04.346 "ddgst": false 00:17:04.346 }, 00:17:04.346 "method": "bdev_nvme_attach_controller" 00:17:04.346 },{ 00:17:04.346 "params": { 00:17:04.346 "name": "Nvme6", 00:17:04.346 "trtype": "tcp", 00:17:04.346 "traddr": "10.0.0.2", 00:17:04.346 "adrfam": "ipv4", 00:17:04.346 "trsvcid": "4420", 00:17:04.346 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:17:04.346 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:17:04.346 "hdgst": false, 00:17:04.346 "ddgst": false 00:17:04.346 }, 00:17:04.346 "method": "bdev_nvme_attach_controller" 00:17:04.346 },{ 00:17:04.346 "params": { 00:17:04.346 "name": "Nvme7", 00:17:04.346 "trtype": "tcp", 00:17:04.346 "traddr": "10.0.0.2", 00:17:04.346 "adrfam": "ipv4", 00:17:04.346 "trsvcid": "4420", 00:17:04.346 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:17:04.346 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:17:04.346 "hdgst": false, 00:17:04.346 "ddgst": false 00:17:04.346 }, 00:17:04.346 "method": "bdev_nvme_attach_controller" 00:17:04.346 },{ 00:17:04.346 "params": { 00:17:04.346 "name": "Nvme8", 00:17:04.346 "trtype": "tcp", 00:17:04.346 "traddr": "10.0.0.2", 00:17:04.346 "adrfam": "ipv4", 00:17:04.346 "trsvcid": "4420", 00:17:04.346 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:17:04.346 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:17:04.346 "hdgst": false, 00:17:04.346 "ddgst": false 00:17:04.346 }, 00:17:04.346 "method": "bdev_nvme_attach_controller" 00:17:04.346 },{ 00:17:04.346 "params": { 00:17:04.346 "name": "Nvme9", 00:17:04.346 "trtype": "tcp", 00:17:04.346 "traddr": "10.0.0.2", 00:17:04.346 "adrfam": "ipv4", 00:17:04.346 "trsvcid": "4420", 00:17:04.346 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:17:04.346 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:17:04.346 "hdgst": false, 00:17:04.346 "ddgst": false 00:17:04.346 }, 00:17:04.346 "method": "bdev_nvme_attach_controller" 00:17:04.346 },{ 00:17:04.346 "params": { 00:17:04.346 "name": "Nvme10", 00:17:04.346 "trtype": "tcp", 00:17:04.346 "traddr": "10.0.0.2", 00:17:04.346 "adrfam": "ipv4", 00:17:04.346 "trsvcid": "4420", 00:17:04.346 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:17:04.346 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:17:04.346 "hdgst": false, 00:17:04.346 "ddgst": false 00:17:04.346 }, 00:17:04.346 "method": "bdev_nvme_attach_controller" 00:17:04.346 }' 00:17:04.346 [2024-04-27 03:28:29.280849] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:04.346 [2024-04-27 03:28:29.280930] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475114 ] 00:17:04.346 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.604 [2024-04-27 03:28:29.348469] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:04.604 [2024-04-27 03:28:29.454960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:05.982 Running I/O for 1 seconds... 00:17:07.357 00:17:07.357 Latency(us) 00:17:07.357 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:07.357 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.357 Verification LBA range: start 0x0 length 0x400 00:17:07.357 Nvme1n1 : 1.13 230.28 14.39 0.00 0.00 274797.68 4417.61 251658.24 00:17:07.357 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.357 Verification LBA range: start 0x0 length 0x400 00:17:07.357 Nvme2n1 : 1.11 235.26 14.70 0.00 0.00 258041.75 31068.92 250104.79 00:17:07.357 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.357 Verification LBA range: start 0x0 length 0x400 00:17:07.357 Nvme3n1 : 1.14 224.81 14.05 0.00 0.00 272956.30 34952.53 234570.33 00:17:07.357 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.357 Verification LBA range: start 0x0 length 0x400 00:17:07.357 Nvme4n1 : 1.12 228.33 14.27 0.00 0.00 264298.95 21845.33 271853.04 00:17:07.358 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.358 Verification LBA range: start 0x0 length 0x400 00:17:07.358 Nvme5n1 : 1.18 272.11 17.01 0.00 0.00 218614.44 17670.45 243891.01 00:17:07.358 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.358 Verification LBA range: start 0x0 length 0x400 00:17:07.358 Nvme6n1 : 1.14 225.32 14.08 0.00 0.00 259243.05 17476.27 253211.69 00:17:07.358 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.358 Verification LBA range: start 0x0 length 0x400 00:17:07.358 Nvme7n1 : 1.18 270.21 16.89 0.00 0.00 213367.92 17185.00 248551.35 00:17:07.358 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.358 Verification LBA range: start 0x0 length 0x400 00:17:07.358 Nvme8n1 : 1.18 220.55 13.78 0.00 0.00 255332.92 7233.23 279620.27 00:17:07.358 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.358 Verification LBA range: start 0x0 length 0x400 00:17:07.358 Nvme9n1 : 1.15 223.12 13.94 0.00 0.00 248817.97 17087.91 257872.02 00:17:07.358 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.358 Verification LBA range: start 0x0 length 0x400 00:17:07.358 Nvme10n1 : 1.19 267.84 16.74 0.00 0.00 204970.36 7475.96 260978.92 00:17:07.358 =================================================================================================================== 00:17:07.358 Total : 2397.83 149.86 0.00 0.00 244709.59 4417.61 279620.27 00:17:07.358 03:28:32 -- target/shutdown.sh@94 -- # stoptarget 00:17:07.358 03:28:32 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:17:07.358 03:28:32 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:07.358 03:28:32 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:07.358 03:28:32 -- target/shutdown.sh@45 -- # nvmftestfini 00:17:07.358 03:28:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:07.358 03:28:32 -- nvmf/common.sh@117 -- # sync 00:17:07.358 03:28:32 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:17:07.358 03:28:32 -- nvmf/common.sh@120 -- # set +e 00:17:07.358 03:28:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:07.358 03:28:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:17:07.358 rmmod nvme_tcp 00:17:07.358 rmmod nvme_fabrics 00:17:07.358 rmmod nvme_keyring 00:17:07.617 03:28:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:07.617 03:28:32 -- nvmf/common.sh@124 -- # set -e 00:17:07.617 03:28:32 -- nvmf/common.sh@125 -- # return 0 00:17:07.617 03:28:32 -- nvmf/common.sh@478 -- # '[' -n 1474633 ']' 00:17:07.617 03:28:32 -- nvmf/common.sh@479 -- # killprocess 1474633 00:17:07.617 03:28:32 -- common/autotest_common.sh@936 -- # '[' -z 1474633 ']' 00:17:07.617 03:28:32 -- common/autotest_common.sh@940 -- # kill -0 1474633 00:17:07.617 03:28:32 -- common/autotest_common.sh@941 -- # uname 00:17:07.617 03:28:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:07.617 03:28:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1474633 00:17:07.617 03:28:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:07.617 03:28:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:07.617 03:28:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1474633' 00:17:07.617 killing process with pid 1474633 00:17:07.617 03:28:32 -- common/autotest_common.sh@955 -- # kill 1474633 00:17:07.617 03:28:32 -- common/autotest_common.sh@960 -- # wait 1474633 00:17:08.190 03:28:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:08.190 03:28:32 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:17:08.190 03:28:32 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:17:08.190 03:28:32 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:08.190 03:28:32 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:17:08.190 03:28:32 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:08.190 03:28:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:08.190 03:28:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:10.129 03:28:34 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:17:10.129 00:17:10.129 real 0m11.815s 00:17:10.129 user 0m33.935s 00:17:10.129 sys 0m3.250s 00:17:10.129 03:28:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:10.129 03:28:34 -- common/autotest_common.sh@10 -- # set +x 00:17:10.129 ************************************ 00:17:10.129 END TEST nvmf_shutdown_tc1 00:17:10.130 ************************************ 00:17:10.130 03:28:34 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:17:10.130 03:28:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:10.130 03:28:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:10.130 03:28:34 -- common/autotest_common.sh@10 -- # set +x 00:17:10.130 ************************************ 00:17:10.130 START TEST nvmf_shutdown_tc2 00:17:10.130 ************************************ 00:17:10.130 03:28:35 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc2 00:17:10.130 03:28:35 -- target/shutdown.sh@99 -- # starttarget 00:17:10.130 03:28:35 -- target/shutdown.sh@15 -- # nvmftestinit 00:17:10.130 03:28:35 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:17:10.130 03:28:35 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:10.130 03:28:35 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:10.130 03:28:35 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:10.130 03:28:35 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:10.130 03:28:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:10.130 03:28:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:10.130 03:28:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:10.130 03:28:35 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:10.130 03:28:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:10.130 03:28:35 -- common/autotest_common.sh@10 -- # set +x 00:17:10.130 03:28:35 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:10.130 03:28:35 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:10.130 03:28:35 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:10.130 03:28:35 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:10.130 03:28:35 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:10.130 03:28:35 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:10.130 03:28:35 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:10.130 03:28:35 -- nvmf/common.sh@295 -- # net_devs=() 00:17:10.130 03:28:35 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:10.130 03:28:35 -- nvmf/common.sh@296 -- # e810=() 00:17:10.130 03:28:35 -- nvmf/common.sh@296 -- # local -ga e810 00:17:10.130 03:28:35 -- nvmf/common.sh@297 -- # x722=() 00:17:10.130 03:28:35 -- nvmf/common.sh@297 -- # local -ga x722 00:17:10.130 03:28:35 -- nvmf/common.sh@298 -- # mlx=() 00:17:10.130 03:28:35 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:10.130 03:28:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:10.130 03:28:35 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:10.130 03:28:35 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:10.130 03:28:35 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:10.130 03:28:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:10.130 03:28:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:17:10.130 Found 0000:09:00.0 (0x8086 - 0x159b) 00:17:10.130 03:28:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:10.130 03:28:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:17:10.130 Found 0000:09:00.1 (0x8086 - 0x159b) 00:17:10.130 03:28:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:10.130 03:28:35 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:10.130 03:28:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:10.130 03:28:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:10.130 03:28:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:10.130 03:28:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:17:10.130 Found net devices under 0000:09:00.0: cvl_0_0 00:17:10.130 03:28:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:10.130 03:28:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:10.130 03:28:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:10.130 03:28:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:10.130 03:28:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:10.130 03:28:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:17:10.130 Found net devices under 0000:09:00.1: cvl_0_1 00:17:10.130 03:28:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:10.130 03:28:35 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:10.130 03:28:35 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:10.130 03:28:35 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:17:10.130 03:28:35 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:17:10.130 03:28:35 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:10.130 03:28:35 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:10.130 03:28:35 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:10.130 03:28:35 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:17:10.130 03:28:35 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:10.130 03:28:35 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:10.130 03:28:35 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:17:10.130 03:28:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:10.130 03:28:35 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:10.130 03:28:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:17:10.389 03:28:35 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:17:10.389 03:28:35 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:17:10.389 03:28:35 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:10.389 03:28:35 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:10.389 03:28:35 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:10.389 03:28:35 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:17:10.389 03:28:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:10.389 03:28:35 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:10.389 03:28:35 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:10.389 03:28:35 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:17:10.389 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:10.389 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.133 ms 00:17:10.389 00:17:10.389 --- 10.0.0.2 ping statistics --- 00:17:10.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:10.389 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:17:10.389 03:28:35 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:10.389 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:10.389 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.185 ms 00:17:10.389 00:17:10.389 --- 10.0.0.1 ping statistics --- 00:17:10.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:10.389 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:17:10.389 03:28:35 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:10.389 03:28:35 -- nvmf/common.sh@411 -- # return 0 00:17:10.390 03:28:35 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:10.390 03:28:35 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:10.390 03:28:35 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:17:10.390 03:28:35 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:17:10.390 03:28:35 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:10.390 03:28:35 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:17:10.390 03:28:35 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:17:10.390 03:28:35 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:17:10.390 03:28:35 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:10.390 03:28:35 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:10.390 03:28:35 -- common/autotest_common.sh@10 -- # set +x 00:17:10.390 03:28:35 -- nvmf/common.sh@470 -- # nvmfpid=1476006 00:17:10.390 03:28:35 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:10.390 03:28:35 -- nvmf/common.sh@471 -- # waitforlisten 1476006 00:17:10.390 03:28:35 -- common/autotest_common.sh@817 -- # '[' -z 1476006 ']' 00:17:10.390 03:28:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:10.390 03:28:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:10.390 03:28:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:10.390 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:10.390 03:28:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:10.390 03:28:35 -- common/autotest_common.sh@10 -- # set +x 00:17:10.390 [2024-04-27 03:28:35.308461] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:10.390 [2024-04-27 03:28:35.308563] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:10.390 EAL: No free 2048 kB hugepages reported on node 1 00:17:10.648 [2024-04-27 03:28:35.374561] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:10.648 [2024-04-27 03:28:35.478059] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:10.648 [2024-04-27 03:28:35.478127] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:10.648 [2024-04-27 03:28:35.478155] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:10.648 [2024-04-27 03:28:35.478167] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:10.648 [2024-04-27 03:28:35.478178] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:10.648 [2024-04-27 03:28:35.478239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:10.648 [2024-04-27 03:28:35.478309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:10.648 [2024-04-27 03:28:35.478373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:10.648 [2024-04-27 03:28:35.478376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:10.648 03:28:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:10.648 03:28:35 -- common/autotest_common.sh@850 -- # return 0 00:17:10.648 03:28:35 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:10.648 03:28:35 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:10.648 03:28:35 -- common/autotest_common.sh@10 -- # set +x 00:17:10.908 03:28:35 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:10.908 03:28:35 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:10.908 03:28:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:10.908 03:28:35 -- common/autotest_common.sh@10 -- # set +x 00:17:10.908 [2024-04-27 03:28:35.644032] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:10.908 03:28:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:10.908 03:28:35 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:17:10.908 03:28:35 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:17:10.908 03:28:35 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:10.908 03:28:35 -- common/autotest_common.sh@10 -- # set +x 00:17:10.908 03:28:35 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:10.908 03:28:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:10.908 03:28:35 -- target/shutdown.sh@28 -- # cat 00:17:10.908 03:28:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:10.908 03:28:35 -- target/shutdown.sh@28 -- # cat 00:17:10.908 03:28:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:10.908 03:28:35 -- target/shutdown.sh@28 -- # cat 00:17:10.908 03:28:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:10.908 03:28:35 -- target/shutdown.sh@28 -- # cat 00:17:10.908 03:28:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:10.908 03:28:35 -- target/shutdown.sh@28 -- # cat 00:17:10.908 03:28:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:10.908 03:28:35 -- target/shutdown.sh@28 -- # cat 00:17:10.908 03:28:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:10.908 03:28:35 -- target/shutdown.sh@28 -- # cat 00:17:10.908 03:28:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:10.908 03:28:35 -- target/shutdown.sh@28 -- # cat 00:17:10.908 03:28:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:10.908 03:28:35 -- target/shutdown.sh@28 -- # cat 00:17:10.908 03:28:35 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:10.908 03:28:35 -- target/shutdown.sh@28 -- # cat 00:17:10.908 03:28:35 -- target/shutdown.sh@35 -- # rpc_cmd 00:17:10.908 03:28:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:10.908 03:28:35 -- common/autotest_common.sh@10 -- # set +x 00:17:10.908 Malloc1 00:17:10.908 [2024-04-27 03:28:35.732976] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:10.908 Malloc2 00:17:10.908 Malloc3 00:17:10.908 Malloc4 00:17:11.167 Malloc5 00:17:11.167 Malloc6 00:17:11.167 Malloc7 00:17:11.167 Malloc8 00:17:11.167 Malloc9 00:17:11.426 Malloc10 00:17:11.426 03:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:11.426 03:28:36 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:17:11.426 03:28:36 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:11.426 03:28:36 -- common/autotest_common.sh@10 -- # set +x 00:17:11.426 03:28:36 -- target/shutdown.sh@103 -- # perfpid=1476187 00:17:11.426 03:28:36 -- target/shutdown.sh@104 -- # waitforlisten 1476187 /var/tmp/bdevperf.sock 00:17:11.426 03:28:36 -- common/autotest_common.sh@817 -- # '[' -z 1476187 ']' 00:17:11.426 03:28:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:11.426 03:28:36 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:11.426 03:28:36 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:17:11.426 03:28:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:11.426 03:28:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:11.426 03:28:36 -- nvmf/common.sh@521 -- # config=() 00:17:11.426 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:11.426 03:28:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:11.426 03:28:36 -- nvmf/common.sh@521 -- # local subsystem config 00:17:11.426 03:28:36 -- common/autotest_common.sh@10 -- # set +x 00:17:11.426 03:28:36 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.426 { 00:17:11.426 "params": { 00:17:11.426 "name": "Nvme$subsystem", 00:17:11.426 "trtype": "$TEST_TRANSPORT", 00:17:11.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.426 "adrfam": "ipv4", 00:17:11.426 "trsvcid": "$NVMF_PORT", 00:17:11.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.426 "hdgst": ${hdgst:-false}, 00:17:11.426 "ddgst": ${ddgst:-false} 00:17:11.426 }, 00:17:11.426 "method": "bdev_nvme_attach_controller" 00:17:11.426 } 00:17:11.426 EOF 00:17:11.426 )") 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # cat 00:17:11.426 03:28:36 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.426 { 00:17:11.426 "params": { 00:17:11.426 "name": "Nvme$subsystem", 00:17:11.426 "trtype": "$TEST_TRANSPORT", 00:17:11.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.426 "adrfam": "ipv4", 00:17:11.426 "trsvcid": "$NVMF_PORT", 00:17:11.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.426 "hdgst": ${hdgst:-false}, 00:17:11.426 "ddgst": ${ddgst:-false} 00:17:11.426 }, 00:17:11.426 "method": "bdev_nvme_attach_controller" 00:17:11.426 } 00:17:11.426 EOF 00:17:11.426 )") 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # cat 00:17:11.426 03:28:36 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.426 { 00:17:11.426 "params": { 00:17:11.426 "name": "Nvme$subsystem", 00:17:11.426 "trtype": "$TEST_TRANSPORT", 00:17:11.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.426 "adrfam": "ipv4", 00:17:11.426 "trsvcid": "$NVMF_PORT", 00:17:11.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.426 "hdgst": ${hdgst:-false}, 00:17:11.426 "ddgst": ${ddgst:-false} 00:17:11.426 }, 00:17:11.426 "method": "bdev_nvme_attach_controller" 00:17:11.426 } 00:17:11.426 EOF 00:17:11.426 )") 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # cat 00:17:11.426 03:28:36 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.426 { 00:17:11.426 "params": { 00:17:11.426 "name": "Nvme$subsystem", 00:17:11.426 "trtype": "$TEST_TRANSPORT", 00:17:11.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.426 "adrfam": "ipv4", 00:17:11.426 "trsvcid": "$NVMF_PORT", 00:17:11.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.426 "hdgst": ${hdgst:-false}, 00:17:11.426 "ddgst": ${ddgst:-false} 00:17:11.426 }, 00:17:11.426 "method": "bdev_nvme_attach_controller" 00:17:11.426 } 00:17:11.426 EOF 00:17:11.426 )") 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # cat 00:17:11.426 03:28:36 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.426 { 00:17:11.426 "params": { 00:17:11.426 "name": "Nvme$subsystem", 00:17:11.426 "trtype": "$TEST_TRANSPORT", 00:17:11.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.426 "adrfam": "ipv4", 00:17:11.426 "trsvcid": "$NVMF_PORT", 00:17:11.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.426 "hdgst": ${hdgst:-false}, 00:17:11.426 "ddgst": ${ddgst:-false} 00:17:11.426 }, 00:17:11.426 "method": "bdev_nvme_attach_controller" 00:17:11.426 } 00:17:11.426 EOF 00:17:11.426 )") 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # cat 00:17:11.426 03:28:36 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.426 { 00:17:11.426 "params": { 00:17:11.426 "name": "Nvme$subsystem", 00:17:11.426 "trtype": "$TEST_TRANSPORT", 00:17:11.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.426 "adrfam": "ipv4", 00:17:11.426 "trsvcid": "$NVMF_PORT", 00:17:11.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.426 "hdgst": ${hdgst:-false}, 00:17:11.426 "ddgst": ${ddgst:-false} 00:17:11.426 }, 00:17:11.426 "method": "bdev_nvme_attach_controller" 00:17:11.426 } 00:17:11.426 EOF 00:17:11.426 )") 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # cat 00:17:11.426 03:28:36 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.426 03:28:36 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.426 { 00:17:11.426 "params": { 00:17:11.426 "name": "Nvme$subsystem", 00:17:11.426 "trtype": "$TEST_TRANSPORT", 00:17:11.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.426 "adrfam": "ipv4", 00:17:11.426 "trsvcid": "$NVMF_PORT", 00:17:11.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.426 "hdgst": ${hdgst:-false}, 00:17:11.426 "ddgst": ${ddgst:-false} 00:17:11.426 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 } 00:17:11.427 EOF 00:17:11.427 )") 00:17:11.427 03:28:36 -- nvmf/common.sh@543 -- # cat 00:17:11.427 03:28:36 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.427 03:28:36 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.427 { 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme$subsystem", 00:17:11.427 "trtype": "$TEST_TRANSPORT", 00:17:11.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "$NVMF_PORT", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.427 "hdgst": ${hdgst:-false}, 00:17:11.427 "ddgst": ${ddgst:-false} 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 } 00:17:11.427 EOF 00:17:11.427 )") 00:17:11.427 03:28:36 -- nvmf/common.sh@543 -- # cat 00:17:11.427 03:28:36 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.427 03:28:36 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.427 { 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme$subsystem", 00:17:11.427 "trtype": "$TEST_TRANSPORT", 00:17:11.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "$NVMF_PORT", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.427 "hdgst": ${hdgst:-false}, 00:17:11.427 "ddgst": ${ddgst:-false} 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 } 00:17:11.427 EOF 00:17:11.427 )") 00:17:11.427 03:28:36 -- nvmf/common.sh@543 -- # cat 00:17:11.427 03:28:36 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.427 03:28:36 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.427 { 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme$subsystem", 00:17:11.427 "trtype": "$TEST_TRANSPORT", 00:17:11.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "$NVMF_PORT", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.427 "hdgst": ${hdgst:-false}, 00:17:11.427 "ddgst": ${ddgst:-false} 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 } 00:17:11.427 EOF 00:17:11.427 )") 00:17:11.427 03:28:36 -- nvmf/common.sh@543 -- # cat 00:17:11.427 03:28:36 -- nvmf/common.sh@545 -- # jq . 00:17:11.427 03:28:36 -- nvmf/common.sh@546 -- # IFS=, 00:17:11.427 03:28:36 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme1", 00:17:11.427 "trtype": "tcp", 00:17:11.427 "traddr": "10.0.0.2", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "4420", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:11.427 "hdgst": false, 00:17:11.427 "ddgst": false 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 },{ 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme2", 00:17:11.427 "trtype": "tcp", 00:17:11.427 "traddr": "10.0.0.2", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "4420", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:11.427 "hdgst": false, 00:17:11.427 "ddgst": false 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 },{ 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme3", 00:17:11.427 "trtype": "tcp", 00:17:11.427 "traddr": "10.0.0.2", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "4420", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:17:11.427 "hdgst": false, 00:17:11.427 "ddgst": false 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 },{ 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme4", 00:17:11.427 "trtype": "tcp", 00:17:11.427 "traddr": "10.0.0.2", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "4420", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:17:11.427 "hdgst": false, 00:17:11.427 "ddgst": false 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 },{ 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme5", 00:17:11.427 "trtype": "tcp", 00:17:11.427 "traddr": "10.0.0.2", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "4420", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:17:11.427 "hdgst": false, 00:17:11.427 "ddgst": false 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 },{ 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme6", 00:17:11.427 "trtype": "tcp", 00:17:11.427 "traddr": "10.0.0.2", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "4420", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:17:11.427 "hdgst": false, 00:17:11.427 "ddgst": false 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 },{ 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme7", 00:17:11.427 "trtype": "tcp", 00:17:11.427 "traddr": "10.0.0.2", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "4420", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:17:11.427 "hdgst": false, 00:17:11.427 "ddgst": false 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 },{ 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme8", 00:17:11.427 "trtype": "tcp", 00:17:11.427 "traddr": "10.0.0.2", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "4420", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:17:11.427 "hdgst": false, 00:17:11.427 "ddgst": false 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 },{ 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme9", 00:17:11.427 "trtype": "tcp", 00:17:11.427 "traddr": "10.0.0.2", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "4420", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:17:11.427 "hdgst": false, 00:17:11.427 "ddgst": false 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 },{ 00:17:11.427 "params": { 00:17:11.427 "name": "Nvme10", 00:17:11.427 "trtype": "tcp", 00:17:11.427 "traddr": "10.0.0.2", 00:17:11.427 "adrfam": "ipv4", 00:17:11.427 "trsvcid": "4420", 00:17:11.427 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:17:11.427 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:17:11.427 "hdgst": false, 00:17:11.427 "ddgst": false 00:17:11.427 }, 00:17:11.427 "method": "bdev_nvme_attach_controller" 00:17:11.427 }' 00:17:11.427 [2024-04-27 03:28:36.248746] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:11.427 [2024-04-27 03:28:36.248821] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1476187 ] 00:17:11.427 EAL: No free 2048 kB hugepages reported on node 1 00:17:11.427 [2024-04-27 03:28:36.312603] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:11.687 [2024-04-27 03:28:36.417855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:13.067 Running I/O for 10 seconds... 00:17:13.326 03:28:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:13.326 03:28:38 -- common/autotest_common.sh@850 -- # return 0 00:17:13.326 03:28:38 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:13.326 03:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:13.326 03:28:38 -- common/autotest_common.sh@10 -- # set +x 00:17:13.326 03:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:13.326 03:28:38 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:17:13.326 03:28:38 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:13.326 03:28:38 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:17:13.326 03:28:38 -- target/shutdown.sh@57 -- # local ret=1 00:17:13.326 03:28:38 -- target/shutdown.sh@58 -- # local i 00:17:13.326 03:28:38 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:17:13.326 03:28:38 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:17:13.326 03:28:38 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:17:13.326 03:28:38 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:17:13.326 03:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:13.326 03:28:38 -- common/autotest_common.sh@10 -- # set +x 00:17:13.326 03:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:13.326 03:28:38 -- target/shutdown.sh@60 -- # read_io_count=3 00:17:13.326 03:28:38 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:17:13.326 03:28:38 -- target/shutdown.sh@67 -- # sleep 0.25 00:17:13.584 03:28:38 -- target/shutdown.sh@59 -- # (( i-- )) 00:17:13.584 03:28:38 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:17:13.584 03:28:38 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:17:13.584 03:28:38 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:17:13.584 03:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:13.584 03:28:38 -- common/autotest_common.sh@10 -- # set +x 00:17:13.844 03:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:13.844 03:28:38 -- target/shutdown.sh@60 -- # read_io_count=67 00:17:13.844 03:28:38 -- target/shutdown.sh@63 -- # '[' 67 -ge 100 ']' 00:17:13.844 03:28:38 -- target/shutdown.sh@67 -- # sleep 0.25 00:17:14.105 03:28:38 -- target/shutdown.sh@59 -- # (( i-- )) 00:17:14.105 03:28:38 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:17:14.105 03:28:38 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:17:14.105 03:28:38 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:17:14.105 03:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:14.105 03:28:38 -- common/autotest_common.sh@10 -- # set +x 00:17:14.105 03:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:14.105 03:28:38 -- target/shutdown.sh@60 -- # read_io_count=131 00:17:14.105 03:28:38 -- target/shutdown.sh@63 -- # '[' 131 -ge 100 ']' 00:17:14.105 03:28:38 -- target/shutdown.sh@64 -- # ret=0 00:17:14.105 03:28:38 -- target/shutdown.sh@65 -- # break 00:17:14.105 03:28:38 -- target/shutdown.sh@69 -- # return 0 00:17:14.105 03:28:38 -- target/shutdown.sh@110 -- # killprocess 1476187 00:17:14.105 03:28:38 -- common/autotest_common.sh@936 -- # '[' -z 1476187 ']' 00:17:14.105 03:28:38 -- common/autotest_common.sh@940 -- # kill -0 1476187 00:17:14.105 03:28:38 -- common/autotest_common.sh@941 -- # uname 00:17:14.105 03:28:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:14.105 03:28:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1476187 00:17:14.105 03:28:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:14.105 03:28:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:14.105 03:28:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1476187' 00:17:14.105 killing process with pid 1476187 00:17:14.105 03:28:38 -- common/autotest_common.sh@955 -- # kill 1476187 00:17:14.105 03:28:38 -- common/autotest_common.sh@960 -- # wait 1476187 00:17:14.105 Received shutdown signal, test time was about 1.035532 seconds 00:17:14.105 00:17:14.105 Latency(us) 00:17:14.105 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:14.105 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:14.105 Verification LBA range: start 0x0 length 0x400 00:17:14.105 Nvme1n1 : 0.99 193.68 12.11 0.00 0.00 326766.49 21748.24 267192.70 00:17:14.105 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:14.105 Verification LBA range: start 0x0 length 0x400 00:17:14.105 Nvme2n1 : 1.01 190.94 11.93 0.00 0.00 325457.04 25826.04 270299.59 00:17:14.105 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:14.105 Verification LBA range: start 0x0 length 0x400 00:17:14.105 Nvme3n1 : 1.02 255.16 15.95 0.00 0.00 237497.83 6650.69 259425.47 00:17:14.105 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:14.105 Verification LBA range: start 0x0 length 0x400 00:17:14.105 Nvme4n1 : 1.03 247.41 15.46 0.00 0.00 242205.58 21068.61 270299.59 00:17:14.105 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:14.105 Verification LBA range: start 0x0 length 0x400 00:17:14.105 Nvme5n1 : 1.03 249.44 15.59 0.00 0.00 235528.91 20291.89 246997.90 00:17:14.105 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:14.105 Verification LBA range: start 0x0 length 0x400 00:17:14.105 Nvme6n1 : 0.99 194.25 12.14 0.00 0.00 295345.37 25049.32 271853.04 00:17:14.105 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:14.105 Verification LBA range: start 0x0 length 0x400 00:17:14.105 Nvme7n1 : 1.03 248.37 15.52 0.00 0.00 227424.14 16990.81 276513.37 00:17:14.105 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:14.105 Verification LBA range: start 0x0 length 0x400 00:17:14.105 Nvme8n1 : 1.01 252.81 15.80 0.00 0.00 218083.93 30098.01 234570.33 00:17:14.105 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:14.105 Verification LBA range: start 0x0 length 0x400 00:17:14.105 Nvme9n1 : 1.00 191.43 11.96 0.00 0.00 282096.58 18641.35 273406.48 00:17:14.105 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:14.105 Verification LBA range: start 0x0 length 0x400 00:17:14.105 Nvme10n1 : 1.02 188.39 11.77 0.00 0.00 281746.14 22913.33 315349.52 00:17:14.105 =================================================================================================================== 00:17:14.105 Total : 2211.86 138.24 0.00 0.00 262150.58 6650.69 315349.52 00:17:14.364 03:28:39 -- target/shutdown.sh@113 -- # sleep 1 00:17:15.300 03:28:40 -- target/shutdown.sh@114 -- # kill -0 1476006 00:17:15.300 03:28:40 -- target/shutdown.sh@116 -- # stoptarget 00:17:15.300 03:28:40 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:17:15.300 03:28:40 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:15.300 03:28:40 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:15.300 03:28:40 -- target/shutdown.sh@45 -- # nvmftestfini 00:17:15.300 03:28:40 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:15.300 03:28:40 -- nvmf/common.sh@117 -- # sync 00:17:15.300 03:28:40 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:17:15.300 03:28:40 -- nvmf/common.sh@120 -- # set +e 00:17:15.300 03:28:40 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:15.300 03:28:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:17:15.300 rmmod nvme_tcp 00:17:15.560 rmmod nvme_fabrics 00:17:15.560 rmmod nvme_keyring 00:17:15.560 03:28:40 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:15.560 03:28:40 -- nvmf/common.sh@124 -- # set -e 00:17:15.560 03:28:40 -- nvmf/common.sh@125 -- # return 0 00:17:15.560 03:28:40 -- nvmf/common.sh@478 -- # '[' -n 1476006 ']' 00:17:15.560 03:28:40 -- nvmf/common.sh@479 -- # killprocess 1476006 00:17:15.560 03:28:40 -- common/autotest_common.sh@936 -- # '[' -z 1476006 ']' 00:17:15.560 03:28:40 -- common/autotest_common.sh@940 -- # kill -0 1476006 00:17:15.560 03:28:40 -- common/autotest_common.sh@941 -- # uname 00:17:15.560 03:28:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:15.560 03:28:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1476006 00:17:15.560 03:28:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:15.560 03:28:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:15.560 03:28:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1476006' 00:17:15.560 killing process with pid 1476006 00:17:15.560 03:28:40 -- common/autotest_common.sh@955 -- # kill 1476006 00:17:15.560 03:28:40 -- common/autotest_common.sh@960 -- # wait 1476006 00:17:16.130 03:28:40 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:16.130 03:28:40 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:17:16.130 03:28:40 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:17:16.130 03:28:40 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:16.130 03:28:40 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:17:16.130 03:28:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:16.130 03:28:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:16.130 03:28:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:18.036 03:28:42 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:17:18.036 00:17:18.036 real 0m7.865s 00:17:18.036 user 0m23.745s 00:17:18.036 sys 0m1.550s 00:17:18.036 03:28:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:18.036 03:28:42 -- common/autotest_common.sh@10 -- # set +x 00:17:18.036 ************************************ 00:17:18.036 END TEST nvmf_shutdown_tc2 00:17:18.036 ************************************ 00:17:18.036 03:28:42 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:17:18.036 03:28:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:18.036 03:28:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:18.036 03:28:42 -- common/autotest_common.sh@10 -- # set +x 00:17:18.293 ************************************ 00:17:18.293 START TEST nvmf_shutdown_tc3 00:17:18.293 ************************************ 00:17:18.293 03:28:43 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc3 00:17:18.293 03:28:43 -- target/shutdown.sh@121 -- # starttarget 00:17:18.293 03:28:43 -- target/shutdown.sh@15 -- # nvmftestinit 00:17:18.293 03:28:43 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:17:18.293 03:28:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:18.293 03:28:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:18.293 03:28:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:18.293 03:28:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:18.293 03:28:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:18.293 03:28:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:18.294 03:28:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:18.294 03:28:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:18.294 03:28:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:18.294 03:28:43 -- common/autotest_common.sh@10 -- # set +x 00:17:18.294 03:28:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:18.294 03:28:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:18.294 03:28:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:18.294 03:28:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:18.294 03:28:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:18.294 03:28:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:18.294 03:28:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:18.294 03:28:43 -- nvmf/common.sh@295 -- # net_devs=() 00:17:18.294 03:28:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:18.294 03:28:43 -- nvmf/common.sh@296 -- # e810=() 00:17:18.294 03:28:43 -- nvmf/common.sh@296 -- # local -ga e810 00:17:18.294 03:28:43 -- nvmf/common.sh@297 -- # x722=() 00:17:18.294 03:28:43 -- nvmf/common.sh@297 -- # local -ga x722 00:17:18.294 03:28:43 -- nvmf/common.sh@298 -- # mlx=() 00:17:18.294 03:28:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:18.294 03:28:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:18.294 03:28:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:18.294 03:28:43 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:18.294 03:28:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:18.294 03:28:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:18.294 03:28:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:17:18.294 Found 0000:09:00.0 (0x8086 - 0x159b) 00:17:18.294 03:28:43 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:18.294 03:28:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:17:18.294 Found 0000:09:00.1 (0x8086 - 0x159b) 00:17:18.294 03:28:43 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:18.294 03:28:43 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:18.294 03:28:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:18.294 03:28:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:18.294 03:28:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:18.294 03:28:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:17:18.294 Found net devices under 0000:09:00.0: cvl_0_0 00:17:18.294 03:28:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:18.294 03:28:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:18.294 03:28:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:18.294 03:28:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:18.294 03:28:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:18.294 03:28:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:17:18.294 Found net devices under 0000:09:00.1: cvl_0_1 00:17:18.294 03:28:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:18.294 03:28:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:18.294 03:28:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:18.294 03:28:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:17:18.294 03:28:43 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:18.294 03:28:43 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:18.294 03:28:43 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:18.294 03:28:43 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:17:18.294 03:28:43 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:18.294 03:28:43 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:18.294 03:28:43 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:17:18.294 03:28:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:18.294 03:28:43 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:18.294 03:28:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:17:18.294 03:28:43 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:17:18.294 03:28:43 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:17:18.294 03:28:43 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:18.294 03:28:43 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:18.294 03:28:43 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:18.294 03:28:43 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:17:18.294 03:28:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:18.294 03:28:43 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:18.294 03:28:43 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:18.294 03:28:43 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:17:18.294 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:18.294 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.152 ms 00:17:18.294 00:17:18.294 --- 10.0.0.2 ping statistics --- 00:17:18.294 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:18.294 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:17:18.294 03:28:43 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:18.294 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:18.294 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:17:18.294 00:17:18.294 --- 10.0.0.1 ping statistics --- 00:17:18.294 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:18.294 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:17:18.294 03:28:43 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:18.294 03:28:43 -- nvmf/common.sh@411 -- # return 0 00:17:18.294 03:28:43 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:18.294 03:28:43 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:18.294 03:28:43 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:17:18.294 03:28:43 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:18.294 03:28:43 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:17:18.294 03:28:43 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:17:18.294 03:28:43 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:17:18.294 03:28:43 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:18.294 03:28:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:18.294 03:28:43 -- common/autotest_common.sh@10 -- # set +x 00:17:18.294 03:28:43 -- nvmf/common.sh@470 -- # nvmfpid=1477110 00:17:18.294 03:28:43 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:18.294 03:28:43 -- nvmf/common.sh@471 -- # waitforlisten 1477110 00:17:18.294 03:28:43 -- common/autotest_common.sh@817 -- # '[' -z 1477110 ']' 00:17:18.294 03:28:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:18.294 03:28:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:18.294 03:28:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:18.294 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:18.294 03:28:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:18.294 03:28:43 -- common/autotest_common.sh@10 -- # set +x 00:17:18.294 [2024-04-27 03:28:43.264685] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:18.294 [2024-04-27 03:28:43.264767] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:18.553 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.553 [2024-04-27 03:28:43.331678] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:18.554 [2024-04-27 03:28:43.449658] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:18.554 [2024-04-27 03:28:43.449712] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:18.554 [2024-04-27 03:28:43.449741] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:18.554 [2024-04-27 03:28:43.449761] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:18.554 [2024-04-27 03:28:43.449772] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:18.554 [2024-04-27 03:28:43.449862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:18.554 [2024-04-27 03:28:43.449919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:18.554 [2024-04-27 03:28:43.449970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:18.554 [2024-04-27 03:28:43.449973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:18.814 03:28:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:18.814 03:28:43 -- common/autotest_common.sh@850 -- # return 0 00:17:18.814 03:28:43 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:18.814 03:28:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:18.814 03:28:43 -- common/autotest_common.sh@10 -- # set +x 00:17:18.814 03:28:43 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:18.814 03:28:43 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:18.814 03:28:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:18.814 03:28:43 -- common/autotest_common.sh@10 -- # set +x 00:17:18.814 [2024-04-27 03:28:43.606070] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:18.814 03:28:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:18.814 03:28:43 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:17:18.814 03:28:43 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:17:18.814 03:28:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:18.814 03:28:43 -- common/autotest_common.sh@10 -- # set +x 00:17:18.814 03:28:43 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:18.814 03:28:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:18.814 03:28:43 -- target/shutdown.sh@28 -- # cat 00:17:18.814 03:28:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:18.814 03:28:43 -- target/shutdown.sh@28 -- # cat 00:17:18.814 03:28:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:18.814 03:28:43 -- target/shutdown.sh@28 -- # cat 00:17:18.814 03:28:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:18.814 03:28:43 -- target/shutdown.sh@28 -- # cat 00:17:18.814 03:28:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:18.814 03:28:43 -- target/shutdown.sh@28 -- # cat 00:17:18.814 03:28:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:18.814 03:28:43 -- target/shutdown.sh@28 -- # cat 00:17:18.814 03:28:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:18.814 03:28:43 -- target/shutdown.sh@28 -- # cat 00:17:18.814 03:28:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:18.814 03:28:43 -- target/shutdown.sh@28 -- # cat 00:17:18.814 03:28:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:18.814 03:28:43 -- target/shutdown.sh@28 -- # cat 00:17:18.814 03:28:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:18.814 03:28:43 -- target/shutdown.sh@28 -- # cat 00:17:18.814 03:28:43 -- target/shutdown.sh@35 -- # rpc_cmd 00:17:18.814 03:28:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:18.814 03:28:43 -- common/autotest_common.sh@10 -- # set +x 00:17:18.814 Malloc1 00:17:18.814 [2024-04-27 03:28:43.695438] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:18.814 Malloc2 00:17:18.814 Malloc3 00:17:19.073 Malloc4 00:17:19.073 Malloc5 00:17:19.073 Malloc6 00:17:19.073 Malloc7 00:17:19.073 Malloc8 00:17:19.331 Malloc9 00:17:19.331 Malloc10 00:17:19.331 03:28:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:19.331 03:28:44 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:17:19.331 03:28:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:19.331 03:28:44 -- common/autotest_common.sh@10 -- # set +x 00:17:19.331 03:28:44 -- target/shutdown.sh@125 -- # perfpid=1477281 00:17:19.331 03:28:44 -- target/shutdown.sh@126 -- # waitforlisten 1477281 /var/tmp/bdevperf.sock 00:17:19.331 03:28:44 -- common/autotest_common.sh@817 -- # '[' -z 1477281 ']' 00:17:19.331 03:28:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:19.331 03:28:44 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:19.331 03:28:44 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:17:19.331 03:28:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:19.331 03:28:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:19.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:19.331 03:28:44 -- nvmf/common.sh@521 -- # config=() 00:17:19.331 03:28:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:19.331 03:28:44 -- nvmf/common.sh@521 -- # local subsystem config 00:17:19.331 03:28:44 -- common/autotest_common.sh@10 -- # set +x 00:17:19.331 03:28:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:19.331 { 00:17:19.331 "params": { 00:17:19.331 "name": "Nvme$subsystem", 00:17:19.331 "trtype": "$TEST_TRANSPORT", 00:17:19.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.331 "adrfam": "ipv4", 00:17:19.331 "trsvcid": "$NVMF_PORT", 00:17:19.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.331 "hdgst": ${hdgst:-false}, 00:17:19.331 "ddgst": ${ddgst:-false} 00:17:19.331 }, 00:17:19.331 "method": "bdev_nvme_attach_controller" 00:17:19.331 } 00:17:19.331 EOF 00:17:19.331 )") 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # cat 00:17:19.331 03:28:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:19.331 { 00:17:19.331 "params": { 00:17:19.331 "name": "Nvme$subsystem", 00:17:19.331 "trtype": "$TEST_TRANSPORT", 00:17:19.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.331 "adrfam": "ipv4", 00:17:19.331 "trsvcid": "$NVMF_PORT", 00:17:19.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.331 "hdgst": ${hdgst:-false}, 00:17:19.331 "ddgst": ${ddgst:-false} 00:17:19.331 }, 00:17:19.331 "method": "bdev_nvme_attach_controller" 00:17:19.331 } 00:17:19.331 EOF 00:17:19.331 )") 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # cat 00:17:19.331 03:28:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:19.331 { 00:17:19.331 "params": { 00:17:19.331 "name": "Nvme$subsystem", 00:17:19.331 "trtype": "$TEST_TRANSPORT", 00:17:19.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.331 "adrfam": "ipv4", 00:17:19.331 "trsvcid": "$NVMF_PORT", 00:17:19.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.331 "hdgst": ${hdgst:-false}, 00:17:19.331 "ddgst": ${ddgst:-false} 00:17:19.331 }, 00:17:19.331 "method": "bdev_nvme_attach_controller" 00:17:19.331 } 00:17:19.331 EOF 00:17:19.331 )") 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # cat 00:17:19.331 03:28:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:19.331 { 00:17:19.331 "params": { 00:17:19.331 "name": "Nvme$subsystem", 00:17:19.331 "trtype": "$TEST_TRANSPORT", 00:17:19.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.331 "adrfam": "ipv4", 00:17:19.331 "trsvcid": "$NVMF_PORT", 00:17:19.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.331 "hdgst": ${hdgst:-false}, 00:17:19.331 "ddgst": ${ddgst:-false} 00:17:19.331 }, 00:17:19.331 "method": "bdev_nvme_attach_controller" 00:17:19.331 } 00:17:19.331 EOF 00:17:19.331 )") 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # cat 00:17:19.331 03:28:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:19.331 { 00:17:19.331 "params": { 00:17:19.331 "name": "Nvme$subsystem", 00:17:19.331 "trtype": "$TEST_TRANSPORT", 00:17:19.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.331 "adrfam": "ipv4", 00:17:19.331 "trsvcid": "$NVMF_PORT", 00:17:19.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.331 "hdgst": ${hdgst:-false}, 00:17:19.331 "ddgst": ${ddgst:-false} 00:17:19.331 }, 00:17:19.331 "method": "bdev_nvme_attach_controller" 00:17:19.331 } 00:17:19.331 EOF 00:17:19.331 )") 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # cat 00:17:19.331 03:28:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:19.331 { 00:17:19.331 "params": { 00:17:19.331 "name": "Nvme$subsystem", 00:17:19.331 "trtype": "$TEST_TRANSPORT", 00:17:19.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.331 "adrfam": "ipv4", 00:17:19.331 "trsvcid": "$NVMF_PORT", 00:17:19.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.331 "hdgst": ${hdgst:-false}, 00:17:19.331 "ddgst": ${ddgst:-false} 00:17:19.331 }, 00:17:19.331 "method": "bdev_nvme_attach_controller" 00:17:19.331 } 00:17:19.331 EOF 00:17:19.331 )") 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # cat 00:17:19.331 03:28:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:19.331 03:28:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:19.331 { 00:17:19.331 "params": { 00:17:19.331 "name": "Nvme$subsystem", 00:17:19.331 "trtype": "$TEST_TRANSPORT", 00:17:19.332 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "$NVMF_PORT", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.332 "hdgst": ${hdgst:-false}, 00:17:19.332 "ddgst": ${ddgst:-false} 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 } 00:17:19.332 EOF 00:17:19.332 )") 00:17:19.332 03:28:44 -- nvmf/common.sh@543 -- # cat 00:17:19.332 03:28:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:19.332 03:28:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:19.332 { 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme$subsystem", 00:17:19.332 "trtype": "$TEST_TRANSPORT", 00:17:19.332 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "$NVMF_PORT", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.332 "hdgst": ${hdgst:-false}, 00:17:19.332 "ddgst": ${ddgst:-false} 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 } 00:17:19.332 EOF 00:17:19.332 )") 00:17:19.332 03:28:44 -- nvmf/common.sh@543 -- # cat 00:17:19.332 03:28:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:19.332 03:28:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:19.332 { 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme$subsystem", 00:17:19.332 "trtype": "$TEST_TRANSPORT", 00:17:19.332 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "$NVMF_PORT", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.332 "hdgst": ${hdgst:-false}, 00:17:19.332 "ddgst": ${ddgst:-false} 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 } 00:17:19.332 EOF 00:17:19.332 )") 00:17:19.332 03:28:44 -- nvmf/common.sh@543 -- # cat 00:17:19.332 03:28:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:19.332 03:28:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:19.332 { 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme$subsystem", 00:17:19.332 "trtype": "$TEST_TRANSPORT", 00:17:19.332 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "$NVMF_PORT", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.332 "hdgst": ${hdgst:-false}, 00:17:19.332 "ddgst": ${ddgst:-false} 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 } 00:17:19.332 EOF 00:17:19.332 )") 00:17:19.332 03:28:44 -- nvmf/common.sh@543 -- # cat 00:17:19.332 03:28:44 -- nvmf/common.sh@545 -- # jq . 00:17:19.332 03:28:44 -- nvmf/common.sh@546 -- # IFS=, 00:17:19.332 03:28:44 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme1", 00:17:19.332 "trtype": "tcp", 00:17:19.332 "traddr": "10.0.0.2", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "4420", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:19.332 "hdgst": false, 00:17:19.332 "ddgst": false 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 },{ 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme2", 00:17:19.332 "trtype": "tcp", 00:17:19.332 "traddr": "10.0.0.2", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "4420", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:19.332 "hdgst": false, 00:17:19.332 "ddgst": false 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 },{ 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme3", 00:17:19.332 "trtype": "tcp", 00:17:19.332 "traddr": "10.0.0.2", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "4420", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:17:19.332 "hdgst": false, 00:17:19.332 "ddgst": false 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 },{ 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme4", 00:17:19.332 "trtype": "tcp", 00:17:19.332 "traddr": "10.0.0.2", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "4420", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:17:19.332 "hdgst": false, 00:17:19.332 "ddgst": false 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 },{ 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme5", 00:17:19.332 "trtype": "tcp", 00:17:19.332 "traddr": "10.0.0.2", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "4420", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:17:19.332 "hdgst": false, 00:17:19.332 "ddgst": false 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 },{ 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme6", 00:17:19.332 "trtype": "tcp", 00:17:19.332 "traddr": "10.0.0.2", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "4420", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:17:19.332 "hdgst": false, 00:17:19.332 "ddgst": false 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 },{ 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme7", 00:17:19.332 "trtype": "tcp", 00:17:19.332 "traddr": "10.0.0.2", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "4420", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:17:19.332 "hdgst": false, 00:17:19.332 "ddgst": false 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 },{ 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme8", 00:17:19.332 "trtype": "tcp", 00:17:19.332 "traddr": "10.0.0.2", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "4420", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:17:19.332 "hdgst": false, 00:17:19.332 "ddgst": false 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 },{ 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme9", 00:17:19.332 "trtype": "tcp", 00:17:19.332 "traddr": "10.0.0.2", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "4420", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:17:19.332 "hdgst": false, 00:17:19.332 "ddgst": false 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 },{ 00:17:19.332 "params": { 00:17:19.332 "name": "Nvme10", 00:17:19.332 "trtype": "tcp", 00:17:19.332 "traddr": "10.0.0.2", 00:17:19.332 "adrfam": "ipv4", 00:17:19.332 "trsvcid": "4420", 00:17:19.332 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:17:19.332 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:17:19.332 "hdgst": false, 00:17:19.332 "ddgst": false 00:17:19.332 }, 00:17:19.332 "method": "bdev_nvme_attach_controller" 00:17:19.332 }' 00:17:19.332 [2024-04-27 03:28:44.209271] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:19.332 [2024-04-27 03:28:44.209349] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1477281 ] 00:17:19.332 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.332 [2024-04-27 03:28:44.272610] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.590 [2024-04-27 03:28:44.377899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:21.495 Running I/O for 10 seconds... 00:17:21.495 03:28:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:21.495 03:28:46 -- common/autotest_common.sh@850 -- # return 0 00:17:21.495 03:28:46 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:21.495 03:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:21.495 03:28:46 -- common/autotest_common.sh@10 -- # set +x 00:17:21.495 03:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:21.495 03:28:46 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:21.495 03:28:46 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:17:21.495 03:28:46 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:21.495 03:28:46 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:17:21.495 03:28:46 -- target/shutdown.sh@57 -- # local ret=1 00:17:21.495 03:28:46 -- target/shutdown.sh@58 -- # local i 00:17:21.495 03:28:46 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:17:21.495 03:28:46 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:17:21.495 03:28:46 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:17:21.495 03:28:46 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:17:21.495 03:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:21.495 03:28:46 -- common/autotest_common.sh@10 -- # set +x 00:17:21.495 03:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:21.495 03:28:46 -- target/shutdown.sh@60 -- # read_io_count=3 00:17:21.495 03:28:46 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:17:21.495 03:28:46 -- target/shutdown.sh@67 -- # sleep 0.25 00:17:21.495 03:28:46 -- target/shutdown.sh@59 -- # (( i-- )) 00:17:21.495 03:28:46 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:17:21.495 03:28:46 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:17:21.495 03:28:46 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:17:21.495 03:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:21.495 03:28:46 -- common/autotest_common.sh@10 -- # set +x 00:17:21.755 03:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:21.755 03:28:46 -- target/shutdown.sh@60 -- # read_io_count=67 00:17:21.755 03:28:46 -- target/shutdown.sh@63 -- # '[' 67 -ge 100 ']' 00:17:21.755 03:28:46 -- target/shutdown.sh@67 -- # sleep 0.25 00:17:22.034 03:28:46 -- target/shutdown.sh@59 -- # (( i-- )) 00:17:22.034 03:28:46 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:17:22.034 03:28:46 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:17:22.034 03:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:22.034 03:28:46 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:17:22.034 03:28:46 -- common/autotest_common.sh@10 -- # set +x 00:17:22.034 03:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:22.034 03:28:46 -- target/shutdown.sh@60 -- # read_io_count=131 00:17:22.034 03:28:46 -- target/shutdown.sh@63 -- # '[' 131 -ge 100 ']' 00:17:22.034 03:28:46 -- target/shutdown.sh@64 -- # ret=0 00:17:22.034 03:28:46 -- target/shutdown.sh@65 -- # break 00:17:22.034 03:28:46 -- target/shutdown.sh@69 -- # return 0 00:17:22.034 03:28:46 -- target/shutdown.sh@135 -- # killprocess 1477110 00:17:22.034 03:28:46 -- common/autotest_common.sh@936 -- # '[' -z 1477110 ']' 00:17:22.034 03:28:46 -- common/autotest_common.sh@940 -- # kill -0 1477110 00:17:22.034 03:28:46 -- common/autotest_common.sh@941 -- # uname 00:17:22.034 03:28:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:22.034 03:28:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1477110 00:17:22.034 03:28:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:22.034 03:28:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:22.034 03:28:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1477110' 00:17:22.034 killing process with pid 1477110 00:17:22.034 03:28:46 -- common/autotest_common.sh@955 -- # kill 1477110 00:17:22.034 03:28:46 -- common/autotest_common.sh@960 -- # wait 1477110 00:17:22.034 [2024-04-27 03:28:46.829001] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829077] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829108] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829120] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829132] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829144] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829156] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829169] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829181] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829193] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829204] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829216] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829228] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829240] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829261] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829274] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829297] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829310] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829322] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829350] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829363] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829374] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829386] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829398] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829410] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829421] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829433] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829444] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829456] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829468] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829480] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829491] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829503] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829515] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829539] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829551] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829563] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829574] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829586] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829603] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829615] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829627] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829638] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829650] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829662] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829675] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829691] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829703] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829715] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829727] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829746] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829758] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829769] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829781] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.034 [2024-04-27 03:28:46.829793] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.829805] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.829816] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.829828] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.829840] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.829851] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.829863] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.829875] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.829887] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23418b0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831065] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831096] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831110] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831122] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831133] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831146] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831158] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831170] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831182] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831194] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831218] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831231] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831243] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831273] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831321] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831333] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831346] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831358] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831369] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831381] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831393] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831405] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831417] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831429] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831440] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831452] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831465] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831477] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831489] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831501] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831512] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831524] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831544] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831556] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831568] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831579] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831592] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831608] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831620] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831632] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831645] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831657] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831669] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831681] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831692] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831704] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831716] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831728] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831739] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831751] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831762] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831774] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831786] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831798] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831809] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831821] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831833] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831845] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831856] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831868] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831880] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831892] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.831904] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c3e0 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833177] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833204] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833217] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833229] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833241] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833261] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833273] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833285] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833297] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833309] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833321] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833333] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833345] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.035 [2024-04-27 03:28:46.833357] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833368] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833380] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833392] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833404] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833415] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833427] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833438] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833450] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833462] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833474] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833486] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833497] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833509] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833520] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833532] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833547] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833559] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833571] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833583] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833595] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833607] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833618] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833630] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833642] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833654] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833666] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833678] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833690] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833702] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833714] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833726] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833738] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833750] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833762] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833773] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833785] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833797] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833809] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833821] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833833] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833846] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833857] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833877] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833890] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833902] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833913] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833925] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833938] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.833950] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2341d40 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835544] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835580] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835595] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835608] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835621] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835634] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835646] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835658] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835671] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835684] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835695] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835707] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835720] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835733] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835745] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835757] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835769] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835783] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835795] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835807] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835827] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835840] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835852] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835864] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835878] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835890] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835902] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835915] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835929] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835942] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835953] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835965] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835979] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.835992] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.836004] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.036 [2024-04-27 03:28:46.836015] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836028] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836040] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836052] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836064] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836078] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836090] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836102] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836114] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836128] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836140] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836152] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836167] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836181] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836193] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836205] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836216] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836230] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836242] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836263] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836278] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836290] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836313] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836326] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836338] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836349] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836361] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.836372] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1febbc0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838271] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838298] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838317] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838329] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838341] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838352] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838364] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838376] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838388] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838400] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838411] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838428] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838440] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838452] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838463] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838475] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838486] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838498] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838510] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838521] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838533] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838545] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838557] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838569] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838581] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838592] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838604] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838615] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838627] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838638] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838650] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838662] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838673] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838685] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838697] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838709] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838720] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838732] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838747] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838759] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838771] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838783] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838794] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838806] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838818] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.037 [2024-04-27 03:28:46.838830] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838841] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838853] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838865] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838877] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838888] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838900] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838912] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838924] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838936] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838948] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838961] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838973] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838984] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.838996] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.839008] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.839020] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.839032] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fec4e0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840091] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840114] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840132] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840144] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840155] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840167] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840180] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840192] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840203] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840215] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840227] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840238] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840258] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840271] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840283] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840294] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840306] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840318] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840330] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840341] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840353] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840365] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840377] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840389] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840401] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840412] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840424] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840436] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840447] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840462] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840475] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840487] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840499] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840511] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840523] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840535] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840546] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840558] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840570] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840582] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840593] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840605] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840617] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840629] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840640] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.038 [2024-04-27 03:28:46.840652] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840664] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840676] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840687] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840699] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840711] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840722] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840734] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840747] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840759] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840771] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840782] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840797] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840810] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840821] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840833] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840844] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.840856] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b1a0 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842128] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842154] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842167] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842179] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842191] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842202] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842214] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842226] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842238] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842269] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842285] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842296] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842318] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842329] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842341] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842353] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842364] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842387] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842404] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842416] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842428] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842445] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842458] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842469] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842481] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842493] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842504] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842516] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842511] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-04-27 03:28:46.842527] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with id:0 cdw10:00000000 cdw11:00000000 00:17:22.039 the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842544] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842557] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.039 [2024-04-27 03:28:46.842568] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842580] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with [2024-04-27 03:28:46.842579] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsthe state(5) to be set 00:17:22.039 id:0 cdw10:00000000 cdw11:00000000 00:17:22.039 [2024-04-27 03:28:46.842593] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.039 [2024-04-27 03:28:46.842605] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.039 [2024-04-27 03:28:46.842617] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.039 [2024-04-27 03:28:46.842630] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842637] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.039 [2024-04-27 03:28:46.842642] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.039 [2024-04-27 03:28:46.842654] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1153e70 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842669] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842682] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842694] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842705] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842717] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842716] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.039 [2024-04-27 03:28:46.842729] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.039 [2024-04-27 03:28:46.842741] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842752] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-04-27 03:28:46.842753] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with id:0 cdw10:00000000 cdw11:00000000 00:17:22.039 the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842767] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with [2024-04-27 03:28:46.842767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:17:22.039 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.039 [2024-04-27 03:28:46.842780] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842783] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.039 [2024-04-27 03:28:46.842792] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.039 [2024-04-27 03:28:46.842805] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.039 [2024-04-27 03:28:46.842810] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.842817] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.842829] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1152da0 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842841] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842853] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842865] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842880] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842892] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842894] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.842904] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-04-27 03:28:46.842916] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842930] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with [2024-04-27 03:28:46.842930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsthe state(5) to be set 00:17:22.040 id:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.842944] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with [2024-04-27 03:28:46.842945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:17:22.040 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.842957] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224b630 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.842960] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.842973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.842987] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1249b10 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.843057] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843091] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843118] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843144] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10879a0 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.843211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843259] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843288] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843315] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc769b0 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.843383] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843416] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843443] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843469] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10b82b0 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.843536] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843570] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843597] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843624] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1252d90 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.843702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843736] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843763] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843789] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.040 [2024-04-27 03:28:46.843802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.843814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x108c560 is same with the state(5) to be set 00:17:22.040 [2024-04-27 03:28:46.844601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.040 [2024-04-27 03:28:46.844626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.844653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.040 [2024-04-27 03:28:46.844669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.844686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.040 [2024-04-27 03:28:46.844700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.844715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.040 [2024-04-27 03:28:46.844729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.844744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.040 [2024-04-27 03:28:46.844758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.844773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.040 [2024-04-27 03:28:46.844786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.040 [2024-04-27 03:28:46.844801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.040 [2024-04-27 03:28:46.844815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.844830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.844843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.844869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.844884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.844899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.844912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.844927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.844941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.844956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.844969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.844984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.844998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845171] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845199] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with [2024-04-27 03:28:46.845207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:17:22.041 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845221] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845236] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845255] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845269] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845289] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845302] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845314] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845326] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with [2024-04-27 03:28:46.845326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:27520 len:1the state(5) to be set 00:17:22.041 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845342] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845355] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845367] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845379] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:27776 len:1[2024-04-27 03:28:46.845391] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845405] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with [2024-04-27 03:28:46.845406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:17:22.041 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845423] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845436] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845448] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845460] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-04-27 03:28:46.845472] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845485] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845497] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845509] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845521] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 [2024-04-27 03:28:46.845533] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28416 len:1[2024-04-27 03:28:46.845548] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-04-27 03:28:46.845562] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.041 the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845577] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.041 [2024-04-27 03:28:46.845578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.041 [2024-04-27 03:28:46.845589] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with [2024-04-27 03:28:46.845592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:17:22.041 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845606] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.845620] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845632] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.845645] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845658] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:1[2024-04-27 03:28:46.845670] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845684] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with [2024-04-27 03:28:46.845684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:17:22.042 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845698] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.845711] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845723] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.845736] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845749] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:29312 len:1[2024-04-27 03:28:46.845761] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845776] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with [2024-04-27 03:28:46.845776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:17:22.042 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845794] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.845806] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845819] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.845832] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845844] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:29696 len:1[2024-04-27 03:28:46.845856] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-04-27 03:28:46.845872] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845887] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.845899] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845911] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.845924] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.845937] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30080 len:1[2024-04-27 03:28:46.845949] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-04-27 03:28:46.845963] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845981] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.845993] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.845998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846006] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.846014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.846019] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.846028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846031] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with the state(5) to be set 00:17:22.042 [2024-04-27 03:28:46.846044] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bf50 is same with [2024-04-27 03:28:46.846044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:30464 len:1the state(5) to be set 00:17:22.042 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.846060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.846088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.846116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.846144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.846175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.846204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.846232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.846273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.042 [2024-04-27 03:28:46.846302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.042 [2024-04-27 03:28:46.846317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.846331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.846346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.846359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.846374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.846387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.846403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.846416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.846431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.846445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.846460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.846473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.846489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.846502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.846519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.846541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.846557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.846570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.846606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:17:22.043 [2024-04-27 03:28:46.846682] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x121f5a0 was disconnected and freed. reset controller. 00:17:22.043 [2024-04-27 03:28:46.847396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.847978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.847992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.848007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.848020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.848036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.043 [2024-04-27 03:28:46.848050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.043 [2024-04-27 03:28:46.848065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.848980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.848994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.849009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.849023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.849038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.849052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.849067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.849081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.849103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.849118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.849133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.849146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.849161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.849175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.849190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.849204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.849219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.849233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.849254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.044 [2024-04-27 03:28:46.849270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.044 [2024-04-27 03:28:46.849285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.849308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.849323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.849341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.849372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:17:22.045 [2024-04-27 03:28:46.849439] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x10842b0 was disconnected and freed. reset controller. 00:17:22.045 [2024-04-27 03:28:46.852283] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:17:22.045 [2024-04-27 03:28:46.852334] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10b82b0 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.852885] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:17:22.045 [2024-04-27 03:28:46.852962] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1253880 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.853064] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.045 [2024-04-27 03:28:46.853087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.853102] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.045 [2024-04-27 03:28:46.853115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.853129] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.045 [2024-04-27 03:28:46.853143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.853157] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:22.045 [2024-04-27 03:28:46.853170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.853183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1146ac0 is same with the state(5) to be set 00:17:22.045 [2024-04-27 03:28:46.853214] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1153e70 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.853256] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1152da0 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.853301] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1249b10 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.853332] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10879a0 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.853361] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc769b0 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.853390] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1252d90 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.853422] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x108c560 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.854528] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:17:22.045 [2024-04-27 03:28:46.854717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.045 [2024-04-27 03:28:46.854839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.045 [2024-04-27 03:28:46.854866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10b82b0 with addr=10.0.0.2, port=4420 00:17:22.045 [2024-04-27 03:28:46.854894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10b82b0 is same with the state(5) to be set 00:17:22.045 [2024-04-27 03:28:46.854984] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:17:22.045 [2024-04-27 03:28:46.855052] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:17:22.045 [2024-04-27 03:28:46.855116] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:17:22.045 [2024-04-27 03:28:46.855201] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:17:22.045 [2024-04-27 03:28:46.855277] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:17:22.045 [2024-04-27 03:28:46.855354] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:17:22.045 [2024-04-27 03:28:46.855461] nvme_tcp.c:1215:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:17:22.045 [2024-04-27 03:28:46.855633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.045 [2024-04-27 03:28:46.855742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.045 [2024-04-27 03:28:46.855767] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1253880 with addr=10.0.0.2, port=4420 00:17:22.045 [2024-04-27 03:28:46.855782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1253880 is same with the state(5) to be set 00:17:22.045 [2024-04-27 03:28:46.855800] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10b82b0 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.855937] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1253880 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.855969] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:17:22.045 [2024-04-27 03:28:46.855985] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:17:22.045 [2024-04-27 03:28:46.856001] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:17:22.045 [2024-04-27 03:28:46.856067] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.045 [2024-04-27 03:28:46.856087] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:17:22.045 [2024-04-27 03:28:46.856100] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:17:22.045 [2024-04-27 03:28:46.856113] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:17:22.045 [2024-04-27 03:28:46.856171] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.045 [2024-04-27 03:28:46.862933] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1146ac0 (9): Bad file descriptor 00:17:22.045 [2024-04-27 03:28:46.863194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.045 [2024-04-27 03:28:46.863828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.045 [2024-04-27 03:28:46.863846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.863862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.863876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.863892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.863906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.863921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.863935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.863950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.863964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.863980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.863994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.864968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.864987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.865002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.865018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.046 [2024-04-27 03:28:46.865032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.046 [2024-04-27 03:28:46.865048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.865062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.865077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.865093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.865109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.865123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.865139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.865153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.865168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.865182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.865198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.865212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.865227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.865242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.865265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.865281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.865296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123aaa0 is same with the state(5) to be set 00:17:22.047 [2024-04-27 03:28:46.866570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.866974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.866988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.047 [2024-04-27 03:28:46.867322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.047 [2024-04-27 03:28:46.867337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.867980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.867993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.048 [2024-04-27 03:28:46.868511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.048 [2024-04-27 03:28:46.868526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123bd20 is same with the state(5) to be set 00:17:22.048 [2024-04-27 03:28:46.869756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.869779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.869800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.869816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.869832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.869846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.869862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.869876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.869891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.869906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.869922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.869936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.869951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.869965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.869981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.869995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.049 [2024-04-27 03:28:46.870964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.049 [2024-04-27 03:28:46.870979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.870993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.871688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.871703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x121e170 is same with the state(5) to be set 00:17:22.050 [2024-04-27 03:28:46.872947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.872969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.872989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.050 [2024-04-27 03:28:46.873406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.050 [2024-04-27 03:28:46.873422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.873981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.873995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.051 [2024-04-27 03:28:46.874606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.051 [2024-04-27 03:28:46.874622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.874636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.874652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.874666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.874681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.874695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.874710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.874724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.874740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.874754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.874770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.874783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.874802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.874817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.874833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.874847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.874862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.874875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.874890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1220a10 is same with the state(5) to be set 00:17:22.052 [2024-04-27 03:28:46.876121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.052 [2024-04-27 03:28:46.876837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.052 [2024-04-27 03:28:46.876852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.876867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.876881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.876897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.876910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.876926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.876940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.876955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.876969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.876985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.876998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.877984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.877999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.878013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.053 [2024-04-27 03:28:46.878029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.053 [2024-04-27 03:28:46.878042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.878057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1081950 is same with the state(5) to be set 00:17:22.054 [2024-04-27 03:28:46.879309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.879980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.879996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.054 [2024-04-27 03:28:46.880487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.054 [2024-04-27 03:28:46.880501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.880978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.880993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.881007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.881022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.881035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.881051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.881068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.881084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.881098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.881113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.881127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.881142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.881156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.881171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.881184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.881200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.881214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.881229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.881242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.881269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1082e00 is same with the state(5) to be set 00:17:22.055 [2024-04-27 03:28:46.882526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.055 [2024-04-27 03:28:46.882945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.055 [2024-04-27 03:28:46.882958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.882974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.882988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.056 [2024-04-27 03:28:46.883942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.056 [2024-04-27 03:28:46.883955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.883971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.883984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.884468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.884482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1232cd0 is same with the state(5) to be set 00:17:22.057 [2024-04-27 03:28:46.886233] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:22.057 [2024-04-27 03:28:46.886270] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:17:22.057 [2024-04-27 03:28:46.886298] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:17:22.057 [2024-04-27 03:28:46.886395] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:22.057 [2024-04-27 03:28:46.886423] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:22.057 [2024-04-27 03:28:46.886442] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:22.057 [2024-04-27 03:28:46.886463] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:22.057 [2024-04-27 03:28:46.886483] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:22.057 [2024-04-27 03:28:46.886606] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:17:22.057 [2024-04-27 03:28:46.886636] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:17:22.057 [2024-04-27 03:28:46.886653] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:17:22.057 [2024-04-27 03:28:46.886668] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:17:22.057 [2024-04-27 03:28:46.886684] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:17:22.057 [2024-04-27 03:28:46.886972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.887101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.887126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc769b0 with addr=10.0.0.2, port=4420 00:17:22.057 [2024-04-27 03:28:46.887142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc769b0 is same with the state(5) to be set 00:17:22.057 [2024-04-27 03:28:46.887243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.887368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.887391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10879a0 with addr=10.0.0.2, port=4420 00:17:22.057 [2024-04-27 03:28:46.887407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10879a0 is same with the state(5) to be set 00:17:22.057 [2024-04-27 03:28:46.887502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.887626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.887650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x108c560 with addr=10.0.0.2, port=4420 00:17:22.057 [2024-04-27 03:28:46.887666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x108c560 is same with the state(5) to be set 00:17:22.057 [2024-04-27 03:28:46.889691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.889809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.889834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1153e70 with addr=10.0.0.2, port=4420 00:17:22.057 [2024-04-27 03:28:46.889849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1153e70 is same with the state(5) to be set 00:17:22.057 [2024-04-27 03:28:46.889940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.890046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.890070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1152da0 with addr=10.0.0.2, port=4420 00:17:22.057 [2024-04-27 03:28:46.890085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1152da0 is same with the state(5) to be set 00:17:22.057 [2024-04-27 03:28:46.890175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.890283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.890307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1249b10 with addr=10.0.0.2, port=4420 00:17:22.057 [2024-04-27 03:28:46.890323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1249b10 is same with the state(5) to be set 00:17:22.057 [2024-04-27 03:28:46.890417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.890523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.890552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1252d90 with addr=10.0.0.2, port=4420 00:17:22.057 [2024-04-27 03:28:46.890567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1252d90 is same with the state(5) to be set 00:17:22.057 [2024-04-27 03:28:46.890673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.890770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.057 [2024-04-27 03:28:46.890793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10b82b0 with addr=10.0.0.2, port=4420 00:17:22.057 [2024-04-27 03:28:46.890808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10b82b0 is same with the state(5) to be set 00:17:22.057 [2024-04-27 03:28:46.890832] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc769b0 (9): Bad file descriptor 00:17:22.057 [2024-04-27 03:28:46.890852] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10879a0 (9): Bad file descriptor 00:17:22.057 [2024-04-27 03:28:46.890869] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x108c560 (9): Bad file descriptor 00:17:22.057 [2024-04-27 03:28:46.890986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.891009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.891037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.057 [2024-04-27 03:28:46.891052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.057 [2024-04-27 03:28:46.891069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.891975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.891988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.892004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.892018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.892034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.892051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.892068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.892082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.892097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.892111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.892127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.892141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.892157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.892170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.892186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.892200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.058 [2024-04-27 03:28:46.892216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.058 [2024-04-27 03:28:46.892230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:22.059 [2024-04-27 03:28:46.892944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:22.059 [2024-04-27 03:28:46.892959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1085510 is same with the state(5) to be set 00:17:22.059 [2024-04-27 03:28:46.894734] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:17:22.059 task offset: 24576 on job bdev=Nvme4n1 fails 00:17:22.059 00:17:22.059 Latency(us) 00:17:22.059 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:22.059 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.059 Job: Nvme1n1 ended in about 0.91 seconds with error 00:17:22.059 Verification LBA range: start 0x0 length 0x400 00:17:22.059 Nvme1n1 : 0.91 141.00 8.81 70.50 0.00 299270.45 25826.04 257872.02 00:17:22.059 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.059 Job: Nvme2n1 ended in about 0.91 seconds with error 00:17:22.059 Verification LBA range: start 0x0 length 0x400 00:17:22.059 Nvme2n1 : 0.91 140.51 8.78 70.26 0.00 294350.70 22233.69 271853.04 00:17:22.059 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.059 Job: Nvme3n1 ended in about 0.91 seconds with error 00:17:22.059 Verification LBA range: start 0x0 length 0x400 00:17:22.059 Nvme3n1 : 0.91 210.03 13.13 70.01 0.00 216881.11 16214.09 259425.47 00:17:22.059 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.059 Job: Nvme4n1 ended in about 0.89 seconds with error 00:17:22.059 Verification LBA range: start 0x0 length 0x400 00:17:22.059 Nvme4n1 : 0.89 215.19 13.45 71.73 0.00 206851.03 20388.98 251658.24 00:17:22.059 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.059 Job: Nvme5n1 ended in about 0.92 seconds with error 00:17:22.059 Verification LBA range: start 0x0 length 0x400 00:17:22.059 Nvme5n1 : 0.92 139.54 8.72 69.77 0.00 278121.43 25631.86 259425.47 00:17:22.059 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.059 Job: Nvme6n1 ended in about 0.92 seconds with error 00:17:22.059 Verification LBA range: start 0x0 length 0x400 00:17:22.059 Nvme6n1 : 0.92 139.06 8.69 69.53 0.00 273227.47 20971.52 257872.02 00:17:22.059 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.059 Job: Nvme7n1 ended in about 0.92 seconds with error 00:17:22.059 Verification LBA range: start 0x0 length 0x400 00:17:22.059 Nvme7n1 : 0.92 138.58 8.66 69.29 0.00 268361.83 16796.63 260978.92 00:17:22.059 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.059 Job: Nvme8n1 ended in about 0.89 seconds with error 00:17:22.059 Verification LBA range: start 0x0 length 0x400 00:17:22.059 Nvme8n1 : 0.89 214.88 13.43 71.63 0.00 189319.02 9223.59 260978.92 00:17:22.059 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.059 Job: Nvme9n1 ended in about 0.94 seconds with error 00:17:22.059 Verification LBA range: start 0x0 length 0x400 00:17:22.059 Nvme9n1 : 0.94 136.84 8.55 68.42 0.00 260549.09 25826.04 279620.27 00:17:22.059 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:22.059 Job: Nvme10n1 ended in about 0.93 seconds with error 00:17:22.059 Verification LBA range: start 0x0 length 0x400 00:17:22.059 Nvme10n1 : 0.93 138.10 8.63 69.05 0.00 251890.60 21748.24 288940.94 00:17:22.059 =================================================================================================================== 00:17:22.059 Total : 1613.74 100.86 700.18 0.00 249379.37 9223.59 288940.94 00:17:22.059 [2024-04-27 03:28:46.923955] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:22.059 [2024-04-27 03:28:46.924053] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:17:22.059 [2024-04-27 03:28:46.924139] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1153e70 (9): Bad file descriptor 00:17:22.059 [2024-04-27 03:28:46.924168] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1152da0 (9): Bad file descriptor 00:17:22.059 [2024-04-27 03:28:46.924187] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1249b10 (9): Bad file descriptor 00:17:22.059 [2024-04-27 03:28:46.924205] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1252d90 (9): Bad file descriptor 00:17:22.059 [2024-04-27 03:28:46.924222] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10b82b0 (9): Bad file descriptor 00:17:22.060 [2024-04-27 03:28:46.924239] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.924261] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.924278] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:22.060 [2024-04-27 03:28:46.924315] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.924329] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.924342] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:22.060 [2024-04-27 03:28:46.924358] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.924380] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.924395] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:17:22.060 [2024-04-27 03:28:46.924604] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.924628] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.924641] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.924938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.060 [2024-04-27 03:28:46.925061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.060 [2024-04-27 03:28:46.925088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1253880 with addr=10.0.0.2, port=4420 00:17:22.060 [2024-04-27 03:28:46.925107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1253880 is same with the state(5) to be set 00:17:22.060 [2024-04-27 03:28:46.925232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.060 [2024-04-27 03:28:46.925346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.060 [2024-04-27 03:28:46.925374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1146ac0 with addr=10.0.0.2, port=4420 00:17:22.060 [2024-04-27 03:28:46.925390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1146ac0 is same with the state(5) to be set 00:17:22.060 [2024-04-27 03:28:46.925404] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.925418] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.925430] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:17:22.060 [2024-04-27 03:28:46.925448] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.925461] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.925473] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:17:22.060 [2024-04-27 03:28:46.925491] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.925504] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.925516] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:17:22.060 [2024-04-27 03:28:46.925532] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.925545] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.925558] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:17:22.060 [2024-04-27 03:28:46.925573] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.925586] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.925598] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:17:22.060 [2024-04-27 03:28:46.925648] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:22.060 [2024-04-27 03:28:46.925670] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:22.060 [2024-04-27 03:28:46.925688] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:22.060 [2024-04-27 03:28:46.925704] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:22.060 [2024-04-27 03:28:46.925721] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:22.060 [2024-04-27 03:28:46.926070] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.926093] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.926106] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.926117] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.926128] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.926151] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1253880 (9): Bad file descriptor 00:17:22.060 [2024-04-27 03:28:46.926172] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1146ac0 (9): Bad file descriptor 00:17:22.060 [2024-04-27 03:28:46.926254] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:17:22.060 [2024-04-27 03:28:46.926280] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:17:22.060 [2024-04-27 03:28:46.926309] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.926325] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.926338] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:17:22.060 [2024-04-27 03:28:46.926355] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.926368] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.926389] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:17:22.060 [2024-04-27 03:28:46.926425] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:22.060 [2024-04-27 03:28:46.926456] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.926472] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.926585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.060 [2024-04-27 03:28:46.926698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.060 [2024-04-27 03:28:46.926723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x108c560 with addr=10.0.0.2, port=4420 00:17:22.060 [2024-04-27 03:28:46.926738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x108c560 is same with the state(5) to be set 00:17:22.060 [2024-04-27 03:28:46.926832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.060 [2024-04-27 03:28:46.926951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.060 [2024-04-27 03:28:46.926976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10879a0 with addr=10.0.0.2, port=4420 00:17:22.060 [2024-04-27 03:28:46.926992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10879a0 is same with the state(5) to be set 00:17:22.060 [2024-04-27 03:28:46.927120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.060 [2024-04-27 03:28:46.927222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:17:22.060 [2024-04-27 03:28:46.927255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc769b0 with addr=10.0.0.2, port=4420 00:17:22.060 [2024-04-27 03:28:46.927273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc769b0 is same with the state(5) to be set 00:17:22.060 [2024-04-27 03:28:46.927292] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x108c560 (9): Bad file descriptor 00:17:22.060 [2024-04-27 03:28:46.927314] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10879a0 (9): Bad file descriptor 00:17:22.060 [2024-04-27 03:28:46.927363] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc769b0 (9): Bad file descriptor 00:17:22.060 [2024-04-27 03:28:46.927383] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.927396] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.927409] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:17:22.060 [2024-04-27 03:28:46.927425] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.927438] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.927455] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:22.060 [2024-04-27 03:28:46.927495] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.927512] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.060 [2024-04-27 03:28:46.927525] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:22.060 [2024-04-27 03:28:46.927537] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:17:22.060 [2024-04-27 03:28:46.927549] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:22.060 [2024-04-27 03:28:46.927583] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:22.629 03:28:47 -- target/shutdown.sh@136 -- # nvmfpid= 00:17:22.629 03:28:47 -- target/shutdown.sh@139 -- # sleep 1 00:17:23.569 03:28:48 -- target/shutdown.sh@142 -- # kill -9 1477281 00:17:23.569 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 142: kill: (1477281) - No such process 00:17:23.569 03:28:48 -- target/shutdown.sh@142 -- # true 00:17:23.569 03:28:48 -- target/shutdown.sh@144 -- # stoptarget 00:17:23.569 03:28:48 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:17:23.569 03:28:48 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:23.569 03:28:48 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:23.569 03:28:48 -- target/shutdown.sh@45 -- # nvmftestfini 00:17:23.569 03:28:48 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:23.569 03:28:48 -- nvmf/common.sh@117 -- # sync 00:17:23.569 03:28:48 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:17:23.569 03:28:48 -- nvmf/common.sh@120 -- # set +e 00:17:23.569 03:28:48 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:23.569 03:28:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:17:23.569 rmmod nvme_tcp 00:17:23.569 rmmod nvme_fabrics 00:17:23.569 rmmod nvme_keyring 00:17:23.569 03:28:48 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:23.569 03:28:48 -- nvmf/common.sh@124 -- # set -e 00:17:23.569 03:28:48 -- nvmf/common.sh@125 -- # return 0 00:17:23.569 03:28:48 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:17:23.569 03:28:48 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:23.569 03:28:48 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:17:23.569 03:28:48 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:17:23.569 03:28:48 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:23.569 03:28:48 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:17:23.569 03:28:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:23.569 03:28:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:23.569 03:28:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:26.105 03:28:50 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:17:26.105 00:17:26.105 real 0m7.482s 00:17:26.105 user 0m18.048s 00:17:26.105 sys 0m1.553s 00:17:26.105 03:28:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:26.105 03:28:50 -- common/autotest_common.sh@10 -- # set +x 00:17:26.105 ************************************ 00:17:26.105 END TEST nvmf_shutdown_tc3 00:17:26.105 ************************************ 00:17:26.105 03:28:50 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:17:26.105 00:17:26.105 real 0m27.583s 00:17:26.105 user 1m15.885s 00:17:26.105 sys 0m6.604s 00:17:26.105 03:28:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:26.105 03:28:50 -- common/autotest_common.sh@10 -- # set +x 00:17:26.105 ************************************ 00:17:26.105 END TEST nvmf_shutdown 00:17:26.105 ************************************ 00:17:26.106 03:28:50 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:17:26.106 03:28:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:26.106 03:28:50 -- common/autotest_common.sh@10 -- # set +x 00:17:26.106 03:28:50 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:17:26.106 03:28:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:26.106 03:28:50 -- common/autotest_common.sh@10 -- # set +x 00:17:26.106 03:28:50 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:17:26.106 03:28:50 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:17:26.106 03:28:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:26.106 03:28:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:26.106 03:28:50 -- common/autotest_common.sh@10 -- # set +x 00:17:26.106 ************************************ 00:17:26.106 START TEST nvmf_multicontroller 00:17:26.106 ************************************ 00:17:26.106 03:28:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:17:26.106 * Looking for test storage... 00:17:26.106 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:17:26.106 03:28:50 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:26.106 03:28:50 -- nvmf/common.sh@7 -- # uname -s 00:17:26.106 03:28:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:26.106 03:28:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:26.106 03:28:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:26.106 03:28:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:26.106 03:28:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:26.106 03:28:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:26.106 03:28:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:26.106 03:28:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:26.106 03:28:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:26.106 03:28:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:26.106 03:28:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:17:26.106 03:28:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:17:26.106 03:28:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:26.106 03:28:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:26.106 03:28:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:26.106 03:28:50 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:26.106 03:28:50 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:26.106 03:28:50 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:26.106 03:28:50 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:26.106 03:28:50 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:26.106 03:28:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.106 03:28:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.106 03:28:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.106 03:28:50 -- paths/export.sh@5 -- # export PATH 00:17:26.106 03:28:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.106 03:28:50 -- nvmf/common.sh@47 -- # : 0 00:17:26.106 03:28:50 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:26.106 03:28:50 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:26.106 03:28:50 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:26.106 03:28:50 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:26.106 03:28:50 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:26.106 03:28:50 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:26.106 03:28:50 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:26.106 03:28:50 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:26.106 03:28:50 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:26.106 03:28:50 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:26.106 03:28:50 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:17:26.106 03:28:50 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:17:26.106 03:28:50 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:26.106 03:28:50 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:17:26.106 03:28:50 -- host/multicontroller.sh@23 -- # nvmftestinit 00:17:26.106 03:28:50 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:17:26.106 03:28:50 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:26.106 03:28:50 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:26.106 03:28:50 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:26.106 03:28:50 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:26.106 03:28:50 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:26.106 03:28:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:26.106 03:28:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:26.106 03:28:50 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:26.106 03:28:50 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:26.106 03:28:50 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:26.106 03:28:50 -- common/autotest_common.sh@10 -- # set +x 00:17:28.046 03:28:52 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:28.046 03:28:52 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:28.046 03:28:52 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:28.046 03:28:52 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:28.046 03:28:52 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:28.046 03:28:52 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:28.046 03:28:52 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:28.046 03:28:52 -- nvmf/common.sh@295 -- # net_devs=() 00:17:28.046 03:28:52 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:28.046 03:28:52 -- nvmf/common.sh@296 -- # e810=() 00:17:28.046 03:28:52 -- nvmf/common.sh@296 -- # local -ga e810 00:17:28.046 03:28:52 -- nvmf/common.sh@297 -- # x722=() 00:17:28.046 03:28:52 -- nvmf/common.sh@297 -- # local -ga x722 00:17:28.046 03:28:52 -- nvmf/common.sh@298 -- # mlx=() 00:17:28.046 03:28:52 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:28.046 03:28:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:28.046 03:28:52 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:28.046 03:28:52 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:28.046 03:28:52 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:28.046 03:28:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:28.046 03:28:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:17:28.046 Found 0000:09:00.0 (0x8086 - 0x159b) 00:17:28.046 03:28:52 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:28.046 03:28:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:17:28.046 Found 0000:09:00.1 (0x8086 - 0x159b) 00:17:28.046 03:28:52 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:28.046 03:28:52 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:28.046 03:28:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:28.046 03:28:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:28.046 03:28:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:28.046 03:28:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:17:28.046 Found net devices under 0000:09:00.0: cvl_0_0 00:17:28.046 03:28:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:28.046 03:28:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:28.046 03:28:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:28.046 03:28:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:28.046 03:28:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:28.046 03:28:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:17:28.046 Found net devices under 0000:09:00.1: cvl_0_1 00:17:28.046 03:28:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:28.046 03:28:52 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:28.046 03:28:52 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:28.046 03:28:52 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:17:28.046 03:28:52 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:17:28.046 03:28:52 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:28.046 03:28:52 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:28.046 03:28:52 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:28.046 03:28:52 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:17:28.046 03:28:52 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:28.046 03:28:52 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:28.046 03:28:52 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:17:28.046 03:28:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:28.046 03:28:52 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:28.046 03:28:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:17:28.046 03:28:52 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:17:28.046 03:28:52 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:17:28.046 03:28:52 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:28.046 03:28:52 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:28.046 03:28:52 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:28.046 03:28:52 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:17:28.046 03:28:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:28.046 03:28:52 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:28.046 03:28:52 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:28.046 03:28:52 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:17:28.046 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:28.046 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:17:28.046 00:17:28.047 --- 10.0.0.2 ping statistics --- 00:17:28.047 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:28.047 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:17:28.047 03:28:52 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:28.047 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:28.047 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.170 ms 00:17:28.047 00:17:28.047 --- 10.0.0.1 ping statistics --- 00:17:28.047 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:28.047 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:17:28.047 03:28:52 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:28.047 03:28:52 -- nvmf/common.sh@411 -- # return 0 00:17:28.047 03:28:52 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:28.047 03:28:52 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:28.047 03:28:52 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:17:28.047 03:28:52 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:17:28.047 03:28:52 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:28.047 03:28:52 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:17:28.047 03:28:52 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:17:28.047 03:28:52 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:17:28.047 03:28:52 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:28.047 03:28:52 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:28.047 03:28:52 -- common/autotest_common.sh@10 -- # set +x 00:17:28.047 03:28:52 -- nvmf/common.sh@470 -- # nvmfpid=1479717 00:17:28.047 03:28:52 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:17:28.047 03:28:52 -- nvmf/common.sh@471 -- # waitforlisten 1479717 00:17:28.047 03:28:52 -- common/autotest_common.sh@817 -- # '[' -z 1479717 ']' 00:17:28.047 03:28:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:28.047 03:28:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:28.047 03:28:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:28.047 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:28.047 03:28:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:28.047 03:28:52 -- common/autotest_common.sh@10 -- # set +x 00:17:28.047 [2024-04-27 03:28:52.892155] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:28.047 [2024-04-27 03:28:52.892233] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:28.047 EAL: No free 2048 kB hugepages reported on node 1 00:17:28.047 [2024-04-27 03:28:52.965448] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:28.305 [2024-04-27 03:28:53.077161] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:28.305 [2024-04-27 03:28:53.077223] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:28.305 [2024-04-27 03:28:53.077239] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:28.305 [2024-04-27 03:28:53.077261] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:28.305 [2024-04-27 03:28:53.077274] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:28.305 [2024-04-27 03:28:53.077362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:28.305 [2024-04-27 03:28:53.077432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:28.305 [2024-04-27 03:28:53.077435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:28.873 03:28:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:28.874 03:28:53 -- common/autotest_common.sh@850 -- # return 0 00:17:28.874 03:28:53 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:28.874 03:28:53 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:28.874 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 03:28:53 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:29.133 03:28:53 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 [2024-04-27 03:28:53.865488] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 Malloc0 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 [2024-04-27 03:28:53.923655] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 [2024-04-27 03:28:53.931560] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 Malloc1 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:17:29.133 03:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.133 03:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.133 03:28:53 -- host/multicontroller.sh@44 -- # bdevperf_pid=1479873 00:17:29.133 03:28:53 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:17:29.133 03:28:53 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:29.133 03:28:53 -- host/multicontroller.sh@47 -- # waitforlisten 1479873 /var/tmp/bdevperf.sock 00:17:29.133 03:28:53 -- common/autotest_common.sh@817 -- # '[' -z 1479873 ']' 00:17:29.133 03:28:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:29.133 03:28:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:29.133 03:28:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:29.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:29.133 03:28:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:29.133 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.391 03:28:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:29.391 03:28:54 -- common/autotest_common.sh@850 -- # return 0 00:17:29.391 03:28:54 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:17:29.391 03:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.391 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:29.651 NVMe0n1 00:17:29.651 03:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.651 03:28:54 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:17:29.651 03:28:54 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:17:29.651 03:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.651 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:29.651 03:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.651 1 00:17:29.651 03:28:54 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:17:29.651 03:28:54 -- common/autotest_common.sh@638 -- # local es=0 00:17:29.651 03:28:54 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:17:29.651 03:28:54 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:29.651 03:28:54 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:17:29.651 03:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.651 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:29.651 request: 00:17:29.651 { 00:17:29.651 "name": "NVMe0", 00:17:29.651 "trtype": "tcp", 00:17:29.651 "traddr": "10.0.0.2", 00:17:29.651 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:17:29.651 "hostaddr": "10.0.0.2", 00:17:29.651 "hostsvcid": "60000", 00:17:29.651 "adrfam": "ipv4", 00:17:29.651 "trsvcid": "4420", 00:17:29.651 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:29.651 "method": "bdev_nvme_attach_controller", 00:17:29.651 "req_id": 1 00:17:29.651 } 00:17:29.651 Got JSON-RPC error response 00:17:29.651 response: 00:17:29.651 { 00:17:29.651 "code": -114, 00:17:29.651 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:17:29.651 } 00:17:29.651 03:28:54 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:17:29.651 03:28:54 -- common/autotest_common.sh@641 -- # es=1 00:17:29.651 03:28:54 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:29.651 03:28:54 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:29.651 03:28:54 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:29.651 03:28:54 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:17:29.651 03:28:54 -- common/autotest_common.sh@638 -- # local es=0 00:17:29.651 03:28:54 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:17:29.651 03:28:54 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:29.651 03:28:54 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:17:29.651 03:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.651 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:29.651 request: 00:17:29.651 { 00:17:29.651 "name": "NVMe0", 00:17:29.651 "trtype": "tcp", 00:17:29.651 "traddr": "10.0.0.2", 00:17:29.651 "hostaddr": "10.0.0.2", 00:17:29.651 "hostsvcid": "60000", 00:17:29.651 "adrfam": "ipv4", 00:17:29.651 "trsvcid": "4420", 00:17:29.651 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:29.651 "method": "bdev_nvme_attach_controller", 00:17:29.651 "req_id": 1 00:17:29.651 } 00:17:29.651 Got JSON-RPC error response 00:17:29.651 response: 00:17:29.651 { 00:17:29.651 "code": -114, 00:17:29.651 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:17:29.651 } 00:17:29.651 03:28:54 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:17:29.651 03:28:54 -- common/autotest_common.sh@641 -- # es=1 00:17:29.651 03:28:54 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:29.651 03:28:54 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:29.651 03:28:54 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:29.651 03:28:54 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:17:29.651 03:28:54 -- common/autotest_common.sh@638 -- # local es=0 00:17:29.651 03:28:54 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:17:29.651 03:28:54 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:29.651 03:28:54 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:17:29.651 03:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.651 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:29.651 request: 00:17:29.651 { 00:17:29.651 "name": "NVMe0", 00:17:29.651 "trtype": "tcp", 00:17:29.651 "traddr": "10.0.0.2", 00:17:29.651 "hostaddr": "10.0.0.2", 00:17:29.651 "hostsvcid": "60000", 00:17:29.651 "adrfam": "ipv4", 00:17:29.651 "trsvcid": "4420", 00:17:29.651 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:29.651 "multipath": "disable", 00:17:29.651 "method": "bdev_nvme_attach_controller", 00:17:29.651 "req_id": 1 00:17:29.651 } 00:17:29.651 Got JSON-RPC error response 00:17:29.651 response: 00:17:29.651 { 00:17:29.651 "code": -114, 00:17:29.651 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:17:29.651 } 00:17:29.651 03:28:54 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:17:29.651 03:28:54 -- common/autotest_common.sh@641 -- # es=1 00:17:29.651 03:28:54 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:29.651 03:28:54 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:29.651 03:28:54 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:29.651 03:28:54 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:17:29.651 03:28:54 -- common/autotest_common.sh@638 -- # local es=0 00:17:29.651 03:28:54 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:17:29.651 03:28:54 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:17:29.651 03:28:54 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:29.651 03:28:54 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:17:29.651 03:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.651 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:29.651 request: 00:17:29.651 { 00:17:29.651 "name": "NVMe0", 00:17:29.652 "trtype": "tcp", 00:17:29.652 "traddr": "10.0.0.2", 00:17:29.652 "hostaddr": "10.0.0.2", 00:17:29.652 "hostsvcid": "60000", 00:17:29.652 "adrfam": "ipv4", 00:17:29.652 "trsvcid": "4420", 00:17:29.652 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:29.652 "multipath": "failover", 00:17:29.652 "method": "bdev_nvme_attach_controller", 00:17:29.652 "req_id": 1 00:17:29.652 } 00:17:29.652 Got JSON-RPC error response 00:17:29.652 response: 00:17:29.652 { 00:17:29.652 "code": -114, 00:17:29.652 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:17:29.652 } 00:17:29.652 03:28:54 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:17:29.652 03:28:54 -- common/autotest_common.sh@641 -- # es=1 00:17:29.652 03:28:54 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:29.652 03:28:54 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:29.652 03:28:54 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:29.652 03:28:54 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:17:29.652 03:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.652 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:29.911 00:17:29.911 03:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.911 03:28:54 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:17:29.911 03:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.911 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:29.911 03:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.911 03:28:54 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:17:29.911 03:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.911 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:29.911 00:17:29.911 03:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.911 03:28:54 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:17:29.911 03:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:29.911 03:28:54 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:17:29.911 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:29.911 03:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.911 03:28:54 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:17:29.911 03:28:54 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:31.287 0 00:17:31.287 03:28:55 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:17:31.287 03:28:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:31.287 03:28:55 -- common/autotest_common.sh@10 -- # set +x 00:17:31.287 03:28:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:31.287 03:28:55 -- host/multicontroller.sh@100 -- # killprocess 1479873 00:17:31.287 03:28:55 -- common/autotest_common.sh@936 -- # '[' -z 1479873 ']' 00:17:31.287 03:28:55 -- common/autotest_common.sh@940 -- # kill -0 1479873 00:17:31.287 03:28:55 -- common/autotest_common.sh@941 -- # uname 00:17:31.287 03:28:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:31.287 03:28:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1479873 00:17:31.287 03:28:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:31.287 03:28:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:31.287 03:28:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1479873' 00:17:31.287 killing process with pid 1479873 00:17:31.287 03:28:55 -- common/autotest_common.sh@955 -- # kill 1479873 00:17:31.287 03:28:55 -- common/autotest_common.sh@960 -- # wait 1479873 00:17:31.287 03:28:56 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:31.287 03:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:31.287 03:28:56 -- common/autotest_common.sh@10 -- # set +x 00:17:31.287 03:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:31.287 03:28:56 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:17:31.287 03:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:31.287 03:28:56 -- common/autotest_common.sh@10 -- # set +x 00:17:31.287 03:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:31.287 03:28:56 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:17:31.287 03:28:56 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:17:31.287 03:28:56 -- common/autotest_common.sh@1598 -- # read -r file 00:17:31.287 03:28:56 -- common/autotest_common.sh@1597 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:17:31.287 03:28:56 -- common/autotest_common.sh@1597 -- # sort -u 00:17:31.287 03:28:56 -- common/autotest_common.sh@1599 -- # cat 00:17:31.287 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:17:31.287 [2024-04-27 03:28:54.026958] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:31.287 [2024-04-27 03:28:54.027044] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1479873 ] 00:17:31.287 EAL: No free 2048 kB hugepages reported on node 1 00:17:31.287 [2024-04-27 03:28:54.087280] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:31.287 [2024-04-27 03:28:54.190984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:31.287 [2024-04-27 03:28:54.780010] bdev.c:4551:bdev_name_add: *ERROR*: Bdev name 0589dd94-7ad3-4b8c-bdd5-dc4ab39372f4 already exists 00:17:31.287 [2024-04-27 03:28:54.780050] bdev.c:7668:bdev_register: *ERROR*: Unable to add uuid:0589dd94-7ad3-4b8c-bdd5-dc4ab39372f4 alias for bdev NVMe1n1 00:17:31.287 [2024-04-27 03:28:54.780084] bdev_nvme.c:4276:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:17:31.287 Running I/O for 1 seconds... 00:17:31.287 00:17:31.287 Latency(us) 00:17:31.287 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:31.287 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:17:31.287 NVMe0n1 : 1.01 18733.76 73.18 0.00 0.00 6823.14 2609.30 12379.02 00:17:31.287 =================================================================================================================== 00:17:31.287 Total : 18733.76 73.18 0.00 0.00 6823.14 2609.30 12379.02 00:17:31.287 Received shutdown signal, test time was about 1.000000 seconds 00:17:31.287 00:17:31.287 Latency(us) 00:17:31.287 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:31.287 =================================================================================================================== 00:17:31.287 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:31.287 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:17:31.287 03:28:56 -- common/autotest_common.sh@1604 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:17:31.287 03:28:56 -- common/autotest_common.sh@1598 -- # read -r file 00:17:31.287 03:28:56 -- host/multicontroller.sh@108 -- # nvmftestfini 00:17:31.287 03:28:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:31.287 03:28:56 -- nvmf/common.sh@117 -- # sync 00:17:31.287 03:28:56 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:17:31.288 03:28:56 -- nvmf/common.sh@120 -- # set +e 00:17:31.288 03:28:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:31.288 03:28:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:17:31.288 rmmod nvme_tcp 00:17:31.546 rmmod nvme_fabrics 00:17:31.546 rmmod nvme_keyring 00:17:31.546 03:28:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:31.546 03:28:56 -- nvmf/common.sh@124 -- # set -e 00:17:31.546 03:28:56 -- nvmf/common.sh@125 -- # return 0 00:17:31.546 03:28:56 -- nvmf/common.sh@478 -- # '[' -n 1479717 ']' 00:17:31.546 03:28:56 -- nvmf/common.sh@479 -- # killprocess 1479717 00:17:31.546 03:28:56 -- common/autotest_common.sh@936 -- # '[' -z 1479717 ']' 00:17:31.546 03:28:56 -- common/autotest_common.sh@940 -- # kill -0 1479717 00:17:31.546 03:28:56 -- common/autotest_common.sh@941 -- # uname 00:17:31.546 03:28:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:31.546 03:28:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1479717 00:17:31.546 03:28:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:31.546 03:28:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:31.546 03:28:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1479717' 00:17:31.546 killing process with pid 1479717 00:17:31.546 03:28:56 -- common/autotest_common.sh@955 -- # kill 1479717 00:17:31.546 03:28:56 -- common/autotest_common.sh@960 -- # wait 1479717 00:17:31.805 03:28:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:31.805 03:28:56 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:17:31.805 03:28:56 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:17:31.805 03:28:56 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:31.805 03:28:56 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:17:31.805 03:28:56 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:31.805 03:28:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:31.805 03:28:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:34.343 03:28:58 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:17:34.343 00:17:34.343 real 0m7.978s 00:17:34.343 user 0m13.671s 00:17:34.343 sys 0m2.255s 00:17:34.343 03:28:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:34.343 03:28:58 -- common/autotest_common.sh@10 -- # set +x 00:17:34.343 ************************************ 00:17:34.343 END TEST nvmf_multicontroller 00:17:34.343 ************************************ 00:17:34.343 03:28:58 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:17:34.343 03:28:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:34.343 03:28:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:34.343 03:28:58 -- common/autotest_common.sh@10 -- # set +x 00:17:34.343 ************************************ 00:17:34.343 START TEST nvmf_aer 00:17:34.343 ************************************ 00:17:34.343 03:28:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:17:34.343 * Looking for test storage... 00:17:34.343 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:17:34.343 03:28:58 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:34.343 03:28:58 -- nvmf/common.sh@7 -- # uname -s 00:17:34.343 03:28:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:34.343 03:28:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:34.343 03:28:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:34.343 03:28:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:34.343 03:28:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:34.343 03:28:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:34.343 03:28:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:34.343 03:28:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:34.343 03:28:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:34.343 03:28:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:34.343 03:28:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:17:34.343 03:28:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:17:34.343 03:28:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:34.343 03:28:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:34.343 03:28:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:34.343 03:28:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:34.343 03:28:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:34.343 03:28:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:34.343 03:28:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:34.343 03:28:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:34.343 03:28:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.343 03:28:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.343 03:28:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.343 03:28:58 -- paths/export.sh@5 -- # export PATH 00:17:34.343 03:28:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.343 03:28:58 -- nvmf/common.sh@47 -- # : 0 00:17:34.343 03:28:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:34.343 03:28:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:34.343 03:28:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:34.343 03:28:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:34.343 03:28:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:34.343 03:28:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:34.343 03:28:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:34.343 03:28:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:34.343 03:28:58 -- host/aer.sh@11 -- # nvmftestinit 00:17:34.343 03:28:58 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:17:34.343 03:28:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:34.343 03:28:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:34.343 03:28:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:34.343 03:28:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:34.343 03:28:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:34.343 03:28:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:34.343 03:28:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:34.343 03:28:58 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:34.343 03:28:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:34.343 03:28:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:34.343 03:28:58 -- common/autotest_common.sh@10 -- # set +x 00:17:36.254 03:29:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:36.254 03:29:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:36.254 03:29:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:36.254 03:29:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:36.254 03:29:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:36.254 03:29:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:36.254 03:29:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:36.254 03:29:00 -- nvmf/common.sh@295 -- # net_devs=() 00:17:36.254 03:29:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:36.254 03:29:00 -- nvmf/common.sh@296 -- # e810=() 00:17:36.254 03:29:00 -- nvmf/common.sh@296 -- # local -ga e810 00:17:36.254 03:29:00 -- nvmf/common.sh@297 -- # x722=() 00:17:36.254 03:29:00 -- nvmf/common.sh@297 -- # local -ga x722 00:17:36.254 03:29:00 -- nvmf/common.sh@298 -- # mlx=() 00:17:36.254 03:29:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:36.254 03:29:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:36.254 03:29:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:36.254 03:29:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:36.254 03:29:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:36.254 03:29:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:36.254 03:29:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:36.254 03:29:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:36.254 03:29:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:36.254 03:29:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:36.255 03:29:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:36.255 03:29:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:36.255 03:29:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:36.255 03:29:00 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:36.255 03:29:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:36.255 03:29:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:36.255 03:29:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:17:36.255 Found 0000:09:00.0 (0x8086 - 0x159b) 00:17:36.255 03:29:00 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:36.255 03:29:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:17:36.255 Found 0000:09:00.1 (0x8086 - 0x159b) 00:17:36.255 03:29:00 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:36.255 03:29:00 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:36.255 03:29:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:36.255 03:29:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:36.255 03:29:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:36.255 03:29:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:17:36.255 Found net devices under 0000:09:00.0: cvl_0_0 00:17:36.255 03:29:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:36.255 03:29:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:36.255 03:29:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:36.255 03:29:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:36.255 03:29:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:36.255 03:29:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:17:36.255 Found net devices under 0000:09:00.1: cvl_0_1 00:17:36.255 03:29:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:36.255 03:29:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:36.255 03:29:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:36.255 03:29:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:17:36.255 03:29:00 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:36.255 03:29:00 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:36.255 03:29:00 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:36.255 03:29:00 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:17:36.255 03:29:00 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:36.255 03:29:00 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:36.255 03:29:00 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:17:36.255 03:29:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:36.255 03:29:00 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:36.255 03:29:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:17:36.255 03:29:00 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:17:36.255 03:29:00 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:17:36.255 03:29:00 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:36.255 03:29:00 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:36.255 03:29:00 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:36.255 03:29:00 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:17:36.255 03:29:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:36.255 03:29:00 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:36.255 03:29:00 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:36.255 03:29:00 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:17:36.255 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:36.255 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:17:36.255 00:17:36.255 --- 10.0.0.2 ping statistics --- 00:17:36.255 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:36.255 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:17:36.255 03:29:00 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:36.255 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:36.255 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.188 ms 00:17:36.255 00:17:36.255 --- 10.0.0.1 ping statistics --- 00:17:36.255 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:36.255 rtt min/avg/max/mdev = 0.188/0.188/0.188/0.000 ms 00:17:36.255 03:29:00 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:36.255 03:29:00 -- nvmf/common.sh@411 -- # return 0 00:17:36.255 03:29:00 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:36.255 03:29:00 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:36.255 03:29:00 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:17:36.255 03:29:00 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:36.255 03:29:00 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:17:36.255 03:29:00 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:17:36.255 03:29:00 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:17:36.255 03:29:00 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:36.255 03:29:00 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:36.255 03:29:00 -- common/autotest_common.sh@10 -- # set +x 00:17:36.255 03:29:00 -- nvmf/common.sh@470 -- # nvmfpid=1482090 00:17:36.255 03:29:00 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:36.255 03:29:00 -- nvmf/common.sh@471 -- # waitforlisten 1482090 00:17:36.255 03:29:00 -- common/autotest_common.sh@817 -- # '[' -z 1482090 ']' 00:17:36.255 03:29:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:36.255 03:29:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:36.255 03:29:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:36.255 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:36.255 03:29:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:36.255 03:29:00 -- common/autotest_common.sh@10 -- # set +x 00:17:36.255 [2024-04-27 03:29:01.009013] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:36.255 [2024-04-27 03:29:01.009096] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:36.255 EAL: No free 2048 kB hugepages reported on node 1 00:17:36.255 [2024-04-27 03:29:01.077448] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:36.255 [2024-04-27 03:29:01.183099] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:36.255 [2024-04-27 03:29:01.183149] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:36.255 [2024-04-27 03:29:01.183177] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:36.255 [2024-04-27 03:29:01.183189] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:36.255 [2024-04-27 03:29:01.183200] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:36.255 [2024-04-27 03:29:01.183307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:36.255 [2024-04-27 03:29:01.185268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:36.255 [2024-04-27 03:29:01.185341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:36.255 [2024-04-27 03:29:01.189277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:36.516 03:29:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:36.516 03:29:01 -- common/autotest_common.sh@850 -- # return 0 00:17:36.516 03:29:01 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:36.516 03:29:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:36.516 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:36.516 03:29:01 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:36.516 03:29:01 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:36.516 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:36.516 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:36.516 [2024-04-27 03:29:01.349036] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:36.516 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:36.516 03:29:01 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:17:36.516 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:36.516 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:36.516 Malloc0 00:17:36.516 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:36.516 03:29:01 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:17:36.516 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:36.516 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:36.516 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:36.516 03:29:01 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:36.516 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:36.516 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:36.516 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:36.516 03:29:01 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:36.516 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:36.516 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:36.516 [2024-04-27 03:29:01.402376] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:36.516 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:36.516 03:29:01 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:17:36.516 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:36.516 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:36.516 [2024-04-27 03:29:01.410048] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:17:36.516 [ 00:17:36.516 { 00:17:36.516 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:17:36.516 "subtype": "Discovery", 00:17:36.516 "listen_addresses": [], 00:17:36.516 "allow_any_host": true, 00:17:36.516 "hosts": [] 00:17:36.516 }, 00:17:36.516 { 00:17:36.516 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:36.516 "subtype": "NVMe", 00:17:36.516 "listen_addresses": [ 00:17:36.516 { 00:17:36.516 "transport": "TCP", 00:17:36.516 "trtype": "TCP", 00:17:36.516 "adrfam": "IPv4", 00:17:36.516 "traddr": "10.0.0.2", 00:17:36.516 "trsvcid": "4420" 00:17:36.516 } 00:17:36.516 ], 00:17:36.516 "allow_any_host": true, 00:17:36.516 "hosts": [], 00:17:36.516 "serial_number": "SPDK00000000000001", 00:17:36.516 "model_number": "SPDK bdev Controller", 00:17:36.516 "max_namespaces": 2, 00:17:36.516 "min_cntlid": 1, 00:17:36.516 "max_cntlid": 65519, 00:17:36.516 "namespaces": [ 00:17:36.516 { 00:17:36.516 "nsid": 1, 00:17:36.516 "bdev_name": "Malloc0", 00:17:36.516 "name": "Malloc0", 00:17:36.516 "nguid": "860E9BA4CA8A4294A96D2AE5F8BBC7F8", 00:17:36.516 "uuid": "860e9ba4-ca8a-4294-a96d-2ae5f8bbc7f8" 00:17:36.516 } 00:17:36.516 ] 00:17:36.516 } 00:17:36.516 ] 00:17:36.516 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:36.516 03:29:01 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:17:36.516 03:29:01 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:17:36.516 03:29:01 -- host/aer.sh@33 -- # aerpid=1482234 00:17:36.516 03:29:01 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:17:36.516 03:29:01 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:17:36.516 03:29:01 -- common/autotest_common.sh@1251 -- # local i=0 00:17:36.516 03:29:01 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:36.516 03:29:01 -- common/autotest_common.sh@1253 -- # '[' 0 -lt 200 ']' 00:17:36.516 03:29:01 -- common/autotest_common.sh@1254 -- # i=1 00:17:36.516 03:29:01 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:17:36.516 EAL: No free 2048 kB hugepages reported on node 1 00:17:36.775 03:29:01 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:36.775 03:29:01 -- common/autotest_common.sh@1253 -- # '[' 1 -lt 200 ']' 00:17:36.775 03:29:01 -- common/autotest_common.sh@1254 -- # i=2 00:17:36.775 03:29:01 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:17:36.775 03:29:01 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:36.775 03:29:01 -- common/autotest_common.sh@1253 -- # '[' 2 -lt 200 ']' 00:17:36.775 03:29:01 -- common/autotest_common.sh@1254 -- # i=3 00:17:36.775 03:29:01 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:17:36.775 03:29:01 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:36.775 03:29:01 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:36.775 03:29:01 -- common/autotest_common.sh@1262 -- # return 0 00:17:36.775 03:29:01 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:17:36.775 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:36.775 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:37.034 Malloc1 00:17:37.034 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.034 03:29:01 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:17:37.034 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.034 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:37.034 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.034 03:29:01 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:17:37.034 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.034 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:37.034 Asynchronous Event Request test 00:17:37.034 Attaching to 10.0.0.2 00:17:37.034 Attached to 10.0.0.2 00:17:37.034 Registering asynchronous event callbacks... 00:17:37.034 Starting namespace attribute notice tests for all controllers... 00:17:37.034 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:17:37.034 aer_cb - Changed Namespace 00:17:37.034 Cleaning up... 00:17:37.034 [ 00:17:37.034 { 00:17:37.034 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:17:37.034 "subtype": "Discovery", 00:17:37.034 "listen_addresses": [], 00:17:37.034 "allow_any_host": true, 00:17:37.034 "hosts": [] 00:17:37.034 }, 00:17:37.034 { 00:17:37.034 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:37.034 "subtype": "NVMe", 00:17:37.034 "listen_addresses": [ 00:17:37.034 { 00:17:37.034 "transport": "TCP", 00:17:37.034 "trtype": "TCP", 00:17:37.034 "adrfam": "IPv4", 00:17:37.034 "traddr": "10.0.0.2", 00:17:37.034 "trsvcid": "4420" 00:17:37.034 } 00:17:37.034 ], 00:17:37.034 "allow_any_host": true, 00:17:37.034 "hosts": [], 00:17:37.034 "serial_number": "SPDK00000000000001", 00:17:37.034 "model_number": "SPDK bdev Controller", 00:17:37.034 "max_namespaces": 2, 00:17:37.034 "min_cntlid": 1, 00:17:37.034 "max_cntlid": 65519, 00:17:37.034 "namespaces": [ 00:17:37.034 { 00:17:37.034 "nsid": 1, 00:17:37.034 "bdev_name": "Malloc0", 00:17:37.034 "name": "Malloc0", 00:17:37.034 "nguid": "860E9BA4CA8A4294A96D2AE5F8BBC7F8", 00:17:37.034 "uuid": "860e9ba4-ca8a-4294-a96d-2ae5f8bbc7f8" 00:17:37.034 }, 00:17:37.034 { 00:17:37.034 "nsid": 2, 00:17:37.034 "bdev_name": "Malloc1", 00:17:37.034 "name": "Malloc1", 00:17:37.034 "nguid": "9C2E5E7072AC4F4F928C8230F85E079D", 00:17:37.034 "uuid": "9c2e5e70-72ac-4f4f-928c-8230f85e079d" 00:17:37.034 } 00:17:37.034 ] 00:17:37.034 } 00:17:37.034 ] 00:17:37.034 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.034 03:29:01 -- host/aer.sh@43 -- # wait 1482234 00:17:37.034 03:29:01 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:17:37.034 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.034 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:37.034 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.034 03:29:01 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:17:37.034 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.034 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:37.034 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.034 03:29:01 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:37.034 03:29:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:37.034 03:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:37.034 03:29:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:37.034 03:29:01 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:17:37.034 03:29:01 -- host/aer.sh@51 -- # nvmftestfini 00:17:37.034 03:29:01 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:37.034 03:29:01 -- nvmf/common.sh@117 -- # sync 00:17:37.034 03:29:01 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:17:37.034 03:29:01 -- nvmf/common.sh@120 -- # set +e 00:17:37.034 03:29:01 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:37.034 03:29:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:17:37.034 rmmod nvme_tcp 00:17:37.034 rmmod nvme_fabrics 00:17:37.034 rmmod nvme_keyring 00:17:37.034 03:29:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:37.034 03:29:01 -- nvmf/common.sh@124 -- # set -e 00:17:37.034 03:29:01 -- nvmf/common.sh@125 -- # return 0 00:17:37.034 03:29:01 -- nvmf/common.sh@478 -- # '[' -n 1482090 ']' 00:17:37.034 03:29:01 -- nvmf/common.sh@479 -- # killprocess 1482090 00:17:37.034 03:29:01 -- common/autotest_common.sh@936 -- # '[' -z 1482090 ']' 00:17:37.034 03:29:01 -- common/autotest_common.sh@940 -- # kill -0 1482090 00:17:37.034 03:29:01 -- common/autotest_common.sh@941 -- # uname 00:17:37.034 03:29:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:37.034 03:29:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1482090 00:17:37.034 03:29:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:37.034 03:29:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:37.034 03:29:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1482090' 00:17:37.034 killing process with pid 1482090 00:17:37.034 03:29:01 -- common/autotest_common.sh@955 -- # kill 1482090 00:17:37.034 [2024-04-27 03:29:01.961084] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:17:37.034 03:29:01 -- common/autotest_common.sh@960 -- # wait 1482090 00:17:37.292 03:29:02 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:37.292 03:29:02 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:17:37.292 03:29:02 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:17:37.292 03:29:02 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:37.292 03:29:02 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:17:37.292 03:29:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:37.292 03:29:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:37.292 03:29:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:39.832 03:29:04 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:17:39.832 00:17:39.832 real 0m5.427s 00:17:39.832 user 0m4.533s 00:17:39.832 sys 0m1.928s 00:17:39.832 03:29:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:39.832 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:17:39.832 ************************************ 00:17:39.832 END TEST nvmf_aer 00:17:39.832 ************************************ 00:17:39.832 03:29:04 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:17:39.832 03:29:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:39.832 03:29:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:39.832 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:17:39.832 ************************************ 00:17:39.832 START TEST nvmf_async_init 00:17:39.832 ************************************ 00:17:39.832 03:29:04 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:17:39.832 * Looking for test storage... 00:17:39.832 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:17:39.832 03:29:04 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:39.832 03:29:04 -- nvmf/common.sh@7 -- # uname -s 00:17:39.832 03:29:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:39.832 03:29:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:39.832 03:29:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:39.832 03:29:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:39.832 03:29:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:39.832 03:29:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:39.832 03:29:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:39.832 03:29:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:39.832 03:29:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:39.832 03:29:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:39.832 03:29:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:17:39.832 03:29:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:17:39.832 03:29:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:39.832 03:29:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:39.832 03:29:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:39.832 03:29:04 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:39.832 03:29:04 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:39.832 03:29:04 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:39.832 03:29:04 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:39.832 03:29:04 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:39.832 03:29:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.832 03:29:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.832 03:29:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.832 03:29:04 -- paths/export.sh@5 -- # export PATH 00:17:39.832 03:29:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.832 03:29:04 -- nvmf/common.sh@47 -- # : 0 00:17:39.832 03:29:04 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:39.832 03:29:04 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:39.832 03:29:04 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:39.832 03:29:04 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:39.832 03:29:04 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:39.832 03:29:04 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:39.832 03:29:04 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:39.832 03:29:04 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:39.832 03:29:04 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:17:39.832 03:29:04 -- host/async_init.sh@14 -- # null_block_size=512 00:17:39.832 03:29:04 -- host/async_init.sh@15 -- # null_bdev=null0 00:17:39.832 03:29:04 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:17:39.832 03:29:04 -- host/async_init.sh@20 -- # uuidgen 00:17:39.832 03:29:04 -- host/async_init.sh@20 -- # tr -d - 00:17:39.832 03:29:04 -- host/async_init.sh@20 -- # nguid=0a50e6eb03db4f56934768424a351f2c 00:17:39.832 03:29:04 -- host/async_init.sh@22 -- # nvmftestinit 00:17:39.832 03:29:04 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:17:39.832 03:29:04 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:39.832 03:29:04 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:39.832 03:29:04 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:39.832 03:29:04 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:39.832 03:29:04 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:39.832 03:29:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:39.832 03:29:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:39.832 03:29:04 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:39.832 03:29:04 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:39.832 03:29:04 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:39.832 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:17:41.739 03:29:06 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:41.739 03:29:06 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:41.739 03:29:06 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:41.739 03:29:06 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:41.739 03:29:06 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:41.739 03:29:06 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:41.739 03:29:06 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:41.739 03:29:06 -- nvmf/common.sh@295 -- # net_devs=() 00:17:41.739 03:29:06 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:41.739 03:29:06 -- nvmf/common.sh@296 -- # e810=() 00:17:41.739 03:29:06 -- nvmf/common.sh@296 -- # local -ga e810 00:17:41.739 03:29:06 -- nvmf/common.sh@297 -- # x722=() 00:17:41.739 03:29:06 -- nvmf/common.sh@297 -- # local -ga x722 00:17:41.739 03:29:06 -- nvmf/common.sh@298 -- # mlx=() 00:17:41.739 03:29:06 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:41.739 03:29:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:41.739 03:29:06 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:41.739 03:29:06 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:41.739 03:29:06 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:41.739 03:29:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:41.739 03:29:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:17:41.739 Found 0000:09:00.0 (0x8086 - 0x159b) 00:17:41.739 03:29:06 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:41.739 03:29:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:17:41.739 Found 0000:09:00.1 (0x8086 - 0x159b) 00:17:41.739 03:29:06 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:41.739 03:29:06 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:41.739 03:29:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:41.739 03:29:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:41.739 03:29:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:41.739 03:29:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:17:41.739 Found net devices under 0000:09:00.0: cvl_0_0 00:17:41.739 03:29:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:41.739 03:29:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:41.739 03:29:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:41.739 03:29:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:41.739 03:29:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:41.739 03:29:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:17:41.739 Found net devices under 0000:09:00.1: cvl_0_1 00:17:41.739 03:29:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:41.739 03:29:06 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:41.739 03:29:06 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:41.739 03:29:06 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:17:41.739 03:29:06 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:17:41.739 03:29:06 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:41.739 03:29:06 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:41.739 03:29:06 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:41.739 03:29:06 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:17:41.739 03:29:06 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:41.739 03:29:06 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:41.739 03:29:06 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:17:41.739 03:29:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:41.739 03:29:06 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:41.739 03:29:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:17:41.739 03:29:06 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:17:41.739 03:29:06 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:17:41.739 03:29:06 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:41.739 03:29:06 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:41.739 03:29:06 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:41.739 03:29:06 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:17:41.739 03:29:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:41.739 03:29:06 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:41.739 03:29:06 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:41.739 03:29:06 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:17:41.739 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:41.739 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:17:41.739 00:17:41.739 --- 10.0.0.2 ping statistics --- 00:17:41.739 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:41.739 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:17:41.739 03:29:06 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:41.739 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:41.739 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.191 ms 00:17:41.739 00:17:41.739 --- 10.0.0.1 ping statistics --- 00:17:41.739 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:41.739 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:17:41.740 03:29:06 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:41.740 03:29:06 -- nvmf/common.sh@411 -- # return 0 00:17:41.740 03:29:06 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:41.740 03:29:06 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:41.740 03:29:06 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:17:41.740 03:29:06 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:17:41.740 03:29:06 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:41.740 03:29:06 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:17:41.740 03:29:06 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:17:41.740 03:29:06 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:17:41.740 03:29:06 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:41.740 03:29:06 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:41.740 03:29:06 -- common/autotest_common.sh@10 -- # set +x 00:17:41.740 03:29:06 -- nvmf/common.sh@470 -- # nvmfpid=1484185 00:17:41.740 03:29:06 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:41.740 03:29:06 -- nvmf/common.sh@471 -- # waitforlisten 1484185 00:17:41.740 03:29:06 -- common/autotest_common.sh@817 -- # '[' -z 1484185 ']' 00:17:41.740 03:29:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:41.740 03:29:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:41.740 03:29:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:41.740 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:41.740 03:29:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:41.740 03:29:06 -- common/autotest_common.sh@10 -- # set +x 00:17:41.740 [2024-04-27 03:29:06.649793] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:41.740 [2024-04-27 03:29:06.649882] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:41.740 EAL: No free 2048 kB hugepages reported on node 1 00:17:41.740 [2024-04-27 03:29:06.714426] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:41.999 [2024-04-27 03:29:06.821474] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:41.999 [2024-04-27 03:29:06.821554] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:41.999 [2024-04-27 03:29:06.821568] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:41.999 [2024-04-27 03:29:06.821578] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:41.999 [2024-04-27 03:29:06.821588] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:41.999 [2024-04-27 03:29:06.821614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:41.999 03:29:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:41.999 03:29:06 -- common/autotest_common.sh@850 -- # return 0 00:17:41.999 03:29:06 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:41.999 03:29:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:41.999 03:29:06 -- common/autotest_common.sh@10 -- # set +x 00:17:41.999 03:29:06 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:41.999 03:29:06 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:17:41.999 03:29:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:41.999 03:29:06 -- common/autotest_common.sh@10 -- # set +x 00:17:41.999 [2024-04-27 03:29:06.958208] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:41.999 03:29:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:41.999 03:29:06 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:17:41.999 03:29:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:41.999 03:29:06 -- common/autotest_common.sh@10 -- # set +x 00:17:41.999 null0 00:17:41.999 03:29:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:41.999 03:29:06 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:17:41.999 03:29:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:41.999 03:29:06 -- common/autotest_common.sh@10 -- # set +x 00:17:42.257 03:29:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.257 03:29:06 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:17:42.257 03:29:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.257 03:29:06 -- common/autotest_common.sh@10 -- # set +x 00:17:42.257 03:29:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.257 03:29:06 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 0a50e6eb03db4f56934768424a351f2c 00:17:42.257 03:29:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.257 03:29:06 -- common/autotest_common.sh@10 -- # set +x 00:17:42.257 03:29:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.257 03:29:06 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:42.257 03:29:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.257 03:29:06 -- common/autotest_common.sh@10 -- # set +x 00:17:42.257 [2024-04-27 03:29:06.998480] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:42.257 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.257 03:29:07 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:17:42.257 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.257 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.257 nvme0n1 00:17:42.257 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.257 03:29:07 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:17:42.257 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.257 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.517 [ 00:17:42.517 { 00:17:42.517 "name": "nvme0n1", 00:17:42.517 "aliases": [ 00:17:42.517 "0a50e6eb-03db-4f56-9347-68424a351f2c" 00:17:42.517 ], 00:17:42.517 "product_name": "NVMe disk", 00:17:42.517 "block_size": 512, 00:17:42.517 "num_blocks": 2097152, 00:17:42.517 "uuid": "0a50e6eb-03db-4f56-9347-68424a351f2c", 00:17:42.517 "assigned_rate_limits": { 00:17:42.517 "rw_ios_per_sec": 0, 00:17:42.517 "rw_mbytes_per_sec": 0, 00:17:42.517 "r_mbytes_per_sec": 0, 00:17:42.517 "w_mbytes_per_sec": 0 00:17:42.517 }, 00:17:42.517 "claimed": false, 00:17:42.517 "zoned": false, 00:17:42.517 "supported_io_types": { 00:17:42.517 "read": true, 00:17:42.517 "write": true, 00:17:42.517 "unmap": false, 00:17:42.517 "write_zeroes": true, 00:17:42.517 "flush": true, 00:17:42.517 "reset": true, 00:17:42.517 "compare": true, 00:17:42.517 "compare_and_write": true, 00:17:42.517 "abort": true, 00:17:42.517 "nvme_admin": true, 00:17:42.517 "nvme_io": true 00:17:42.517 }, 00:17:42.517 "memory_domains": [ 00:17:42.517 { 00:17:42.517 "dma_device_id": "system", 00:17:42.517 "dma_device_type": 1 00:17:42.517 } 00:17:42.517 ], 00:17:42.517 "driver_specific": { 00:17:42.517 "nvme": [ 00:17:42.517 { 00:17:42.517 "trid": { 00:17:42.517 "trtype": "TCP", 00:17:42.517 "adrfam": "IPv4", 00:17:42.517 "traddr": "10.0.0.2", 00:17:42.517 "trsvcid": "4420", 00:17:42.517 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:42.517 }, 00:17:42.517 "ctrlr_data": { 00:17:42.517 "cntlid": 1, 00:17:42.517 "vendor_id": "0x8086", 00:17:42.517 "model_number": "SPDK bdev Controller", 00:17:42.517 "serial_number": "00000000000000000000", 00:17:42.517 "firmware_revision": "24.05", 00:17:42.517 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:42.517 "oacs": { 00:17:42.517 "security": 0, 00:17:42.517 "format": 0, 00:17:42.517 "firmware": 0, 00:17:42.517 "ns_manage": 0 00:17:42.517 }, 00:17:42.517 "multi_ctrlr": true, 00:17:42.517 "ana_reporting": false 00:17:42.517 }, 00:17:42.517 "vs": { 00:17:42.517 "nvme_version": "1.3" 00:17:42.517 }, 00:17:42.517 "ns_data": { 00:17:42.517 "id": 1, 00:17:42.517 "can_share": true 00:17:42.517 } 00:17:42.517 } 00:17:42.517 ], 00:17:42.517 "mp_policy": "active_passive" 00:17:42.517 } 00:17:42.517 } 00:17:42.517 ] 00:17:42.517 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.517 03:29:07 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:17:42.517 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.517 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.517 [2024-04-27 03:29:07.250989] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:42.517 [2024-04-27 03:29:07.251075] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2175a40 (9): Bad file descriptor 00:17:42.517 [2024-04-27 03:29:07.393395] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:42.517 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.517 03:29:07 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:17:42.517 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.517 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.517 [ 00:17:42.517 { 00:17:42.517 "name": "nvme0n1", 00:17:42.517 "aliases": [ 00:17:42.517 "0a50e6eb-03db-4f56-9347-68424a351f2c" 00:17:42.517 ], 00:17:42.517 "product_name": "NVMe disk", 00:17:42.517 "block_size": 512, 00:17:42.517 "num_blocks": 2097152, 00:17:42.517 "uuid": "0a50e6eb-03db-4f56-9347-68424a351f2c", 00:17:42.517 "assigned_rate_limits": { 00:17:42.517 "rw_ios_per_sec": 0, 00:17:42.517 "rw_mbytes_per_sec": 0, 00:17:42.517 "r_mbytes_per_sec": 0, 00:17:42.517 "w_mbytes_per_sec": 0 00:17:42.517 }, 00:17:42.517 "claimed": false, 00:17:42.517 "zoned": false, 00:17:42.517 "supported_io_types": { 00:17:42.517 "read": true, 00:17:42.517 "write": true, 00:17:42.517 "unmap": false, 00:17:42.517 "write_zeroes": true, 00:17:42.517 "flush": true, 00:17:42.517 "reset": true, 00:17:42.517 "compare": true, 00:17:42.517 "compare_and_write": true, 00:17:42.517 "abort": true, 00:17:42.517 "nvme_admin": true, 00:17:42.517 "nvme_io": true 00:17:42.517 }, 00:17:42.517 "memory_domains": [ 00:17:42.517 { 00:17:42.517 "dma_device_id": "system", 00:17:42.517 "dma_device_type": 1 00:17:42.517 } 00:17:42.517 ], 00:17:42.517 "driver_specific": { 00:17:42.517 "nvme": [ 00:17:42.517 { 00:17:42.517 "trid": { 00:17:42.517 "trtype": "TCP", 00:17:42.517 "adrfam": "IPv4", 00:17:42.517 "traddr": "10.0.0.2", 00:17:42.517 "trsvcid": "4420", 00:17:42.517 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:42.517 }, 00:17:42.517 "ctrlr_data": { 00:17:42.517 "cntlid": 2, 00:17:42.517 "vendor_id": "0x8086", 00:17:42.517 "model_number": "SPDK bdev Controller", 00:17:42.518 "serial_number": "00000000000000000000", 00:17:42.518 "firmware_revision": "24.05", 00:17:42.518 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:42.518 "oacs": { 00:17:42.518 "security": 0, 00:17:42.518 "format": 0, 00:17:42.518 "firmware": 0, 00:17:42.518 "ns_manage": 0 00:17:42.518 }, 00:17:42.518 "multi_ctrlr": true, 00:17:42.518 "ana_reporting": false 00:17:42.518 }, 00:17:42.518 "vs": { 00:17:42.518 "nvme_version": "1.3" 00:17:42.518 }, 00:17:42.518 "ns_data": { 00:17:42.518 "id": 1, 00:17:42.518 "can_share": true 00:17:42.518 } 00:17:42.518 } 00:17:42.518 ], 00:17:42.518 "mp_policy": "active_passive" 00:17:42.518 } 00:17:42.518 } 00:17:42.518 ] 00:17:42.518 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.518 03:29:07 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:17:42.518 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.518 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.518 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.518 03:29:07 -- host/async_init.sh@53 -- # mktemp 00:17:42.518 03:29:07 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.eTgXiUvctf 00:17:42.518 03:29:07 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:42.518 03:29:07 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.eTgXiUvctf 00:17:42.518 03:29:07 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:17:42.518 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.518 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.518 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.518 03:29:07 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:17:42.518 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.518 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.518 [2024-04-27 03:29:07.443652] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:42.518 [2024-04-27 03:29:07.443778] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:17:42.518 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.518 03:29:07 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.eTgXiUvctf 00:17:42.518 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.518 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.518 [2024-04-27 03:29:07.451684] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:17:42.518 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.518 03:29:07 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.eTgXiUvctf 00:17:42.518 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.518 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.518 [2024-04-27 03:29:07.459691] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:42.518 [2024-04-27 03:29:07.459751] nvme_tcp.c:2577:nvme_tcp_generate_tls_credentials: *WARNING*: nvme_ctrlr_psk: deprecated feature spdk_nvme_ctrlr_opts.psk to be removed in v24.09 00:17:42.778 nvme0n1 00:17:42.778 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.778 03:29:07 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:17:42.778 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.778 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.778 [ 00:17:42.778 { 00:17:42.778 "name": "nvme0n1", 00:17:42.778 "aliases": [ 00:17:42.778 "0a50e6eb-03db-4f56-9347-68424a351f2c" 00:17:42.778 ], 00:17:42.778 "product_name": "NVMe disk", 00:17:42.778 "block_size": 512, 00:17:42.778 "num_blocks": 2097152, 00:17:42.778 "uuid": "0a50e6eb-03db-4f56-9347-68424a351f2c", 00:17:42.778 "assigned_rate_limits": { 00:17:42.778 "rw_ios_per_sec": 0, 00:17:42.778 "rw_mbytes_per_sec": 0, 00:17:42.778 "r_mbytes_per_sec": 0, 00:17:42.778 "w_mbytes_per_sec": 0 00:17:42.778 }, 00:17:42.778 "claimed": false, 00:17:42.778 "zoned": false, 00:17:42.778 "supported_io_types": { 00:17:42.778 "read": true, 00:17:42.778 "write": true, 00:17:42.778 "unmap": false, 00:17:42.778 "write_zeroes": true, 00:17:42.778 "flush": true, 00:17:42.778 "reset": true, 00:17:42.778 "compare": true, 00:17:42.778 "compare_and_write": true, 00:17:42.778 "abort": true, 00:17:42.778 "nvme_admin": true, 00:17:42.778 "nvme_io": true 00:17:42.778 }, 00:17:42.778 "memory_domains": [ 00:17:42.778 { 00:17:42.778 "dma_device_id": "system", 00:17:42.778 "dma_device_type": 1 00:17:42.778 } 00:17:42.778 ], 00:17:42.778 "driver_specific": { 00:17:42.778 "nvme": [ 00:17:42.778 { 00:17:42.778 "trid": { 00:17:42.778 "trtype": "TCP", 00:17:42.778 "adrfam": "IPv4", 00:17:42.778 "traddr": "10.0.0.2", 00:17:42.778 "trsvcid": "4421", 00:17:42.778 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:42.778 }, 00:17:42.778 "ctrlr_data": { 00:17:42.778 "cntlid": 3, 00:17:42.778 "vendor_id": "0x8086", 00:17:42.778 "model_number": "SPDK bdev Controller", 00:17:42.778 "serial_number": "00000000000000000000", 00:17:42.778 "firmware_revision": "24.05", 00:17:42.778 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:42.778 "oacs": { 00:17:42.778 "security": 0, 00:17:42.778 "format": 0, 00:17:42.778 "firmware": 0, 00:17:42.778 "ns_manage": 0 00:17:42.778 }, 00:17:42.778 "multi_ctrlr": true, 00:17:42.778 "ana_reporting": false 00:17:42.778 }, 00:17:42.778 "vs": { 00:17:42.778 "nvme_version": "1.3" 00:17:42.778 }, 00:17:42.778 "ns_data": { 00:17:42.778 "id": 1, 00:17:42.778 "can_share": true 00:17:42.778 } 00:17:42.778 } 00:17:42.778 ], 00:17:42.778 "mp_policy": "active_passive" 00:17:42.778 } 00:17:42.778 } 00:17:42.778 ] 00:17:42.778 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.778 03:29:07 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:17:42.778 03:29:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:42.778 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:17:42.778 03:29:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:42.778 03:29:07 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.eTgXiUvctf 00:17:42.778 03:29:07 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:17:42.778 03:29:07 -- host/async_init.sh@78 -- # nvmftestfini 00:17:42.778 03:29:07 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:42.779 03:29:07 -- nvmf/common.sh@117 -- # sync 00:17:42.779 03:29:07 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:17:42.779 03:29:07 -- nvmf/common.sh@120 -- # set +e 00:17:42.779 03:29:07 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:42.779 03:29:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:17:42.779 rmmod nvme_tcp 00:17:42.779 rmmod nvme_fabrics 00:17:42.779 rmmod nvme_keyring 00:17:42.779 03:29:07 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:42.779 03:29:07 -- nvmf/common.sh@124 -- # set -e 00:17:42.779 03:29:07 -- nvmf/common.sh@125 -- # return 0 00:17:42.779 03:29:07 -- nvmf/common.sh@478 -- # '[' -n 1484185 ']' 00:17:42.779 03:29:07 -- nvmf/common.sh@479 -- # killprocess 1484185 00:17:42.779 03:29:07 -- common/autotest_common.sh@936 -- # '[' -z 1484185 ']' 00:17:42.779 03:29:07 -- common/autotest_common.sh@940 -- # kill -0 1484185 00:17:42.779 03:29:07 -- common/autotest_common.sh@941 -- # uname 00:17:42.779 03:29:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.779 03:29:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1484185 00:17:42.779 03:29:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:42.779 03:29:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:42.779 03:29:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1484185' 00:17:42.779 killing process with pid 1484185 00:17:42.779 03:29:07 -- common/autotest_common.sh@955 -- # kill 1484185 00:17:42.779 [2024-04-27 03:29:07.654718] app.c: 937:log_deprecation_hits: *WARNING*: nvme_ctrlr_psk: deprecation 'spdk_nvme_ctrlr_opts.psk' scheduled for removal in v24.09 hit 1 times 00:17:42.779 [2024-04-27 03:29:07.654759] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:17:42.779 03:29:07 -- common/autotest_common.sh@960 -- # wait 1484185 00:17:43.037 03:29:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:43.037 03:29:07 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:17:43.037 03:29:07 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:17:43.037 03:29:07 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:43.037 03:29:07 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:17:43.037 03:29:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:43.037 03:29:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:43.037 03:29:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:45.577 03:29:09 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:17:45.577 00:17:45.577 real 0m5.583s 00:17:45.577 user 0m2.157s 00:17:45.577 sys 0m1.801s 00:17:45.577 03:29:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:45.577 03:29:09 -- common/autotest_common.sh@10 -- # set +x 00:17:45.577 ************************************ 00:17:45.577 END TEST nvmf_async_init 00:17:45.577 ************************************ 00:17:45.577 03:29:09 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:17:45.577 03:29:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:45.577 03:29:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:45.577 03:29:09 -- common/autotest_common.sh@10 -- # set +x 00:17:45.577 ************************************ 00:17:45.577 START TEST dma 00:17:45.577 ************************************ 00:17:45.577 03:29:10 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:17:45.577 * Looking for test storage... 00:17:45.577 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:17:45.577 03:29:10 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:45.577 03:29:10 -- nvmf/common.sh@7 -- # uname -s 00:17:45.577 03:29:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:45.577 03:29:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:45.577 03:29:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:45.577 03:29:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:45.577 03:29:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:45.577 03:29:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:45.577 03:29:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:45.577 03:29:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:45.577 03:29:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:45.577 03:29:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:45.577 03:29:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:17:45.577 03:29:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:17:45.577 03:29:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:45.577 03:29:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:45.577 03:29:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:45.577 03:29:10 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:45.577 03:29:10 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:45.577 03:29:10 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:45.577 03:29:10 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:45.577 03:29:10 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:45.577 03:29:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.577 03:29:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.577 03:29:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.577 03:29:10 -- paths/export.sh@5 -- # export PATH 00:17:45.577 03:29:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.577 03:29:10 -- nvmf/common.sh@47 -- # : 0 00:17:45.577 03:29:10 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:45.577 03:29:10 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:45.577 03:29:10 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:45.577 03:29:10 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:45.577 03:29:10 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:45.577 03:29:10 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:45.577 03:29:10 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:45.577 03:29:10 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:45.577 03:29:10 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:17:45.577 03:29:10 -- host/dma.sh@13 -- # exit 0 00:17:45.577 00:17:45.577 real 0m0.073s 00:17:45.577 user 0m0.033s 00:17:45.577 sys 0m0.046s 00:17:45.577 03:29:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:45.577 03:29:10 -- common/autotest_common.sh@10 -- # set +x 00:17:45.577 ************************************ 00:17:45.577 END TEST dma 00:17:45.577 ************************************ 00:17:45.577 03:29:10 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:17:45.577 03:29:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:45.577 03:29:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:45.577 03:29:10 -- common/autotest_common.sh@10 -- # set +x 00:17:45.577 ************************************ 00:17:45.577 START TEST nvmf_identify 00:17:45.577 ************************************ 00:17:45.577 03:29:10 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:17:45.577 * Looking for test storage... 00:17:45.577 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:17:45.577 03:29:10 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:45.577 03:29:10 -- nvmf/common.sh@7 -- # uname -s 00:17:45.577 03:29:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:45.577 03:29:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:45.577 03:29:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:45.577 03:29:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:45.577 03:29:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:45.577 03:29:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:45.577 03:29:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:45.577 03:29:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:45.578 03:29:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:45.578 03:29:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:45.578 03:29:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:17:45.578 03:29:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:17:45.578 03:29:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:45.578 03:29:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:45.578 03:29:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:45.578 03:29:10 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:45.578 03:29:10 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:45.578 03:29:10 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:45.578 03:29:10 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:45.578 03:29:10 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:45.578 03:29:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.578 03:29:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.578 03:29:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.578 03:29:10 -- paths/export.sh@5 -- # export PATH 00:17:45.578 03:29:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.578 03:29:10 -- nvmf/common.sh@47 -- # : 0 00:17:45.578 03:29:10 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:45.578 03:29:10 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:45.578 03:29:10 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:45.578 03:29:10 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:45.578 03:29:10 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:45.578 03:29:10 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:45.578 03:29:10 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:45.578 03:29:10 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:45.578 03:29:10 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:45.578 03:29:10 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:45.578 03:29:10 -- host/identify.sh@14 -- # nvmftestinit 00:17:45.578 03:29:10 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:17:45.578 03:29:10 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:45.578 03:29:10 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:45.578 03:29:10 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:45.578 03:29:10 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:45.578 03:29:10 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:45.578 03:29:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:45.578 03:29:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:45.578 03:29:10 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:45.578 03:29:10 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:45.578 03:29:10 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:45.578 03:29:10 -- common/autotest_common.sh@10 -- # set +x 00:17:47.480 03:29:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:47.480 03:29:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:47.480 03:29:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:47.480 03:29:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:47.480 03:29:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:47.480 03:29:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:47.480 03:29:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:47.480 03:29:12 -- nvmf/common.sh@295 -- # net_devs=() 00:17:47.480 03:29:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:47.480 03:29:12 -- nvmf/common.sh@296 -- # e810=() 00:17:47.480 03:29:12 -- nvmf/common.sh@296 -- # local -ga e810 00:17:47.480 03:29:12 -- nvmf/common.sh@297 -- # x722=() 00:17:47.480 03:29:12 -- nvmf/common.sh@297 -- # local -ga x722 00:17:47.480 03:29:12 -- nvmf/common.sh@298 -- # mlx=() 00:17:47.480 03:29:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:47.480 03:29:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:47.480 03:29:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:47.480 03:29:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:47.480 03:29:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:47.480 03:29:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:47.480 03:29:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:47.480 03:29:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:47.480 03:29:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:47.480 03:29:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:47.481 03:29:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:47.481 03:29:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:47.481 03:29:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:47.481 03:29:12 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:47.481 03:29:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:47.481 03:29:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:47.481 03:29:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:17:47.481 Found 0000:09:00.0 (0x8086 - 0x159b) 00:17:47.481 03:29:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:47.481 03:29:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:17:47.481 Found 0000:09:00.1 (0x8086 - 0x159b) 00:17:47.481 03:29:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:47.481 03:29:12 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:47.481 03:29:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:47.481 03:29:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:47.481 03:29:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:47.481 03:29:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:17:47.481 Found net devices under 0000:09:00.0: cvl_0_0 00:17:47.481 03:29:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:47.481 03:29:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:47.481 03:29:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:47.481 03:29:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:47.481 03:29:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:47.481 03:29:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:17:47.481 Found net devices under 0000:09:00.1: cvl_0_1 00:17:47.481 03:29:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:47.481 03:29:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:47.481 03:29:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:47.481 03:29:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:17:47.481 03:29:12 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:47.481 03:29:12 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:47.481 03:29:12 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:47.481 03:29:12 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:17:47.481 03:29:12 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:47.481 03:29:12 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:47.481 03:29:12 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:17:47.481 03:29:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:47.481 03:29:12 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:47.481 03:29:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:17:47.481 03:29:12 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:17:47.481 03:29:12 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:17:47.481 03:29:12 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:47.481 03:29:12 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:47.481 03:29:12 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:47.481 03:29:12 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:17:47.481 03:29:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:47.481 03:29:12 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:47.481 03:29:12 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:47.481 03:29:12 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:17:47.481 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:47.481 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:17:47.481 00:17:47.481 --- 10.0.0.2 ping statistics --- 00:17:47.481 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:47.481 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:17:47.481 03:29:12 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:47.481 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:47.481 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:17:47.481 00:17:47.481 --- 10.0.0.1 ping statistics --- 00:17:47.481 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:47.481 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:17:47.481 03:29:12 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:47.481 03:29:12 -- nvmf/common.sh@411 -- # return 0 00:17:47.481 03:29:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:47.481 03:29:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:47.481 03:29:12 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:17:47.481 03:29:12 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:47.481 03:29:12 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:17:47.481 03:29:12 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:17:47.481 03:29:12 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:17:47.481 03:29:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:47.481 03:29:12 -- common/autotest_common.sh@10 -- # set +x 00:17:47.481 03:29:12 -- host/identify.sh@19 -- # nvmfpid=1486325 00:17:47.481 03:29:12 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:47.481 03:29:12 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:47.481 03:29:12 -- host/identify.sh@23 -- # waitforlisten 1486325 00:17:47.481 03:29:12 -- common/autotest_common.sh@817 -- # '[' -z 1486325 ']' 00:17:47.481 03:29:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:47.481 03:29:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:47.481 03:29:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:47.481 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:47.481 03:29:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:47.481 03:29:12 -- common/autotest_common.sh@10 -- # set +x 00:17:47.741 [2024-04-27 03:29:12.485837] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:47.741 [2024-04-27 03:29:12.485909] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:47.741 EAL: No free 2048 kB hugepages reported on node 1 00:17:47.741 [2024-04-27 03:29:12.557165] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:47.741 [2024-04-27 03:29:12.670576] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:47.741 [2024-04-27 03:29:12.670641] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:47.741 [2024-04-27 03:29:12.670656] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:47.741 [2024-04-27 03:29:12.670669] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:47.741 [2024-04-27 03:29:12.670681] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:47.741 [2024-04-27 03:29:12.670778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:47.741 [2024-04-27 03:29:12.670834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.741 [2024-04-27 03:29:12.670920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:47.741 [2024-04-27 03:29:12.670923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:48.678 03:29:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:48.678 03:29:13 -- common/autotest_common.sh@850 -- # return 0 00:17:48.678 03:29:13 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:48.678 03:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:48.678 03:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:48.678 [2024-04-27 03:29:13.433982] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:48.678 03:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:48.678 03:29:13 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:17:48.678 03:29:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:48.678 03:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:48.678 03:29:13 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:48.678 03:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:48.678 03:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:48.678 Malloc0 00:17:48.678 03:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:48.678 03:29:13 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:48.678 03:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:48.678 03:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:48.678 03:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:48.678 03:29:13 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:17:48.678 03:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:48.678 03:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:48.678 03:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:48.678 03:29:13 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:48.678 03:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:48.678 03:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:48.678 [2024-04-27 03:29:13.511154] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:48.678 03:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:48.678 03:29:13 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:48.678 03:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:48.678 03:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:48.678 03:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:48.678 03:29:13 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:17:48.678 03:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:48.678 03:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:48.678 [2024-04-27 03:29:13.526907] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:17:48.678 [ 00:17:48.678 { 00:17:48.678 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:17:48.678 "subtype": "Discovery", 00:17:48.678 "listen_addresses": [ 00:17:48.678 { 00:17:48.678 "transport": "TCP", 00:17:48.678 "trtype": "TCP", 00:17:48.678 "adrfam": "IPv4", 00:17:48.678 "traddr": "10.0.0.2", 00:17:48.678 "trsvcid": "4420" 00:17:48.678 } 00:17:48.678 ], 00:17:48.678 "allow_any_host": true, 00:17:48.678 "hosts": [] 00:17:48.678 }, 00:17:48.678 { 00:17:48.678 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.678 "subtype": "NVMe", 00:17:48.678 "listen_addresses": [ 00:17:48.678 { 00:17:48.678 "transport": "TCP", 00:17:48.678 "trtype": "TCP", 00:17:48.679 "adrfam": "IPv4", 00:17:48.679 "traddr": "10.0.0.2", 00:17:48.679 "trsvcid": "4420" 00:17:48.679 } 00:17:48.679 ], 00:17:48.679 "allow_any_host": true, 00:17:48.679 "hosts": [], 00:17:48.679 "serial_number": "SPDK00000000000001", 00:17:48.679 "model_number": "SPDK bdev Controller", 00:17:48.679 "max_namespaces": 32, 00:17:48.679 "min_cntlid": 1, 00:17:48.679 "max_cntlid": 65519, 00:17:48.679 "namespaces": [ 00:17:48.679 { 00:17:48.679 "nsid": 1, 00:17:48.679 "bdev_name": "Malloc0", 00:17:48.679 "name": "Malloc0", 00:17:48.679 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:17:48.679 "eui64": "ABCDEF0123456789", 00:17:48.679 "uuid": "81568190-a6ef-4e75-8ac5-71c1112d000d" 00:17:48.679 } 00:17:48.679 ] 00:17:48.679 } 00:17:48.679 ] 00:17:48.679 03:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:48.679 03:29:13 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:17:48.679 [2024-04-27 03:29:13.550851] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:48.679 [2024-04-27 03:29:13.550890] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1486487 ] 00:17:48.679 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.679 [2024-04-27 03:29:13.583603] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:17:48.679 [2024-04-27 03:29:13.583659] nvme_tcp.c:2326:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:17:48.679 [2024-04-27 03:29:13.583669] nvme_tcp.c:2330:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:17:48.679 [2024-04-27 03:29:13.583683] nvme_tcp.c:2348:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:17:48.679 [2024-04-27 03:29:13.583694] sock.c: 336:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:17:48.679 [2024-04-27 03:29:13.587290] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:17:48.679 [2024-04-27 03:29:13.587350] nvme_tcp.c:1543:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1f49d60 0 00:17:48.679 [2024-04-27 03:29:13.595263] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:17:48.679 [2024-04-27 03:29:13.595284] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:17:48.679 [2024-04-27 03:29:13.595292] nvme_tcp.c:1589:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:17:48.679 [2024-04-27 03:29:13.595298] nvme_tcp.c:1590:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:17:48.679 [2024-04-27 03:29:13.595347] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.595359] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.595366] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f49d60) 00:17:48.679 [2024-04-27 03:29:13.595383] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:17:48.679 [2024-04-27 03:29:13.595414] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa8f20, cid 0, qid 0 00:17:48.679 [2024-04-27 03:29:13.603261] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.679 [2024-04-27 03:29:13.603279] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.679 [2024-04-27 03:29:13.603287] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.603294] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa8f20) on tqpair=0x1f49d60 00:17:48.679 [2024-04-27 03:29:13.603315] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:17:48.679 [2024-04-27 03:29:13.603326] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:17:48.679 [2024-04-27 03:29:13.603335] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:17:48.679 [2024-04-27 03:29:13.603355] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.603364] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.603370] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f49d60) 00:17:48.679 [2024-04-27 03:29:13.603382] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.679 [2024-04-27 03:29:13.603404] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa8f20, cid 0, qid 0 00:17:48.679 [2024-04-27 03:29:13.603528] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.679 [2024-04-27 03:29:13.603540] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.679 [2024-04-27 03:29:13.603546] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.603553] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa8f20) on tqpair=0x1f49d60 00:17:48.679 [2024-04-27 03:29:13.603563] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:17:48.679 [2024-04-27 03:29:13.603575] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:17:48.679 [2024-04-27 03:29:13.603588] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.603595] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.603601] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f49d60) 00:17:48.679 [2024-04-27 03:29:13.603613] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.679 [2024-04-27 03:29:13.603633] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa8f20, cid 0, qid 0 00:17:48.679 [2024-04-27 03:29:13.603748] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.679 [2024-04-27 03:29:13.603763] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.679 [2024-04-27 03:29:13.603770] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.603777] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa8f20) on tqpair=0x1f49d60 00:17:48.679 [2024-04-27 03:29:13.603787] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:17:48.679 [2024-04-27 03:29:13.603801] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:17:48.679 [2024-04-27 03:29:13.603812] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.603820] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.603826] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f49d60) 00:17:48.679 [2024-04-27 03:29:13.603838] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.679 [2024-04-27 03:29:13.603863] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa8f20, cid 0, qid 0 00:17:48.679 [2024-04-27 03:29:13.603975] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.679 [2024-04-27 03:29:13.603988] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.679 [2024-04-27 03:29:13.603994] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.604001] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa8f20) on tqpair=0x1f49d60 00:17:48.679 [2024-04-27 03:29:13.604010] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:17:48.679 [2024-04-27 03:29:13.604026] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.604035] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.604041] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f49d60) 00:17:48.679 [2024-04-27 03:29:13.604052] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.679 [2024-04-27 03:29:13.604072] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa8f20, cid 0, qid 0 00:17:48.679 [2024-04-27 03:29:13.604161] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.679 [2024-04-27 03:29:13.604173] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.679 [2024-04-27 03:29:13.604180] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.604187] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa8f20) on tqpair=0x1f49d60 00:17:48.679 [2024-04-27 03:29:13.604196] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:17:48.679 [2024-04-27 03:29:13.604205] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:17:48.679 [2024-04-27 03:29:13.604217] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:17:48.679 [2024-04-27 03:29:13.604327] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:17:48.679 [2024-04-27 03:29:13.604337] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:17:48.679 [2024-04-27 03:29:13.604351] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.604358] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.604365] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f49d60) 00:17:48.679 [2024-04-27 03:29:13.604375] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.679 [2024-04-27 03:29:13.604396] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa8f20, cid 0, qid 0 00:17:48.679 [2024-04-27 03:29:13.604511] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.679 [2024-04-27 03:29:13.604526] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.679 [2024-04-27 03:29:13.604533] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.679 [2024-04-27 03:29:13.604540] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa8f20) on tqpair=0x1f49d60 00:17:48.679 [2024-04-27 03:29:13.604549] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:17:48.680 [2024-04-27 03:29:13.604566] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.604574] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.604580] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f49d60) 00:17:48.680 [2024-04-27 03:29:13.604595] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.680 [2024-04-27 03:29:13.604616] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa8f20, cid 0, qid 0 00:17:48.680 [2024-04-27 03:29:13.604730] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.680 [2024-04-27 03:29:13.604745] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.680 [2024-04-27 03:29:13.604752] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.604759] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa8f20) on tqpair=0x1f49d60 00:17:48.680 [2024-04-27 03:29:13.604768] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:17:48.680 [2024-04-27 03:29:13.604776] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:17:48.680 [2024-04-27 03:29:13.604789] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:17:48.680 [2024-04-27 03:29:13.604807] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:17:48.680 [2024-04-27 03:29:13.604825] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.604834] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f49d60) 00:17:48.680 [2024-04-27 03:29:13.604845] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.680 [2024-04-27 03:29:13.604866] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa8f20, cid 0, qid 0 00:17:48.680 [2024-04-27 03:29:13.605015] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:48.680 [2024-04-27 03:29:13.605027] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:48.680 [2024-04-27 03:29:13.605034] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.605040] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f49d60): datao=0, datal=4096, cccid=0 00:17:48.680 [2024-04-27 03:29:13.605048] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fa8f20) on tqpair(0x1f49d60): expected_datao=0, payload_size=4096 00:17:48.680 [2024-04-27 03:29:13.605056] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.605073] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.605082] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645353] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.680 [2024-04-27 03:29:13.645372] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.680 [2024-04-27 03:29:13.645379] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645386] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa8f20) on tqpair=0x1f49d60 00:17:48.680 [2024-04-27 03:29:13.645399] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:17:48.680 [2024-04-27 03:29:13.645408] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:17:48.680 [2024-04-27 03:29:13.645416] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:17:48.680 [2024-04-27 03:29:13.645424] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:17:48.680 [2024-04-27 03:29:13.645432] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:17:48.680 [2024-04-27 03:29:13.645439] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:17:48.680 [2024-04-27 03:29:13.645458] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:17:48.680 [2024-04-27 03:29:13.645472] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645480] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645486] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f49d60) 00:17:48.680 [2024-04-27 03:29:13.645497] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:48.680 [2024-04-27 03:29:13.645520] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa8f20, cid 0, qid 0 00:17:48.680 [2024-04-27 03:29:13.645637] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.680 [2024-04-27 03:29:13.645652] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.680 [2024-04-27 03:29:13.645659] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645666] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa8f20) on tqpair=0x1f49d60 00:17:48.680 [2024-04-27 03:29:13.645687] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645694] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645701] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f49d60) 00:17:48.680 [2024-04-27 03:29:13.645711] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.680 [2024-04-27 03:29:13.645721] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645728] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645734] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1f49d60) 00:17:48.680 [2024-04-27 03:29:13.645743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.680 [2024-04-27 03:29:13.645752] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645759] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645765] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1f49d60) 00:17:48.680 [2024-04-27 03:29:13.645774] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.680 [2024-04-27 03:29:13.645783] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645790] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645796] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.680 [2024-04-27 03:29:13.645805] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.680 [2024-04-27 03:29:13.645814] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:17:48.680 [2024-04-27 03:29:13.645833] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:17:48.680 [2024-04-27 03:29:13.645846] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.645853] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f49d60) 00:17:48.680 [2024-04-27 03:29:13.645864] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.680 [2024-04-27 03:29:13.645886] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa8f20, cid 0, qid 0 00:17:48.680 [2024-04-27 03:29:13.645912] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9080, cid 1, qid 0 00:17:48.680 [2024-04-27 03:29:13.645923] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa91e0, cid 2, qid 0 00:17:48.680 [2024-04-27 03:29:13.645931] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.680 [2024-04-27 03:29:13.645939] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa94a0, cid 4, qid 0 00:17:48.680 [2024-04-27 03:29:13.646178] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.680 [2024-04-27 03:29:13.646191] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.680 [2024-04-27 03:29:13.646198] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.646204] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa94a0) on tqpair=0x1f49d60 00:17:48.680 [2024-04-27 03:29:13.646214] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:17:48.680 [2024-04-27 03:29:13.646223] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:17:48.680 [2024-04-27 03:29:13.650256] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.650270] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f49d60) 00:17:48.680 [2024-04-27 03:29:13.650281] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.680 [2024-04-27 03:29:13.650303] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa94a0, cid 4, qid 0 00:17:48.680 [2024-04-27 03:29:13.650445] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:48.680 [2024-04-27 03:29:13.650461] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:48.680 [2024-04-27 03:29:13.650468] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.650474] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f49d60): datao=0, datal=4096, cccid=4 00:17:48.680 [2024-04-27 03:29:13.650482] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fa94a0) on tqpair(0x1f49d60): expected_datao=0, payload_size=4096 00:17:48.680 [2024-04-27 03:29:13.650489] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.680 [2024-04-27 03:29:13.650508] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.650517] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.650578] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.681 [2024-04-27 03:29:13.650593] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.681 [2024-04-27 03:29:13.650600] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.650607] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa94a0) on tqpair=0x1f49d60 00:17:48.681 [2024-04-27 03:29:13.650628] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:17:48.681 [2024-04-27 03:29:13.650664] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.650674] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f49d60) 00:17:48.681 [2024-04-27 03:29:13.650685] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.681 [2024-04-27 03:29:13.650708] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.650722] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.650735] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f49d60) 00:17:48.681 [2024-04-27 03:29:13.650748] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.681 [2024-04-27 03:29:13.650785] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa94a0, cid 4, qid 0 00:17:48.681 [2024-04-27 03:29:13.650803] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9600, cid 5, qid 0 00:17:48.681 [2024-04-27 03:29:13.650975] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:48.681 [2024-04-27 03:29:13.650988] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:48.681 [2024-04-27 03:29:13.650995] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.651001] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f49d60): datao=0, datal=1024, cccid=4 00:17:48.681 [2024-04-27 03:29:13.651009] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fa94a0) on tqpair(0x1f49d60): expected_datao=0, payload_size=1024 00:17:48.681 [2024-04-27 03:29:13.651017] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.651026] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.651033] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.651042] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.681 [2024-04-27 03:29:13.651051] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.681 [2024-04-27 03:29:13.651058] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.681 [2024-04-27 03:29:13.651064] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9600) on tqpair=0x1f49d60 00:17:48.942 [2024-04-27 03:29:13.691367] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.942 [2024-04-27 03:29:13.691388] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.942 [2024-04-27 03:29:13.691396] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.691403] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa94a0) on tqpair=0x1f49d60 00:17:48.942 [2024-04-27 03:29:13.691422] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.691431] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f49d60) 00:17:48.942 [2024-04-27 03:29:13.691443] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.942 [2024-04-27 03:29:13.691472] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa94a0, cid 4, qid 0 00:17:48.942 [2024-04-27 03:29:13.691627] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:48.942 [2024-04-27 03:29:13.691639] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:48.942 [2024-04-27 03:29:13.691646] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.691653] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f49d60): datao=0, datal=3072, cccid=4 00:17:48.942 [2024-04-27 03:29:13.691660] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fa94a0) on tqpair(0x1f49d60): expected_datao=0, payload_size=3072 00:17:48.942 [2024-04-27 03:29:13.691668] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.691686] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.691695] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.732355] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.942 [2024-04-27 03:29:13.732374] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.942 [2024-04-27 03:29:13.732382] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.732389] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa94a0) on tqpair=0x1f49d60 00:17:48.942 [2024-04-27 03:29:13.732406] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.732415] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f49d60) 00:17:48.942 [2024-04-27 03:29:13.732427] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.942 [2024-04-27 03:29:13.732456] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa94a0, cid 4, qid 0 00:17:48.942 [2024-04-27 03:29:13.732566] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:48.942 [2024-04-27 03:29:13.732582] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:48.942 [2024-04-27 03:29:13.732589] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.732596] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f49d60): datao=0, datal=8, cccid=4 00:17:48.942 [2024-04-27 03:29:13.732603] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fa94a0) on tqpair(0x1f49d60): expected_datao=0, payload_size=8 00:17:48.942 [2024-04-27 03:29:13.732611] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.732621] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.732628] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.777283] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.942 [2024-04-27 03:29:13.777301] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.942 [2024-04-27 03:29:13.777308] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.942 [2024-04-27 03:29:13.777314] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa94a0) on tqpair=0x1f49d60 00:17:48.942 ===================================================== 00:17:48.942 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:17:48.942 ===================================================== 00:17:48.942 Controller Capabilities/Features 00:17:48.942 ================================ 00:17:48.942 Vendor ID: 0000 00:17:48.942 Subsystem Vendor ID: 0000 00:17:48.942 Serial Number: .................... 00:17:48.942 Model Number: ........................................ 00:17:48.942 Firmware Version: 24.05 00:17:48.942 Recommended Arb Burst: 0 00:17:48.942 IEEE OUI Identifier: 00 00 00 00:17:48.942 Multi-path I/O 00:17:48.942 May have multiple subsystem ports: No 00:17:48.942 May have multiple controllers: No 00:17:48.942 Associated with SR-IOV VF: No 00:17:48.942 Max Data Transfer Size: 131072 00:17:48.942 Max Number of Namespaces: 0 00:17:48.942 Max Number of I/O Queues: 1024 00:17:48.942 NVMe Specification Version (VS): 1.3 00:17:48.942 NVMe Specification Version (Identify): 1.3 00:17:48.942 Maximum Queue Entries: 128 00:17:48.942 Contiguous Queues Required: Yes 00:17:48.942 Arbitration Mechanisms Supported 00:17:48.942 Weighted Round Robin: Not Supported 00:17:48.942 Vendor Specific: Not Supported 00:17:48.942 Reset Timeout: 15000 ms 00:17:48.942 Doorbell Stride: 4 bytes 00:17:48.942 NVM Subsystem Reset: Not Supported 00:17:48.942 Command Sets Supported 00:17:48.942 NVM Command Set: Supported 00:17:48.942 Boot Partition: Not Supported 00:17:48.942 Memory Page Size Minimum: 4096 bytes 00:17:48.942 Memory Page Size Maximum: 4096 bytes 00:17:48.942 Persistent Memory Region: Not Supported 00:17:48.942 Optional Asynchronous Events Supported 00:17:48.942 Namespace Attribute Notices: Not Supported 00:17:48.942 Firmware Activation Notices: Not Supported 00:17:48.942 ANA Change Notices: Not Supported 00:17:48.942 PLE Aggregate Log Change Notices: Not Supported 00:17:48.942 LBA Status Info Alert Notices: Not Supported 00:17:48.942 EGE Aggregate Log Change Notices: Not Supported 00:17:48.942 Normal NVM Subsystem Shutdown event: Not Supported 00:17:48.942 Zone Descriptor Change Notices: Not Supported 00:17:48.942 Discovery Log Change Notices: Supported 00:17:48.942 Controller Attributes 00:17:48.942 128-bit Host Identifier: Not Supported 00:17:48.942 Non-Operational Permissive Mode: Not Supported 00:17:48.942 NVM Sets: Not Supported 00:17:48.943 Read Recovery Levels: Not Supported 00:17:48.943 Endurance Groups: Not Supported 00:17:48.943 Predictable Latency Mode: Not Supported 00:17:48.943 Traffic Based Keep ALive: Not Supported 00:17:48.943 Namespace Granularity: Not Supported 00:17:48.943 SQ Associations: Not Supported 00:17:48.943 UUID List: Not Supported 00:17:48.943 Multi-Domain Subsystem: Not Supported 00:17:48.943 Fixed Capacity Management: Not Supported 00:17:48.943 Variable Capacity Management: Not Supported 00:17:48.943 Delete Endurance Group: Not Supported 00:17:48.943 Delete NVM Set: Not Supported 00:17:48.943 Extended LBA Formats Supported: Not Supported 00:17:48.943 Flexible Data Placement Supported: Not Supported 00:17:48.943 00:17:48.943 Controller Memory Buffer Support 00:17:48.943 ================================ 00:17:48.943 Supported: No 00:17:48.943 00:17:48.943 Persistent Memory Region Support 00:17:48.943 ================================ 00:17:48.943 Supported: No 00:17:48.943 00:17:48.943 Admin Command Set Attributes 00:17:48.943 ============================ 00:17:48.943 Security Send/Receive: Not Supported 00:17:48.943 Format NVM: Not Supported 00:17:48.943 Firmware Activate/Download: Not Supported 00:17:48.943 Namespace Management: Not Supported 00:17:48.943 Device Self-Test: Not Supported 00:17:48.943 Directives: Not Supported 00:17:48.943 NVMe-MI: Not Supported 00:17:48.943 Virtualization Management: Not Supported 00:17:48.943 Doorbell Buffer Config: Not Supported 00:17:48.943 Get LBA Status Capability: Not Supported 00:17:48.943 Command & Feature Lockdown Capability: Not Supported 00:17:48.943 Abort Command Limit: 1 00:17:48.943 Async Event Request Limit: 4 00:17:48.943 Number of Firmware Slots: N/A 00:17:48.943 Firmware Slot 1 Read-Only: N/A 00:17:48.943 Firmware Activation Without Reset: N/A 00:17:48.943 Multiple Update Detection Support: N/A 00:17:48.943 Firmware Update Granularity: No Information Provided 00:17:48.943 Per-Namespace SMART Log: No 00:17:48.943 Asymmetric Namespace Access Log Page: Not Supported 00:17:48.943 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:17:48.943 Command Effects Log Page: Not Supported 00:17:48.943 Get Log Page Extended Data: Supported 00:17:48.943 Telemetry Log Pages: Not Supported 00:17:48.943 Persistent Event Log Pages: Not Supported 00:17:48.943 Supported Log Pages Log Page: May Support 00:17:48.943 Commands Supported & Effects Log Page: Not Supported 00:17:48.943 Feature Identifiers & Effects Log Page:May Support 00:17:48.943 NVMe-MI Commands & Effects Log Page: May Support 00:17:48.943 Data Area 4 for Telemetry Log: Not Supported 00:17:48.943 Error Log Page Entries Supported: 128 00:17:48.943 Keep Alive: Not Supported 00:17:48.943 00:17:48.943 NVM Command Set Attributes 00:17:48.943 ========================== 00:17:48.943 Submission Queue Entry Size 00:17:48.943 Max: 1 00:17:48.943 Min: 1 00:17:48.943 Completion Queue Entry Size 00:17:48.943 Max: 1 00:17:48.943 Min: 1 00:17:48.943 Number of Namespaces: 0 00:17:48.943 Compare Command: Not Supported 00:17:48.943 Write Uncorrectable Command: Not Supported 00:17:48.943 Dataset Management Command: Not Supported 00:17:48.943 Write Zeroes Command: Not Supported 00:17:48.943 Set Features Save Field: Not Supported 00:17:48.943 Reservations: Not Supported 00:17:48.943 Timestamp: Not Supported 00:17:48.943 Copy: Not Supported 00:17:48.943 Volatile Write Cache: Not Present 00:17:48.943 Atomic Write Unit (Normal): 1 00:17:48.943 Atomic Write Unit (PFail): 1 00:17:48.943 Atomic Compare & Write Unit: 1 00:17:48.943 Fused Compare & Write: Supported 00:17:48.943 Scatter-Gather List 00:17:48.943 SGL Command Set: Supported 00:17:48.943 SGL Keyed: Supported 00:17:48.943 SGL Bit Bucket Descriptor: Not Supported 00:17:48.943 SGL Metadata Pointer: Not Supported 00:17:48.943 Oversized SGL: Not Supported 00:17:48.943 SGL Metadata Address: Not Supported 00:17:48.943 SGL Offset: Supported 00:17:48.943 Transport SGL Data Block: Not Supported 00:17:48.943 Replay Protected Memory Block: Not Supported 00:17:48.943 00:17:48.943 Firmware Slot Information 00:17:48.943 ========================= 00:17:48.943 Active slot: 0 00:17:48.943 00:17:48.943 00:17:48.943 Error Log 00:17:48.943 ========= 00:17:48.943 00:17:48.943 Active Namespaces 00:17:48.943 ================= 00:17:48.943 Discovery Log Page 00:17:48.943 ================== 00:17:48.943 Generation Counter: 2 00:17:48.943 Number of Records: 2 00:17:48.943 Record Format: 0 00:17:48.943 00:17:48.943 Discovery Log Entry 0 00:17:48.943 ---------------------- 00:17:48.943 Transport Type: 3 (TCP) 00:17:48.943 Address Family: 1 (IPv4) 00:17:48.943 Subsystem Type: 3 (Current Discovery Subsystem) 00:17:48.943 Entry Flags: 00:17:48.943 Duplicate Returned Information: 1 00:17:48.943 Explicit Persistent Connection Support for Discovery: 1 00:17:48.943 Transport Requirements: 00:17:48.943 Secure Channel: Not Required 00:17:48.943 Port ID: 0 (0x0000) 00:17:48.943 Controller ID: 65535 (0xffff) 00:17:48.943 Admin Max SQ Size: 128 00:17:48.943 Transport Service Identifier: 4420 00:17:48.943 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:17:48.943 Transport Address: 10.0.0.2 00:17:48.943 Discovery Log Entry 1 00:17:48.943 ---------------------- 00:17:48.943 Transport Type: 3 (TCP) 00:17:48.943 Address Family: 1 (IPv4) 00:17:48.943 Subsystem Type: 2 (NVM Subsystem) 00:17:48.943 Entry Flags: 00:17:48.943 Duplicate Returned Information: 0 00:17:48.943 Explicit Persistent Connection Support for Discovery: 0 00:17:48.943 Transport Requirements: 00:17:48.943 Secure Channel: Not Required 00:17:48.943 Port ID: 0 (0x0000) 00:17:48.943 Controller ID: 65535 (0xffff) 00:17:48.943 Admin Max SQ Size: 128 00:17:48.943 Transport Service Identifier: 4420 00:17:48.943 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:17:48.943 Transport Address: 10.0.0.2 [2024-04-27 03:29:13.777448] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:17:48.943 [2024-04-27 03:29:13.777473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:48.943 [2024-04-27 03:29:13.777486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:48.943 [2024-04-27 03:29:13.777495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:48.943 [2024-04-27 03:29:13.777505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:48.943 [2024-04-27 03:29:13.777518] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.943 [2024-04-27 03:29:13.777526] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.943 [2024-04-27 03:29:13.777532] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.943 [2024-04-27 03:29:13.777544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.943 [2024-04-27 03:29:13.777568] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.943 [2024-04-27 03:29:13.777692] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.943 [2024-04-27 03:29:13.777708] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.943 [2024-04-27 03:29:13.777715] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.943 [2024-04-27 03:29:13.777722] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.943 [2024-04-27 03:29:13.777735] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.943 [2024-04-27 03:29:13.777742] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.943 [2024-04-27 03:29:13.777749] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.943 [2024-04-27 03:29:13.777760] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.943 [2024-04-27 03:29:13.777786] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.943 [2024-04-27 03:29:13.777917] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.943 [2024-04-27 03:29:13.777929] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.943 [2024-04-27 03:29:13.777936] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.943 [2024-04-27 03:29:13.777943] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.943 [2024-04-27 03:29:13.777956] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:17:48.943 [2024-04-27 03:29:13.777965] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:17:48.943 [2024-04-27 03:29:13.777981] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.943 [2024-04-27 03:29:13.777990] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.943 [2024-04-27 03:29:13.777996] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.943 [2024-04-27 03:29:13.778007] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.778027] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.778142] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.778158] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.778165] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778172] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.778190] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778199] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778206] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.778217] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.778237] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.778346] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.778362] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.778369] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778375] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.778393] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778403] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778409] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.778420] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.778441] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.778538] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.778553] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.778560] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778567] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.778584] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778593] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778600] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.778611] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.778631] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.778728] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.778744] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.778754] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778762] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.778780] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778789] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778795] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.778806] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.778826] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.778924] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.778939] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.778946] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778953] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.778971] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778980] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.778986] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.778997] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.779017] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.779112] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.779127] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.779134] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779141] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.779158] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779167] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779174] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.779185] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.779205] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.779307] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.779321] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.779328] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779335] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.779352] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779361] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779367] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.779378] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.779398] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.779496] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.779511] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.779518] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779529] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.779547] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779556] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779563] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.779573] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.779594] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.779691] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.779706] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.779713] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779720] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.779737] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779746] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779753] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.779763] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.779784] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.779885] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.779900] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.779906] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779913] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.779931] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779940] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.779946] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.779957] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.779977] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.780067] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.780078] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.780085] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.780092] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.780109] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.780118] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.780124] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.944 [2024-04-27 03:29:13.780135] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.944 [2024-04-27 03:29:13.780155] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.944 [2024-04-27 03:29:13.780243] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.944 [2024-04-27 03:29:13.780264] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.944 [2024-04-27 03:29:13.780271] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.780278] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.944 [2024-04-27 03:29:13.780299] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.780309] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.944 [2024-04-27 03:29:13.780316] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.945 [2024-04-27 03:29:13.780326] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.945 [2024-04-27 03:29:13.780347] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.945 [2024-04-27 03:29:13.780441] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.945 [2024-04-27 03:29:13.780453] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.945 [2024-04-27 03:29:13.780459] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.780466] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.945 [2024-04-27 03:29:13.780483] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.780492] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.780498] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.945 [2024-04-27 03:29:13.780509] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.945 [2024-04-27 03:29:13.780529] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.945 [2024-04-27 03:29:13.780630] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.945 [2024-04-27 03:29:13.780646] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.945 [2024-04-27 03:29:13.780652] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.780659] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.945 [2024-04-27 03:29:13.780677] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.780686] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.780692] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.945 [2024-04-27 03:29:13.780703] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.945 [2024-04-27 03:29:13.780723] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.945 [2024-04-27 03:29:13.780820] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.945 [2024-04-27 03:29:13.780835] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.945 [2024-04-27 03:29:13.780842] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.780849] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.945 [2024-04-27 03:29:13.780867] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.780876] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.780882] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.945 [2024-04-27 03:29:13.780893] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.945 [2024-04-27 03:29:13.780913] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.945 [2024-04-27 03:29:13.781005] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.945 [2024-04-27 03:29:13.781016] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.945 [2024-04-27 03:29:13.781023] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.781030] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.945 [2024-04-27 03:29:13.781051] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.781061] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.781067] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.945 [2024-04-27 03:29:13.781078] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.945 [2024-04-27 03:29:13.781108] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.945 [2024-04-27 03:29:13.781204] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.945 [2024-04-27 03:29:13.781215] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.945 [2024-04-27 03:29:13.781222] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.781229] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.945 [2024-04-27 03:29:13.785253] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.785268] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.785274] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f49d60) 00:17:48.945 [2024-04-27 03:29:13.785285] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.945 [2024-04-27 03:29:13.785307] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fa9340, cid 3, qid 0 00:17:48.945 [2024-04-27 03:29:13.785440] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.945 [2024-04-27 03:29:13.785453] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.945 [2024-04-27 03:29:13.785459] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.785466] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fa9340) on tqpair=0x1f49d60 00:17:48.945 [2024-04-27 03:29:13.785480] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:17:48.945 00:17:48.945 03:29:13 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:17:48.945 [2024-04-27 03:29:13.814781] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:48.945 [2024-04-27 03:29:13.814828] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1486604 ] 00:17:48.945 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.945 [2024-04-27 03:29:13.847121] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:17:48.945 [2024-04-27 03:29:13.847166] nvme_tcp.c:2326:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:17:48.945 [2024-04-27 03:29:13.847176] nvme_tcp.c:2330:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:17:48.945 [2024-04-27 03:29:13.847188] nvme_tcp.c:2348:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:17:48.945 [2024-04-27 03:29:13.847199] sock.c: 336:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:17:48.945 [2024-04-27 03:29:13.847456] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:17:48.945 [2024-04-27 03:29:13.847495] nvme_tcp.c:1543:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1424d60 0 00:17:48.945 [2024-04-27 03:29:13.858274] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:17:48.945 [2024-04-27 03:29:13.858292] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:17:48.945 [2024-04-27 03:29:13.858303] nvme_tcp.c:1589:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:17:48.945 [2024-04-27 03:29:13.858310] nvme_tcp.c:1590:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:17:48.945 [2024-04-27 03:29:13.858347] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.858358] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.858364] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1424d60) 00:17:48.945 [2024-04-27 03:29:13.858377] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:17:48.945 [2024-04-27 03:29:13.858402] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483f20, cid 0, qid 0 00:17:48.945 [2024-04-27 03:29:13.866263] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.945 [2024-04-27 03:29:13.866280] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.945 [2024-04-27 03:29:13.866287] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.866294] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483f20) on tqpair=0x1424d60 00:17:48.945 [2024-04-27 03:29:13.866312] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:17:48.945 [2024-04-27 03:29:13.866323] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:17:48.945 [2024-04-27 03:29:13.866332] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:17:48.945 [2024-04-27 03:29:13.866349] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.866357] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.866364] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1424d60) 00:17:48.945 [2024-04-27 03:29:13.866375] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.945 [2024-04-27 03:29:13.866397] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483f20, cid 0, qid 0 00:17:48.945 [2024-04-27 03:29:13.866551] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.945 [2024-04-27 03:29:13.866563] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.945 [2024-04-27 03:29:13.866570] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.866577] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483f20) on tqpair=0x1424d60 00:17:48.945 [2024-04-27 03:29:13.866586] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:17:48.945 [2024-04-27 03:29:13.866599] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:17:48.945 [2024-04-27 03:29:13.866611] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.866618] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.866624] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1424d60) 00:17:48.945 [2024-04-27 03:29:13.866635] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.945 [2024-04-27 03:29:13.866655] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483f20, cid 0, qid 0 00:17:48.945 [2024-04-27 03:29:13.866770] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.945 [2024-04-27 03:29:13.866785] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.945 [2024-04-27 03:29:13.866791] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.945 [2024-04-27 03:29:13.866798] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483f20) on tqpair=0x1424d60 00:17:48.945 [2024-04-27 03:29:13.866808] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:17:48.945 [2024-04-27 03:29:13.866826] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:17:48.946 [2024-04-27 03:29:13.866839] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.866846] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.866852] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1424d60) 00:17:48.946 [2024-04-27 03:29:13.866863] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.946 [2024-04-27 03:29:13.866884] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483f20, cid 0, qid 0 00:17:48.946 [2024-04-27 03:29:13.867000] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.946 [2024-04-27 03:29:13.867015] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.946 [2024-04-27 03:29:13.867021] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867028] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483f20) on tqpair=0x1424d60 00:17:48.946 [2024-04-27 03:29:13.867038] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:17:48.946 [2024-04-27 03:29:13.867054] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867063] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867069] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1424d60) 00:17:48.946 [2024-04-27 03:29:13.867080] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.946 [2024-04-27 03:29:13.867101] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483f20, cid 0, qid 0 00:17:48.946 [2024-04-27 03:29:13.867204] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.946 [2024-04-27 03:29:13.867219] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.946 [2024-04-27 03:29:13.867226] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867232] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483f20) on tqpair=0x1424d60 00:17:48.946 [2024-04-27 03:29:13.867241] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:17:48.946 [2024-04-27 03:29:13.867259] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:17:48.946 [2024-04-27 03:29:13.867273] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:17:48.946 [2024-04-27 03:29:13.867383] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:17:48.946 [2024-04-27 03:29:13.867390] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:17:48.946 [2024-04-27 03:29:13.867401] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867409] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867415] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1424d60) 00:17:48.946 [2024-04-27 03:29:13.867426] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.946 [2024-04-27 03:29:13.867461] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483f20, cid 0, qid 0 00:17:48.946 [2024-04-27 03:29:13.867635] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.946 [2024-04-27 03:29:13.867651] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.946 [2024-04-27 03:29:13.867657] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867664] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483f20) on tqpair=0x1424d60 00:17:48.946 [2024-04-27 03:29:13.867678] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:17:48.946 [2024-04-27 03:29:13.867695] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867703] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867710] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1424d60) 00:17:48.946 [2024-04-27 03:29:13.867721] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.946 [2024-04-27 03:29:13.867741] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483f20, cid 0, qid 0 00:17:48.946 [2024-04-27 03:29:13.867854] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.946 [2024-04-27 03:29:13.867869] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.946 [2024-04-27 03:29:13.867875] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867882] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483f20) on tqpair=0x1424d60 00:17:48.946 [2024-04-27 03:29:13.867891] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:17:48.946 [2024-04-27 03:29:13.867899] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:17:48.946 [2024-04-27 03:29:13.867913] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:17:48.946 [2024-04-27 03:29:13.867926] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:17:48.946 [2024-04-27 03:29:13.867942] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.867950] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1424d60) 00:17:48.946 [2024-04-27 03:29:13.867961] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.946 [2024-04-27 03:29:13.867982] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483f20, cid 0, qid 0 00:17:48.946 [2024-04-27 03:29:13.868127] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:48.946 [2024-04-27 03:29:13.868142] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:48.946 [2024-04-27 03:29:13.868149] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.868156] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1424d60): datao=0, datal=4096, cccid=0 00:17:48.946 [2024-04-27 03:29:13.868163] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1483f20) on tqpair(0x1424d60): expected_datao=0, payload_size=4096 00:17:48.946 [2024-04-27 03:29:13.868171] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.868193] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.868202] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913276] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.946 [2024-04-27 03:29:13.913297] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.946 [2024-04-27 03:29:13.913304] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913311] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483f20) on tqpair=0x1424d60 00:17:48.946 [2024-04-27 03:29:13.913325] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:17:48.946 [2024-04-27 03:29:13.913333] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:17:48.946 [2024-04-27 03:29:13.913341] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:17:48.946 [2024-04-27 03:29:13.913352] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:17:48.946 [2024-04-27 03:29:13.913360] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:17:48.946 [2024-04-27 03:29:13.913368] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:17:48.946 [2024-04-27 03:29:13.913383] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:17:48.946 [2024-04-27 03:29:13.913395] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913403] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913409] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1424d60) 00:17:48.946 [2024-04-27 03:29:13.913421] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:48.946 [2024-04-27 03:29:13.913445] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483f20, cid 0, qid 0 00:17:48.946 [2024-04-27 03:29:13.913595] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.946 [2024-04-27 03:29:13.913607] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.946 [2024-04-27 03:29:13.913614] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913621] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483f20) on tqpair=0x1424d60 00:17:48.946 [2024-04-27 03:29:13.913633] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913640] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913646] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1424d60) 00:17:48.946 [2024-04-27 03:29:13.913656] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.946 [2024-04-27 03:29:13.913667] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913673] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913680] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1424d60) 00:17:48.946 [2024-04-27 03:29:13.913688] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.946 [2024-04-27 03:29:13.913698] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913704] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.946 [2024-04-27 03:29:13.913711] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1424d60) 00:17:48.946 [2024-04-27 03:29:13.913719] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.947 [2024-04-27 03:29:13.913729] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.913735] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.913742] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:48.947 [2024-04-27 03:29:13.913750] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.947 [2024-04-27 03:29:13.913772] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.913792] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.913804] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.913811] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1424d60) 00:17:48.947 [2024-04-27 03:29:13.913825] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.947 [2024-04-27 03:29:13.913847] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483f20, cid 0, qid 0 00:17:48.947 [2024-04-27 03:29:13.913877] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484080, cid 1, qid 0 00:17:48.947 [2024-04-27 03:29:13.913892] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14841e0, cid 2, qid 0 00:17:48.947 [2024-04-27 03:29:13.913900] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:48.947 [2024-04-27 03:29:13.913908] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14844a0, cid 4, qid 0 00:17:48.947 [2024-04-27 03:29:13.914120] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.947 [2024-04-27 03:29:13.914142] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.947 [2024-04-27 03:29:13.914153] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914160] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14844a0) on tqpair=0x1424d60 00:17:48.947 [2024-04-27 03:29:13.914169] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:17:48.947 [2024-04-27 03:29:13.914178] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.914197] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.914209] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.914220] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914227] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914234] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1424d60) 00:17:48.947 [2024-04-27 03:29:13.914245] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:48.947 [2024-04-27 03:29:13.914280] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14844a0, cid 4, qid 0 00:17:48.947 [2024-04-27 03:29:13.914427] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.947 [2024-04-27 03:29:13.914443] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.947 [2024-04-27 03:29:13.914449] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914456] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14844a0) on tqpair=0x1424d60 00:17:48.947 [2024-04-27 03:29:13.914511] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.914529] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.914543] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914551] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1424d60) 00:17:48.947 [2024-04-27 03:29:13.914562] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.947 [2024-04-27 03:29:13.914583] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14844a0, cid 4, qid 0 00:17:48.947 [2024-04-27 03:29:13.914747] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:48.947 [2024-04-27 03:29:13.914763] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:48.947 [2024-04-27 03:29:13.914770] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914776] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1424d60): datao=0, datal=4096, cccid=4 00:17:48.947 [2024-04-27 03:29:13.914788] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14844a0) on tqpair(0x1424d60): expected_datao=0, payload_size=4096 00:17:48.947 [2024-04-27 03:29:13.914796] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914806] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914814] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914826] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.947 [2024-04-27 03:29:13.914835] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.947 [2024-04-27 03:29:13.914841] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914848] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14844a0) on tqpair=0x1424d60 00:17:48.947 [2024-04-27 03:29:13.914864] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:17:48.947 [2024-04-27 03:29:13.914885] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.914902] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.914915] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.914923] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1424d60) 00:17:48.947 [2024-04-27 03:29:13.914934] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.947 [2024-04-27 03:29:13.914955] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14844a0, cid 4, qid 0 00:17:48.947 [2024-04-27 03:29:13.915086] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:48.947 [2024-04-27 03:29:13.915102] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:48.947 [2024-04-27 03:29:13.915108] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915115] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1424d60): datao=0, datal=4096, cccid=4 00:17:48.947 [2024-04-27 03:29:13.915122] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14844a0) on tqpair(0x1424d60): expected_datao=0, payload_size=4096 00:17:48.947 [2024-04-27 03:29:13.915130] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915140] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915147] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915159] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.947 [2024-04-27 03:29:13.915168] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.947 [2024-04-27 03:29:13.915175] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915181] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14844a0) on tqpair=0x1424d60 00:17:48.947 [2024-04-27 03:29:13.915202] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.915220] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.915234] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915242] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1424d60) 00:17:48.947 [2024-04-27 03:29:13.915263] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.947 [2024-04-27 03:29:13.915285] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14844a0, cid 4, qid 0 00:17:48.947 [2024-04-27 03:29:13.915408] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:48.947 [2024-04-27 03:29:13.915424] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:48.947 [2024-04-27 03:29:13.915431] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915437] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1424d60): datao=0, datal=4096, cccid=4 00:17:48.947 [2024-04-27 03:29:13.915445] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14844a0) on tqpair(0x1424d60): expected_datao=0, payload_size=4096 00:17:48.947 [2024-04-27 03:29:13.915452] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915462] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915469] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915481] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.947 [2024-04-27 03:29:13.915498] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.947 [2024-04-27 03:29:13.915513] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.947 [2024-04-27 03:29:13.915520] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14844a0) on tqpair=0x1424d60 00:17:48.947 [2024-04-27 03:29:13.915534] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.915550] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.915565] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:17:48.947 [2024-04-27 03:29:13.915575] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:17:48.948 [2024-04-27 03:29:13.915583] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:17:48.948 [2024-04-27 03:29:13.915592] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:17:48.948 [2024-04-27 03:29:13.915599] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:17:48.948 [2024-04-27 03:29:13.915608] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:17:48.948 [2024-04-27 03:29:13.915627] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.948 [2024-04-27 03:29:13.915643] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1424d60) 00:17:48.948 [2024-04-27 03:29:13.915660] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:48.948 [2024-04-27 03:29:13.915673] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:48.948 [2024-04-27 03:29:13.915684] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.948 [2024-04-27 03:29:13.915690] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1424d60) 00:17:48.948 [2024-04-27 03:29:13.915700] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.948 [2024-04-27 03:29:13.915746] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14844a0, cid 4, qid 0 00:17:48.948 [2024-04-27 03:29:13.915759] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484600, cid 5, qid 0 00:17:48.948 [2024-04-27 03:29:13.915943] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.948 [2024-04-27 03:29:13.915955] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.948 [2024-04-27 03:29:13.915962] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.948 [2024-04-27 03:29:13.915969] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14844a0) on tqpair=0x1424d60 00:17:48.948 [2024-04-27 03:29:13.915984] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:48.948 [2024-04-27 03:29:13.915994] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:48.948 [2024-04-27 03:29:13.916000] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:48.948 [2024-04-27 03:29:13.916007] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484600) on tqpair=0x1424d60 00:17:48.948 [2024-04-27 03:29:13.916023] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:48.948 [2024-04-27 03:29:13.916032] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1424d60) 00:17:48.948 [2024-04-27 03:29:13.916043] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.256 [2024-04-27 03:29:13.916063] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484600, cid 5, qid 0 00:17:49.256 [2024-04-27 03:29:13.916205] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.256 [2024-04-27 03:29:13.916224] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.256 [2024-04-27 03:29:13.916231] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.256 [2024-04-27 03:29:13.916238] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484600) on tqpair=0x1424d60 00:17:49.256 [2024-04-27 03:29:13.916263] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.256 [2024-04-27 03:29:13.916274] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1424d60) 00:17:49.256 [2024-04-27 03:29:13.916284] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.256 [2024-04-27 03:29:13.916305] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484600, cid 5, qid 0 00:17:49.256 [2024-04-27 03:29:13.916425] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.256 [2024-04-27 03:29:13.916441] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.256 [2024-04-27 03:29:13.916447] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.256 [2024-04-27 03:29:13.916454] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484600) on tqpair=0x1424d60 00:17:49.256 [2024-04-27 03:29:13.916471] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.256 [2024-04-27 03:29:13.916479] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1424d60) 00:17:49.256 [2024-04-27 03:29:13.916490] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.256 [2024-04-27 03:29:13.916510] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484600, cid 5, qid 0 00:17:49.256 [2024-04-27 03:29:13.916621] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.256 [2024-04-27 03:29:13.916633] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.256 [2024-04-27 03:29:13.916639] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.256 [2024-04-27 03:29:13.916646] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484600) on tqpair=0x1424d60 00:17:49.256 [2024-04-27 03:29:13.916666] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.256 [2024-04-27 03:29:13.916675] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1424d60) 00:17:49.256 [2024-04-27 03:29:13.916686] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.256 [2024-04-27 03:29:13.916698] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.256 [2024-04-27 03:29:13.916706] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1424d60) 00:17:49.256 [2024-04-27 03:29:13.916715] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.256 [2024-04-27 03:29:13.916730] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.256 [2024-04-27 03:29:13.916739] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1424d60) 00:17:49.257 [2024-04-27 03:29:13.916748] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.257 [2024-04-27 03:29:13.916760] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.916767] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1424d60) 00:17:49.257 [2024-04-27 03:29:13.916776] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.257 [2024-04-27 03:29:13.916797] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484600, cid 5, qid 0 00:17:49.257 [2024-04-27 03:29:13.916808] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14844a0, cid 4, qid 0 00:17:49.257 [2024-04-27 03:29:13.916816] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484760, cid 6, qid 0 00:17:49.257 [2024-04-27 03:29:13.916824] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14848c0, cid 7, qid 0 00:17:49.257 [2024-04-27 03:29:13.917055] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:49.257 [2024-04-27 03:29:13.917067] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:49.257 [2024-04-27 03:29:13.917074] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.917080] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1424d60): datao=0, datal=8192, cccid=5 00:17:49.257 [2024-04-27 03:29:13.917088] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1484600) on tqpair(0x1424d60): expected_datao=0, payload_size=8192 00:17:49.257 [2024-04-27 03:29:13.917095] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.917136] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.917146] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.917155] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:49.257 [2024-04-27 03:29:13.917163] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:49.257 [2024-04-27 03:29:13.917170] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.917176] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1424d60): datao=0, datal=512, cccid=4 00:17:49.257 [2024-04-27 03:29:13.917184] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14844a0) on tqpair(0x1424d60): expected_datao=0, payload_size=512 00:17:49.257 [2024-04-27 03:29:13.917191] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.917200] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.917207] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.917215] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:49.257 [2024-04-27 03:29:13.917224] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:49.257 [2024-04-27 03:29:13.917230] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.917236] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1424d60): datao=0, datal=512, cccid=6 00:17:49.257 [2024-04-27 03:29:13.917244] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1484760) on tqpair(0x1424d60): expected_datao=0, payload_size=512 00:17:49.257 [2024-04-27 03:29:13.921271] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921284] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921291] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921300] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:49.257 [2024-04-27 03:29:13.921309] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:49.257 [2024-04-27 03:29:13.921319] nvme_tcp.c:1707:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921326] nvme_tcp.c:1708:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1424d60): datao=0, datal=4096, cccid=7 00:17:49.257 [2024-04-27 03:29:13.921334] nvme_tcp.c:1719:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14848c0) on tqpair(0x1424d60): expected_datao=0, payload_size=4096 00:17:49.257 [2024-04-27 03:29:13.921341] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921351] nvme_tcp.c:1509:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921358] nvme_tcp.c:1293:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921370] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.257 [2024-04-27 03:29:13.921380] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.257 [2024-04-27 03:29:13.921386] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921393] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484600) on tqpair=0x1424d60 00:17:49.257 [2024-04-27 03:29:13.921414] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.257 [2024-04-27 03:29:13.921425] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.257 [2024-04-27 03:29:13.921432] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921438] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14844a0) on tqpair=0x1424d60 00:17:49.257 [2024-04-27 03:29:13.921453] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.257 [2024-04-27 03:29:13.921464] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.257 [2024-04-27 03:29:13.921470] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921477] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484760) on tqpair=0x1424d60 00:17:49.257 [2024-04-27 03:29:13.921489] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.257 [2024-04-27 03:29:13.921498] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.257 [2024-04-27 03:29:13.921505] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.257 [2024-04-27 03:29:13.921511] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14848c0) on tqpair=0x1424d60 00:17:49.257 ===================================================== 00:17:49.257 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:49.257 ===================================================== 00:17:49.257 Controller Capabilities/Features 00:17:49.257 ================================ 00:17:49.257 Vendor ID: 8086 00:17:49.257 Subsystem Vendor ID: 8086 00:17:49.257 Serial Number: SPDK00000000000001 00:17:49.257 Model Number: SPDK bdev Controller 00:17:49.257 Firmware Version: 24.05 00:17:49.257 Recommended Arb Burst: 6 00:17:49.257 IEEE OUI Identifier: e4 d2 5c 00:17:49.257 Multi-path I/O 00:17:49.257 May have multiple subsystem ports: Yes 00:17:49.257 May have multiple controllers: Yes 00:17:49.257 Associated with SR-IOV VF: No 00:17:49.257 Max Data Transfer Size: 131072 00:17:49.257 Max Number of Namespaces: 32 00:17:49.257 Max Number of I/O Queues: 127 00:17:49.257 NVMe Specification Version (VS): 1.3 00:17:49.257 NVMe Specification Version (Identify): 1.3 00:17:49.257 Maximum Queue Entries: 128 00:17:49.257 Contiguous Queues Required: Yes 00:17:49.257 Arbitration Mechanisms Supported 00:17:49.257 Weighted Round Robin: Not Supported 00:17:49.257 Vendor Specific: Not Supported 00:17:49.257 Reset Timeout: 15000 ms 00:17:49.257 Doorbell Stride: 4 bytes 00:17:49.257 NVM Subsystem Reset: Not Supported 00:17:49.257 Command Sets Supported 00:17:49.257 NVM Command Set: Supported 00:17:49.257 Boot Partition: Not Supported 00:17:49.257 Memory Page Size Minimum: 4096 bytes 00:17:49.257 Memory Page Size Maximum: 4096 bytes 00:17:49.257 Persistent Memory Region: Not Supported 00:17:49.257 Optional Asynchronous Events Supported 00:17:49.257 Namespace Attribute Notices: Supported 00:17:49.258 Firmware Activation Notices: Not Supported 00:17:49.258 ANA Change Notices: Not Supported 00:17:49.258 PLE Aggregate Log Change Notices: Not Supported 00:17:49.258 LBA Status Info Alert Notices: Not Supported 00:17:49.258 EGE Aggregate Log Change Notices: Not Supported 00:17:49.258 Normal NVM Subsystem Shutdown event: Not Supported 00:17:49.258 Zone Descriptor Change Notices: Not Supported 00:17:49.258 Discovery Log Change Notices: Not Supported 00:17:49.258 Controller Attributes 00:17:49.258 128-bit Host Identifier: Supported 00:17:49.258 Non-Operational Permissive Mode: Not Supported 00:17:49.258 NVM Sets: Not Supported 00:17:49.258 Read Recovery Levels: Not Supported 00:17:49.258 Endurance Groups: Not Supported 00:17:49.258 Predictable Latency Mode: Not Supported 00:17:49.258 Traffic Based Keep ALive: Not Supported 00:17:49.258 Namespace Granularity: Not Supported 00:17:49.258 SQ Associations: Not Supported 00:17:49.258 UUID List: Not Supported 00:17:49.258 Multi-Domain Subsystem: Not Supported 00:17:49.258 Fixed Capacity Management: Not Supported 00:17:49.258 Variable Capacity Management: Not Supported 00:17:49.258 Delete Endurance Group: Not Supported 00:17:49.258 Delete NVM Set: Not Supported 00:17:49.258 Extended LBA Formats Supported: Not Supported 00:17:49.258 Flexible Data Placement Supported: Not Supported 00:17:49.258 00:17:49.258 Controller Memory Buffer Support 00:17:49.258 ================================ 00:17:49.258 Supported: No 00:17:49.258 00:17:49.258 Persistent Memory Region Support 00:17:49.258 ================================ 00:17:49.258 Supported: No 00:17:49.258 00:17:49.258 Admin Command Set Attributes 00:17:49.258 ============================ 00:17:49.258 Security Send/Receive: Not Supported 00:17:49.258 Format NVM: Not Supported 00:17:49.258 Firmware Activate/Download: Not Supported 00:17:49.258 Namespace Management: Not Supported 00:17:49.258 Device Self-Test: Not Supported 00:17:49.258 Directives: Not Supported 00:17:49.258 NVMe-MI: Not Supported 00:17:49.258 Virtualization Management: Not Supported 00:17:49.258 Doorbell Buffer Config: Not Supported 00:17:49.258 Get LBA Status Capability: Not Supported 00:17:49.258 Command & Feature Lockdown Capability: Not Supported 00:17:49.258 Abort Command Limit: 4 00:17:49.258 Async Event Request Limit: 4 00:17:49.258 Number of Firmware Slots: N/A 00:17:49.258 Firmware Slot 1 Read-Only: N/A 00:17:49.258 Firmware Activation Without Reset: N/A 00:17:49.258 Multiple Update Detection Support: N/A 00:17:49.258 Firmware Update Granularity: No Information Provided 00:17:49.258 Per-Namespace SMART Log: No 00:17:49.258 Asymmetric Namespace Access Log Page: Not Supported 00:17:49.258 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:17:49.258 Command Effects Log Page: Supported 00:17:49.258 Get Log Page Extended Data: Supported 00:17:49.258 Telemetry Log Pages: Not Supported 00:17:49.258 Persistent Event Log Pages: Not Supported 00:17:49.258 Supported Log Pages Log Page: May Support 00:17:49.258 Commands Supported & Effects Log Page: Not Supported 00:17:49.258 Feature Identifiers & Effects Log Page:May Support 00:17:49.258 NVMe-MI Commands & Effects Log Page: May Support 00:17:49.258 Data Area 4 for Telemetry Log: Not Supported 00:17:49.258 Error Log Page Entries Supported: 128 00:17:49.258 Keep Alive: Supported 00:17:49.258 Keep Alive Granularity: 10000 ms 00:17:49.258 00:17:49.258 NVM Command Set Attributes 00:17:49.258 ========================== 00:17:49.258 Submission Queue Entry Size 00:17:49.258 Max: 64 00:17:49.258 Min: 64 00:17:49.258 Completion Queue Entry Size 00:17:49.258 Max: 16 00:17:49.258 Min: 16 00:17:49.258 Number of Namespaces: 32 00:17:49.258 Compare Command: Supported 00:17:49.258 Write Uncorrectable Command: Not Supported 00:17:49.258 Dataset Management Command: Supported 00:17:49.258 Write Zeroes Command: Supported 00:17:49.258 Set Features Save Field: Not Supported 00:17:49.258 Reservations: Supported 00:17:49.258 Timestamp: Not Supported 00:17:49.258 Copy: Supported 00:17:49.258 Volatile Write Cache: Present 00:17:49.258 Atomic Write Unit (Normal): 1 00:17:49.258 Atomic Write Unit (PFail): 1 00:17:49.258 Atomic Compare & Write Unit: 1 00:17:49.258 Fused Compare & Write: Supported 00:17:49.258 Scatter-Gather List 00:17:49.258 SGL Command Set: Supported 00:17:49.258 SGL Keyed: Supported 00:17:49.258 SGL Bit Bucket Descriptor: Not Supported 00:17:49.258 SGL Metadata Pointer: Not Supported 00:17:49.258 Oversized SGL: Not Supported 00:17:49.258 SGL Metadata Address: Not Supported 00:17:49.258 SGL Offset: Supported 00:17:49.258 Transport SGL Data Block: Not Supported 00:17:49.258 Replay Protected Memory Block: Not Supported 00:17:49.258 00:17:49.258 Firmware Slot Information 00:17:49.258 ========================= 00:17:49.258 Active slot: 1 00:17:49.258 Slot 1 Firmware Revision: 24.05 00:17:49.258 00:17:49.258 00:17:49.258 Commands Supported and Effects 00:17:49.258 ============================== 00:17:49.258 Admin Commands 00:17:49.258 -------------- 00:17:49.258 Get Log Page (02h): Supported 00:17:49.258 Identify (06h): Supported 00:17:49.258 Abort (08h): Supported 00:17:49.258 Set Features (09h): Supported 00:17:49.258 Get Features (0Ah): Supported 00:17:49.258 Asynchronous Event Request (0Ch): Supported 00:17:49.258 Keep Alive (18h): Supported 00:17:49.258 I/O Commands 00:17:49.258 ------------ 00:17:49.258 Flush (00h): Supported LBA-Change 00:17:49.258 Write (01h): Supported LBA-Change 00:17:49.258 Read (02h): Supported 00:17:49.258 Compare (05h): Supported 00:17:49.258 Write Zeroes (08h): Supported LBA-Change 00:17:49.258 Dataset Management (09h): Supported LBA-Change 00:17:49.258 Copy (19h): Supported LBA-Change 00:17:49.258 Unknown (79h): Supported LBA-Change 00:17:49.258 Unknown (7Ah): Supported 00:17:49.258 00:17:49.258 Error Log 00:17:49.258 ========= 00:17:49.258 00:17:49.258 Arbitration 00:17:49.258 =========== 00:17:49.258 Arbitration Burst: 1 00:17:49.258 00:17:49.258 Power Management 00:17:49.258 ================ 00:17:49.258 Number of Power States: 1 00:17:49.258 Current Power State: Power State #0 00:17:49.258 Power State #0: 00:17:49.258 Max Power: 0.00 W 00:17:49.258 Non-Operational State: Operational 00:17:49.258 Entry Latency: Not Reported 00:17:49.258 Exit Latency: Not Reported 00:17:49.258 Relative Read Throughput: 0 00:17:49.258 Relative Read Latency: 0 00:17:49.258 Relative Write Throughput: 0 00:17:49.258 Relative Write Latency: 0 00:17:49.258 Idle Power: Not Reported 00:17:49.258 Active Power: Not Reported 00:17:49.258 Non-Operational Permissive Mode: Not Supported 00:17:49.258 00:17:49.258 Health Information 00:17:49.258 ================== 00:17:49.258 Critical Warnings: 00:17:49.258 Available Spare Space: OK 00:17:49.258 Temperature: OK 00:17:49.258 Device Reliability: OK 00:17:49.258 Read Only: No 00:17:49.258 Volatile Memory Backup: OK 00:17:49.258 Current Temperature: 0 Kelvin (-273 Celsius) 00:17:49.258 Temperature Threshold: [2024-04-27 03:29:13.921673] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.258 [2024-04-27 03:29:13.921686] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1424d60) 00:17:49.258 [2024-04-27 03:29:13.921696] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.258 [2024-04-27 03:29:13.921719] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14848c0, cid 7, qid 0 00:17:49.258 [2024-04-27 03:29:13.921880] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.258 [2024-04-27 03:29:13.921896] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.258 [2024-04-27 03:29:13.921903] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.258 [2024-04-27 03:29:13.921910] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14848c0) on tqpair=0x1424d60 00:17:49.258 [2024-04-27 03:29:13.921952] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:17:49.258 [2024-04-27 03:29:13.921973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.258 [2024-04-27 03:29:13.921984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.258 [2024-04-27 03:29:13.921994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.259 [2024-04-27 03:29:13.922003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:49.259 [2024-04-27 03:29:13.922016] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922027] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922035] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.922045] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.922067] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.922196] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.922211] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.922218] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922225] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.922240] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922267] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922275] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.922286] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.922313] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.922445] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.922460] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.922467] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922473] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.922482] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:17:49.259 [2024-04-27 03:29:13.922490] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:17:49.259 [2024-04-27 03:29:13.922506] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922515] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922522] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.922532] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.922562] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.922670] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.922685] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.922692] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922699] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.922716] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922725] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922732] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.922742] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.922762] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.922875] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.922891] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.922897] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922904] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.922925] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922935] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.922942] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.922952] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.922972] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.923072] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.923087] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.923094] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923101] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.923118] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923127] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923134] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.923144] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.923164] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.923285] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.923299] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.923306] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923312] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.923329] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923338] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923345] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.923355] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.923375] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.923488] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.923504] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.923511] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923518] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.923541] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923550] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923556] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.923567] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.923588] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.923698] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.923713] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.923719] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923726] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.923747] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923757] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923763] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.923774] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.923794] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.923896] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.923911] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.923918] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923925] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.923942] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923951] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.923958] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.923968] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.923988] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.924087] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.924102] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.924109] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.924116] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.924133] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.924142] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.924148] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.924158] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.259 [2024-04-27 03:29:13.924179] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.259 [2024-04-27 03:29:13.924289] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.259 [2024-04-27 03:29:13.924303] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.259 [2024-04-27 03:29:13.924310] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.924316] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.259 [2024-04-27 03:29:13.924333] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.924342] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.259 [2024-04-27 03:29:13.924349] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.259 [2024-04-27 03:29:13.924359] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.260 [2024-04-27 03:29:13.924379] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.260 [2024-04-27 03:29:13.924492] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.260 [2024-04-27 03:29:13.924512] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.260 [2024-04-27 03:29:13.924520] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.260 [2024-04-27 03:29:13.924527] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.260 [2024-04-27 03:29:13.924545] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.260 [2024-04-27 03:29:13.924558] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.260 [2024-04-27 03:29:13.924565] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.260 [2024-04-27 03:29:13.924576] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.260 [2024-04-27 03:29:13.924597] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.260 [2024-04-27 03:29:13.924703] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.260 [2024-04-27 03:29:13.924714] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.260 [2024-04-27 03:29:13.924721] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.260 [2024-04-27 03:29:13.924728] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.260 [2024-04-27 03:29:13.924744] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.260 [2024-04-27 03:29:13.924753] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.260 [2024-04-27 03:29:13.924760] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.260 [2024-04-27 03:29:13.924770] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.260 [2024-04-27 03:29:13.924790] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.260 [2024-04-27 03:29:13.928264] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.260 [2024-04-27 03:29:13.928282] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.260 [2024-04-27 03:29:13.928290] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.260 [2024-04-27 03:29:13.928296] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.260 [2024-04-27 03:29:13.928316] nvme_tcp.c: 766:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:49.260 [2024-04-27 03:29:13.928325] nvme_tcp.c: 949:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:49.260 [2024-04-27 03:29:13.928332] nvme_tcp.c: 958:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1424d60) 00:17:49.260 [2024-04-27 03:29:13.928342] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:49.260 [2024-04-27 03:29:13.928364] nvme_tcp.c: 923:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484340, cid 3, qid 0 00:17:49.260 [2024-04-27 03:29:13.928501] nvme_tcp.c:1161:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:49.260 [2024-04-27 03:29:13.928516] nvme_tcp.c:1963:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:49.260 [2024-04-27 03:29:13.928523] nvme_tcp.c:1636:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:49.260 [2024-04-27 03:29:13.928530] nvme_tcp.c: 908:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484340) on tqpair=0x1424d60 00:17:49.260 [2024-04-27 03:29:13.928544] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:17:49.260 0 Kelvin (-273 Celsius) 00:17:49.260 Available Spare: 0% 00:17:49.260 Available Spare Threshold: 0% 00:17:49.260 Life Percentage Used: 0% 00:17:49.260 Data Units Read: 0 00:17:49.260 Data Units Written: 0 00:17:49.260 Host Read Commands: 0 00:17:49.260 Host Write Commands: 0 00:17:49.260 Controller Busy Time: 0 minutes 00:17:49.260 Power Cycles: 0 00:17:49.260 Power On Hours: 0 hours 00:17:49.260 Unsafe Shutdowns: 0 00:17:49.260 Unrecoverable Media Errors: 0 00:17:49.260 Lifetime Error Log Entries: 0 00:17:49.260 Warning Temperature Time: 0 minutes 00:17:49.260 Critical Temperature Time: 0 minutes 00:17:49.260 00:17:49.260 Number of Queues 00:17:49.260 ================ 00:17:49.260 Number of I/O Submission Queues: 127 00:17:49.260 Number of I/O Completion Queues: 127 00:17:49.260 00:17:49.260 Active Namespaces 00:17:49.260 ================= 00:17:49.260 Namespace ID:1 00:17:49.260 Error Recovery Timeout: Unlimited 00:17:49.260 Command Set Identifier: NVM (00h) 00:17:49.260 Deallocate: Supported 00:17:49.260 Deallocated/Unwritten Error: Not Supported 00:17:49.260 Deallocated Read Value: Unknown 00:17:49.260 Deallocate in Write Zeroes: Not Supported 00:17:49.260 Deallocated Guard Field: 0xFFFF 00:17:49.260 Flush: Supported 00:17:49.260 Reservation: Supported 00:17:49.260 Namespace Sharing Capabilities: Multiple Controllers 00:17:49.260 Size (in LBAs): 131072 (0GiB) 00:17:49.260 Capacity (in LBAs): 131072 (0GiB) 00:17:49.260 Utilization (in LBAs): 131072 (0GiB) 00:17:49.260 NGUID: ABCDEF0123456789ABCDEF0123456789 00:17:49.260 EUI64: ABCDEF0123456789 00:17:49.260 UUID: 81568190-a6ef-4e75-8ac5-71c1112d000d 00:17:49.260 Thin Provisioning: Not Supported 00:17:49.260 Per-NS Atomic Units: Yes 00:17:49.260 Atomic Boundary Size (Normal): 0 00:17:49.260 Atomic Boundary Size (PFail): 0 00:17:49.260 Atomic Boundary Offset: 0 00:17:49.260 Maximum Single Source Range Length: 65535 00:17:49.260 Maximum Copy Length: 65535 00:17:49.260 Maximum Source Range Count: 1 00:17:49.260 NGUID/EUI64 Never Reused: No 00:17:49.260 Namespace Write Protected: No 00:17:49.260 Number of LBA Formats: 1 00:17:49.260 Current LBA Format: LBA Format #00 00:17:49.260 LBA Format #00: Data Size: 512 Metadata Size: 0 00:17:49.260 00:17:49.260 03:29:13 -- host/identify.sh@51 -- # sync 00:17:49.260 03:29:13 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:49.260 03:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:49.260 03:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:49.260 03:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:49.260 03:29:13 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:17:49.260 03:29:13 -- host/identify.sh@56 -- # nvmftestfini 00:17:49.260 03:29:13 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:49.260 03:29:13 -- nvmf/common.sh@117 -- # sync 00:17:49.260 03:29:13 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:17:49.260 03:29:13 -- nvmf/common.sh@120 -- # set +e 00:17:49.260 03:29:13 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:49.260 03:29:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:17:49.260 rmmod nvme_tcp 00:17:49.260 rmmod nvme_fabrics 00:17:49.260 rmmod nvme_keyring 00:17:49.260 03:29:13 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:49.260 03:29:14 -- nvmf/common.sh@124 -- # set -e 00:17:49.260 03:29:14 -- nvmf/common.sh@125 -- # return 0 00:17:49.260 03:29:14 -- nvmf/common.sh@478 -- # '[' -n 1486325 ']' 00:17:49.260 03:29:14 -- nvmf/common.sh@479 -- # killprocess 1486325 00:17:49.260 03:29:14 -- common/autotest_common.sh@936 -- # '[' -z 1486325 ']' 00:17:49.260 03:29:14 -- common/autotest_common.sh@940 -- # kill -0 1486325 00:17:49.260 03:29:14 -- common/autotest_common.sh@941 -- # uname 00:17:49.260 03:29:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:49.260 03:29:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1486325 00:17:49.260 03:29:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:49.260 03:29:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:49.260 03:29:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1486325' 00:17:49.260 killing process with pid 1486325 00:17:49.260 03:29:14 -- common/autotest_common.sh@955 -- # kill 1486325 00:17:49.260 [2024-04-27 03:29:14.028612] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:17:49.260 03:29:14 -- common/autotest_common.sh@960 -- # wait 1486325 00:17:49.520 03:29:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:49.520 03:29:14 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:17:49.520 03:29:14 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:17:49.520 03:29:14 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:49.520 03:29:14 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:17:49.520 03:29:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:49.520 03:29:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:49.520 03:29:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:51.420 03:29:16 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:17:51.420 00:17:51.420 real 0m6.097s 00:17:51.420 user 0m7.304s 00:17:51.420 sys 0m1.879s 00:17:51.420 03:29:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:51.420 03:29:16 -- common/autotest_common.sh@10 -- # set +x 00:17:51.420 ************************************ 00:17:51.420 END TEST nvmf_identify 00:17:51.420 ************************************ 00:17:51.678 03:29:16 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:17:51.678 03:29:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:51.678 03:29:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:51.678 03:29:16 -- common/autotest_common.sh@10 -- # set +x 00:17:51.678 ************************************ 00:17:51.678 START TEST nvmf_perf 00:17:51.678 ************************************ 00:17:51.678 03:29:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:17:51.678 * Looking for test storage... 00:17:51.678 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:17:51.678 03:29:16 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:51.678 03:29:16 -- nvmf/common.sh@7 -- # uname -s 00:17:51.678 03:29:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:51.678 03:29:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:51.678 03:29:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:51.678 03:29:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:51.678 03:29:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:51.678 03:29:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:51.678 03:29:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:51.678 03:29:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:51.678 03:29:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:51.678 03:29:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:51.678 03:29:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:17:51.678 03:29:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:17:51.678 03:29:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:51.678 03:29:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:51.678 03:29:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:51.678 03:29:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:51.678 03:29:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:51.678 03:29:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:51.678 03:29:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:51.678 03:29:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:51.678 03:29:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:51.678 03:29:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:51.678 03:29:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:51.678 03:29:16 -- paths/export.sh@5 -- # export PATH 00:17:51.678 03:29:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:51.678 03:29:16 -- nvmf/common.sh@47 -- # : 0 00:17:51.678 03:29:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:51.678 03:29:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:51.678 03:29:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:51.678 03:29:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:51.678 03:29:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:51.678 03:29:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:51.678 03:29:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:51.678 03:29:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:51.678 03:29:16 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:17:51.678 03:29:16 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:17:51.678 03:29:16 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:51.678 03:29:16 -- host/perf.sh@17 -- # nvmftestinit 00:17:51.678 03:29:16 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:17:51.678 03:29:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:51.678 03:29:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:51.678 03:29:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:51.678 03:29:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:51.678 03:29:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:51.678 03:29:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:51.678 03:29:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:51.678 03:29:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:51.678 03:29:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:51.678 03:29:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:51.678 03:29:16 -- common/autotest_common.sh@10 -- # set +x 00:17:53.578 03:29:18 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:53.578 03:29:18 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:53.578 03:29:18 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:53.578 03:29:18 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:53.578 03:29:18 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:53.578 03:29:18 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:53.578 03:29:18 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:53.579 03:29:18 -- nvmf/common.sh@295 -- # net_devs=() 00:17:53.579 03:29:18 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:53.579 03:29:18 -- nvmf/common.sh@296 -- # e810=() 00:17:53.579 03:29:18 -- nvmf/common.sh@296 -- # local -ga e810 00:17:53.579 03:29:18 -- nvmf/common.sh@297 -- # x722=() 00:17:53.579 03:29:18 -- nvmf/common.sh@297 -- # local -ga x722 00:17:53.579 03:29:18 -- nvmf/common.sh@298 -- # mlx=() 00:17:53.579 03:29:18 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:53.579 03:29:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:53.579 03:29:18 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:53.579 03:29:18 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:53.579 03:29:18 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:53.579 03:29:18 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:53.579 03:29:18 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:17:53.579 Found 0000:09:00.0 (0x8086 - 0x159b) 00:17:53.579 03:29:18 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:53.579 03:29:18 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:17:53.579 Found 0000:09:00.1 (0x8086 - 0x159b) 00:17:53.579 03:29:18 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:53.579 03:29:18 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:53.579 03:29:18 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:53.579 03:29:18 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:53.579 03:29:18 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:53.579 03:29:18 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:17:53.579 Found net devices under 0000:09:00.0: cvl_0_0 00:17:53.579 03:29:18 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:53.579 03:29:18 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:53.579 03:29:18 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:53.579 03:29:18 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:53.579 03:29:18 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:53.579 03:29:18 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:17:53.579 Found net devices under 0000:09:00.1: cvl_0_1 00:17:53.579 03:29:18 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:53.579 03:29:18 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:53.579 03:29:18 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:53.579 03:29:18 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:17:53.579 03:29:18 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:53.579 03:29:18 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:53.579 03:29:18 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:53.579 03:29:18 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:17:53.579 03:29:18 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:53.579 03:29:18 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:53.579 03:29:18 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:17:53.579 03:29:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:53.579 03:29:18 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:53.579 03:29:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:17:53.579 03:29:18 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:17:53.579 03:29:18 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:17:53.579 03:29:18 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:53.579 03:29:18 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:53.579 03:29:18 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:53.579 03:29:18 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:17:53.579 03:29:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:53.579 03:29:18 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:53.579 03:29:18 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:53.579 03:29:18 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:17:53.579 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:53.579 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:17:53.579 00:17:53.579 --- 10.0.0.2 ping statistics --- 00:17:53.579 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:53.579 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:17:53.579 03:29:18 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:53.579 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:53.579 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:17:53.579 00:17:53.579 --- 10.0.0.1 ping statistics --- 00:17:53.579 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:53.579 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:17:53.579 03:29:18 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:53.579 03:29:18 -- nvmf/common.sh@411 -- # return 0 00:17:53.579 03:29:18 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:53.579 03:29:18 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:53.579 03:29:18 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:17:53.579 03:29:18 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:53.579 03:29:18 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:17:53.579 03:29:18 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:17:53.579 03:29:18 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:17:53.579 03:29:18 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:53.579 03:29:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:53.579 03:29:18 -- common/autotest_common.sh@10 -- # set +x 00:17:53.579 03:29:18 -- nvmf/common.sh@470 -- # nvmfpid=1488541 00:17:53.579 03:29:18 -- nvmf/common.sh@471 -- # waitforlisten 1488541 00:17:53.579 03:29:18 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:53.579 03:29:18 -- common/autotest_common.sh@817 -- # '[' -z 1488541 ']' 00:17:53.579 03:29:18 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:53.579 03:29:18 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:53.579 03:29:18 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:53.579 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:53.579 03:29:18 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:53.579 03:29:18 -- common/autotest_common.sh@10 -- # set +x 00:17:53.838 [2024-04-27 03:29:18.597239] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:17:53.838 [2024-04-27 03:29:18.597342] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:53.838 EAL: No free 2048 kB hugepages reported on node 1 00:17:53.838 [2024-04-27 03:29:18.666192] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:53.838 [2024-04-27 03:29:18.777550] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:53.838 [2024-04-27 03:29:18.777618] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:53.838 [2024-04-27 03:29:18.777634] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:53.838 [2024-04-27 03:29:18.777647] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:53.838 [2024-04-27 03:29:18.777659] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:53.838 [2024-04-27 03:29:18.777719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:53.838 [2024-04-27 03:29:18.777780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:53.838 [2024-04-27 03:29:18.777805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:53.838 [2024-04-27 03:29:18.777807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:54.772 03:29:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:54.772 03:29:19 -- common/autotest_common.sh@850 -- # return 0 00:17:54.772 03:29:19 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:54.772 03:29:19 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:54.772 03:29:19 -- common/autotest_common.sh@10 -- # set +x 00:17:54.772 03:29:19 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:54.772 03:29:19 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:17:54.772 03:29:19 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:17:58.052 03:29:22 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:17:58.052 03:29:22 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:17:58.052 03:29:22 -- host/perf.sh@30 -- # local_nvme_trid=0000:0b:00.0 00:17:58.052 03:29:22 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:58.310 03:29:23 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:17:58.310 03:29:23 -- host/perf.sh@33 -- # '[' -n 0000:0b:00.0 ']' 00:17:58.311 03:29:23 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:17:58.311 03:29:23 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:17:58.311 03:29:23 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:58.568 [2024-04-27 03:29:23.477978] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:58.568 03:29:23 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:58.826 03:29:23 -- host/perf.sh@45 -- # for bdev in $bdevs 00:17:58.826 03:29:23 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:59.083 03:29:24 -- host/perf.sh@45 -- # for bdev in $bdevs 00:17:59.083 03:29:24 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:17:59.341 03:29:24 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:59.599 [2024-04-27 03:29:24.473603] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:59.599 03:29:24 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:59.857 03:29:24 -- host/perf.sh@52 -- # '[' -n 0000:0b:00.0 ']' 00:17:59.857 03:29:24 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:0b:00.0' 00:17:59.857 03:29:24 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:17:59.857 03:29:24 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:0b:00.0' 00:18:01.230 Initializing NVMe Controllers 00:18:01.230 Attached to NVMe Controller at 0000:0b:00.0 [8086:0a54] 00:18:01.230 Associating PCIE (0000:0b:00.0) NSID 1 with lcore 0 00:18:01.230 Initialization complete. Launching workers. 00:18:01.230 ======================================================== 00:18:01.230 Latency(us) 00:18:01.230 Device Information : IOPS MiB/s Average min max 00:18:01.230 PCIE (0000:0b:00.0) NSID 1 from core 0: 86320.72 337.19 370.09 28.56 7242.25 00:18:01.230 ======================================================== 00:18:01.230 Total : 86320.72 337.19 370.09 28.56 7242.25 00:18:01.230 00:18:01.230 03:29:25 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:18:01.230 EAL: No free 2048 kB hugepages reported on node 1 00:18:02.603 Initializing NVMe Controllers 00:18:02.603 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:02.603 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:02.603 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:18:02.603 Initialization complete. Launching workers. 00:18:02.603 ======================================================== 00:18:02.603 Latency(us) 00:18:02.603 Device Information : IOPS MiB/s Average min max 00:18:02.603 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 82.71 0.32 12127.76 157.86 45766.38 00:18:02.603 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 56.80 0.22 17745.52 5015.19 47906.83 00:18:02.604 ======================================================== 00:18:02.604 Total : 139.51 0.54 14414.99 157.86 47906.83 00:18:02.604 00:18:02.604 03:29:27 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:18:02.604 EAL: No free 2048 kB hugepages reported on node 1 00:18:03.979 Initializing NVMe Controllers 00:18:03.979 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:03.979 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:03.979 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:18:03.979 Initialization complete. Launching workers. 00:18:03.979 ======================================================== 00:18:03.979 Latency(us) 00:18:03.979 Device Information : IOPS MiB/s Average min max 00:18:03.979 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8388.99 32.77 3815.01 538.51 10377.45 00:18:03.979 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3764.00 14.70 8546.13 4025.89 22311.98 00:18:03.979 ======================================================== 00:18:03.979 Total : 12152.99 47.47 5280.32 538.51 22311.98 00:18:03.979 00:18:03.979 03:29:28 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:18:03.979 03:29:28 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:18:03.979 03:29:28 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:18:03.979 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.520 Initializing NVMe Controllers 00:18:06.520 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:06.520 Controller IO queue size 128, less than required. 00:18:06.520 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:06.520 Controller IO queue size 128, less than required. 00:18:06.520 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:06.520 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:06.520 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:18:06.520 Initialization complete. Launching workers. 00:18:06.520 ======================================================== 00:18:06.520 Latency(us) 00:18:06.520 Device Information : IOPS MiB/s Average min max 00:18:06.520 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1277.45 319.36 103376.54 73216.14 153952.82 00:18:06.520 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 576.25 144.06 226623.43 119895.37 330346.36 00:18:06.520 ======================================================== 00:18:06.520 Total : 1853.70 463.43 141689.75 73216.14 330346.36 00:18:06.520 00:18:06.520 03:29:30 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:18:06.520 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.520 No valid NVMe controllers or AIO or URING devices found 00:18:06.520 Initializing NVMe Controllers 00:18:06.520 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:06.520 Controller IO queue size 128, less than required. 00:18:06.520 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:06.520 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:18:06.520 Controller IO queue size 128, less than required. 00:18:06.520 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:06.520 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:18:06.520 WARNING: Some requested NVMe devices were skipped 00:18:06.520 03:29:31 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:18:06.520 EAL: No free 2048 kB hugepages reported on node 1 00:18:09.051 Initializing NVMe Controllers 00:18:09.051 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:09.051 Controller IO queue size 128, less than required. 00:18:09.051 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:09.051 Controller IO queue size 128, less than required. 00:18:09.051 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:09.051 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:09.051 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:18:09.051 Initialization complete. Launching workers. 00:18:09.051 00:18:09.051 ==================== 00:18:09.051 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:18:09.051 TCP transport: 00:18:09.051 polls: 12399 00:18:09.051 idle_polls: 5646 00:18:09.051 sock_completions: 6753 00:18:09.051 nvme_completions: 6063 00:18:09.051 submitted_requests: 9036 00:18:09.051 queued_requests: 1 00:18:09.051 00:18:09.051 ==================== 00:18:09.051 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:18:09.051 TCP transport: 00:18:09.051 polls: 15765 00:18:09.051 idle_polls: 9483 00:18:09.051 sock_completions: 6282 00:18:09.051 nvme_completions: 5543 00:18:09.051 submitted_requests: 8368 00:18:09.051 queued_requests: 1 00:18:09.051 ======================================================== 00:18:09.051 Latency(us) 00:18:09.051 Device Information : IOPS MiB/s Average min max 00:18:09.051 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1512.96 378.24 87055.50 57522.52 127152.25 00:18:09.051 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1383.18 345.79 94018.77 40759.44 146367.90 00:18:09.051 ======================================================== 00:18:09.051 Total : 2896.14 724.03 90381.12 40759.44 146367.90 00:18:09.051 00:18:09.051 03:29:33 -- host/perf.sh@66 -- # sync 00:18:09.051 03:29:33 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:09.051 03:29:33 -- host/perf.sh@69 -- # '[' 0 -eq 1 ']' 00:18:09.051 03:29:33 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:18:09.051 03:29:33 -- host/perf.sh@114 -- # nvmftestfini 00:18:09.051 03:29:33 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:09.051 03:29:33 -- nvmf/common.sh@117 -- # sync 00:18:09.051 03:29:33 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:18:09.051 03:29:33 -- nvmf/common.sh@120 -- # set +e 00:18:09.051 03:29:33 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:09.051 03:29:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:18:09.051 rmmod nvme_tcp 00:18:09.051 rmmod nvme_fabrics 00:18:09.051 rmmod nvme_keyring 00:18:09.051 03:29:33 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:09.051 03:29:33 -- nvmf/common.sh@124 -- # set -e 00:18:09.051 03:29:33 -- nvmf/common.sh@125 -- # return 0 00:18:09.051 03:29:33 -- nvmf/common.sh@478 -- # '[' -n 1488541 ']' 00:18:09.051 03:29:33 -- nvmf/common.sh@479 -- # killprocess 1488541 00:18:09.051 03:29:33 -- common/autotest_common.sh@936 -- # '[' -z 1488541 ']' 00:18:09.051 03:29:33 -- common/autotest_common.sh@940 -- # kill -0 1488541 00:18:09.051 03:29:33 -- common/autotest_common.sh@941 -- # uname 00:18:09.051 03:29:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:09.051 03:29:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1488541 00:18:09.051 03:29:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:09.051 03:29:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:09.051 03:29:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1488541' 00:18:09.051 killing process with pid 1488541 00:18:09.051 03:29:33 -- common/autotest_common.sh@955 -- # kill 1488541 00:18:09.051 03:29:33 -- common/autotest_common.sh@960 -- # wait 1488541 00:18:10.958 03:29:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:10.958 03:29:35 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:18:10.958 03:29:35 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:18:10.958 03:29:35 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:10.958 03:29:35 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:18:10.958 03:29:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:10.958 03:29:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:10.958 03:29:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:12.902 03:29:37 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:18:12.903 00:18:12.903 real 0m21.078s 00:18:12.903 user 1m6.084s 00:18:12.903 sys 0m5.104s 00:18:12.903 03:29:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:12.903 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:18:12.903 ************************************ 00:18:12.903 END TEST nvmf_perf 00:18:12.903 ************************************ 00:18:12.903 03:29:37 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:18:12.903 03:29:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:12.903 03:29:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:12.903 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:18:12.903 ************************************ 00:18:12.903 START TEST nvmf_fio_host 00:18:12.903 ************************************ 00:18:12.903 03:29:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:18:12.903 * Looking for test storage... 00:18:12.903 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:18:12.903 03:29:37 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:12.903 03:29:37 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:12.903 03:29:37 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:12.903 03:29:37 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:12.903 03:29:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.903 03:29:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.903 03:29:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.903 03:29:37 -- paths/export.sh@5 -- # export PATH 00:18:12.903 03:29:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.903 03:29:37 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:12.903 03:29:37 -- nvmf/common.sh@7 -- # uname -s 00:18:12.903 03:29:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:12.903 03:29:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:12.903 03:29:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:12.903 03:29:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:12.903 03:29:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:12.903 03:29:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:12.903 03:29:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:12.903 03:29:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:12.903 03:29:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:12.903 03:29:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:12.903 03:29:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:18:12.903 03:29:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:18:12.903 03:29:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:12.903 03:29:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:12.903 03:29:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:12.903 03:29:37 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:12.903 03:29:37 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:12.903 03:29:37 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:12.903 03:29:37 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:12.903 03:29:37 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:12.903 03:29:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.903 03:29:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.903 03:29:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.903 03:29:37 -- paths/export.sh@5 -- # export PATH 00:18:12.903 03:29:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.903 03:29:37 -- nvmf/common.sh@47 -- # : 0 00:18:12.903 03:29:37 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:12.903 03:29:37 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:12.903 03:29:37 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:12.903 03:29:37 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:12.903 03:29:37 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:12.903 03:29:37 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:12.903 03:29:37 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:12.903 03:29:37 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:12.903 03:29:37 -- host/fio.sh@12 -- # nvmftestinit 00:18:12.903 03:29:37 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:18:12.903 03:29:37 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:12.903 03:29:37 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:12.903 03:29:37 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:12.903 03:29:37 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:12.903 03:29:37 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:12.903 03:29:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:12.903 03:29:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:12.903 03:29:37 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:12.903 03:29:37 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:12.903 03:29:37 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:12.903 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:18:14.809 03:29:39 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:14.809 03:29:39 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:14.809 03:29:39 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:14.809 03:29:39 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:14.809 03:29:39 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:14.809 03:29:39 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:14.809 03:29:39 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:14.809 03:29:39 -- nvmf/common.sh@295 -- # net_devs=() 00:18:14.809 03:29:39 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:14.809 03:29:39 -- nvmf/common.sh@296 -- # e810=() 00:18:14.809 03:29:39 -- nvmf/common.sh@296 -- # local -ga e810 00:18:14.809 03:29:39 -- nvmf/common.sh@297 -- # x722=() 00:18:14.809 03:29:39 -- nvmf/common.sh@297 -- # local -ga x722 00:18:14.809 03:29:39 -- nvmf/common.sh@298 -- # mlx=() 00:18:14.809 03:29:39 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:14.809 03:29:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:14.809 03:29:39 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:14.809 03:29:39 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:14.809 03:29:39 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:14.809 03:29:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:14.809 03:29:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:18:14.809 Found 0000:09:00.0 (0x8086 - 0x159b) 00:18:14.809 03:29:39 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:14.809 03:29:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:18:14.809 Found 0000:09:00.1 (0x8086 - 0x159b) 00:18:14.809 03:29:39 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:14.809 03:29:39 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:18:14.809 03:29:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:14.809 03:29:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:14.809 03:29:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:14.809 03:29:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:14.809 03:29:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:18:14.809 Found net devices under 0000:09:00.0: cvl_0_0 00:18:14.809 03:29:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:14.809 03:29:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:14.809 03:29:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:14.809 03:29:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:14.809 03:29:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:14.809 03:29:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:18:14.809 Found net devices under 0000:09:00.1: cvl_0_1 00:18:14.809 03:29:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:14.809 03:29:39 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:14.809 03:29:39 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:14.810 03:29:39 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:14.810 03:29:39 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:18:14.810 03:29:39 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:18:14.810 03:29:39 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:14.810 03:29:39 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:14.810 03:29:39 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:14.810 03:29:39 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:18:14.810 03:29:39 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:14.810 03:29:39 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:14.810 03:29:39 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:18:14.810 03:29:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:14.810 03:29:39 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:14.810 03:29:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:18:14.810 03:29:39 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:18:14.810 03:29:39 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:18:14.810 03:29:39 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:15.067 03:29:39 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:15.067 03:29:39 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:15.067 03:29:39 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:18:15.067 03:29:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:15.067 03:29:39 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:15.067 03:29:39 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:15.067 03:29:39 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:18:15.067 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:15.067 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:18:15.067 00:18:15.067 --- 10.0.0.2 ping statistics --- 00:18:15.067 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:15.067 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:18:15.067 03:29:39 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:15.067 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:15.067 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:18:15.067 00:18:15.067 --- 10.0.0.1 ping statistics --- 00:18:15.067 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:15.068 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:18:15.068 03:29:39 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:15.068 03:29:39 -- nvmf/common.sh@411 -- # return 0 00:18:15.068 03:29:39 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:15.068 03:29:39 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:15.068 03:29:39 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:18:15.068 03:29:39 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:18:15.068 03:29:39 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:15.068 03:29:39 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:18:15.068 03:29:39 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:18:15.068 03:29:39 -- host/fio.sh@14 -- # [[ y != y ]] 00:18:15.068 03:29:39 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:18:15.068 03:29:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:15.068 03:29:39 -- common/autotest_common.sh@10 -- # set +x 00:18:15.068 03:29:39 -- host/fio.sh@22 -- # nvmfpid=1492521 00:18:15.068 03:29:39 -- host/fio.sh@21 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:15.068 03:29:39 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:15.068 03:29:39 -- host/fio.sh@26 -- # waitforlisten 1492521 00:18:15.068 03:29:39 -- common/autotest_common.sh@817 -- # '[' -z 1492521 ']' 00:18:15.068 03:29:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:15.068 03:29:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:15.068 03:29:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:15.068 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:15.068 03:29:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:15.068 03:29:39 -- common/autotest_common.sh@10 -- # set +x 00:18:15.068 [2024-04-27 03:29:39.978135] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:18:15.068 [2024-04-27 03:29:39.978208] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:15.068 EAL: No free 2048 kB hugepages reported on node 1 00:18:15.068 [2024-04-27 03:29:40.044607] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:15.326 [2024-04-27 03:29:40.148853] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:15.326 [2024-04-27 03:29:40.148907] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:15.326 [2024-04-27 03:29:40.148935] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:15.326 [2024-04-27 03:29:40.148947] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:15.326 [2024-04-27 03:29:40.148957] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:15.326 [2024-04-27 03:29:40.149017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:15.326 [2024-04-27 03:29:40.149076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:15.326 [2024-04-27 03:29:40.149118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:15.326 [2024-04-27 03:29:40.149120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:15.326 03:29:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:15.326 03:29:40 -- common/autotest_common.sh@850 -- # return 0 00:18:15.326 03:29:40 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:15.326 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:15.326 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:18:15.326 [2024-04-27 03:29:40.284087] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:15.326 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:15.326 03:29:40 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:18:15.326 03:29:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:15.326 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:18:15.585 03:29:40 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:18:15.585 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:15.585 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:18:15.585 Malloc1 00:18:15.585 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:15.585 03:29:40 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:15.585 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:15.585 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:18:15.585 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:15.585 03:29:40 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:15.585 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:15.585 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:18:15.585 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:15.585 03:29:40 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:15.585 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:15.585 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:18:15.585 [2024-04-27 03:29:40.365720] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:15.585 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:15.585 03:29:40 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:15.585 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:15.585 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:18:15.585 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:15.585 03:29:40 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:18:15.585 03:29:40 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:18:15.585 03:29:40 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:18:15.585 03:29:40 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:18:15.585 03:29:40 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:18:15.585 03:29:40 -- common/autotest_common.sh@1325 -- # local sanitizers 00:18:15.585 03:29:40 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:18:15.585 03:29:40 -- common/autotest_common.sh@1327 -- # shift 00:18:15.585 03:29:40 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:18:15.585 03:29:40 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:18:15.585 03:29:40 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:18:15.585 03:29:40 -- common/autotest_common.sh@1331 -- # grep libasan 00:18:15.585 03:29:40 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:18:15.585 03:29:40 -- common/autotest_common.sh@1331 -- # asan_lib= 00:18:15.585 03:29:40 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:18:15.585 03:29:40 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:18:15.585 03:29:40 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:18:15.585 03:29:40 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:18:15.585 03:29:40 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:18:15.585 03:29:40 -- common/autotest_common.sh@1331 -- # asan_lib= 00:18:15.585 03:29:40 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:18:15.585 03:29:40 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:18:15.585 03:29:40 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:18:15.843 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:18:15.843 fio-3.35 00:18:15.843 Starting 1 thread 00:18:15.843 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.368 00:18:18.368 test: (groupid=0, jobs=1): err= 0: pid=1492626: Sat Apr 27 03:29:42 2024 00:18:18.368 read: IOPS=8368, BW=32.7MiB/s (34.3MB/s)(66.9MiB/2048msec) 00:18:18.368 slat (nsec): min=1960, max=146226, avg=2444.16, stdev=1721.74 00:18:18.368 clat (usec): min=2183, max=56217, avg=8378.89, stdev=2633.77 00:18:18.368 lat (usec): min=2209, max=56219, avg=8381.34, stdev=2633.75 00:18:18.368 clat percentiles (usec): 00:18:18.368 | 1.00th=[ 6652], 5.00th=[ 7111], 10.00th=[ 7373], 20.00th=[ 7635], 00:18:18.368 | 30.00th=[ 7898], 40.00th=[ 8094], 50.00th=[ 8225], 60.00th=[ 8455], 00:18:18.368 | 70.00th=[ 8586], 80.00th=[ 8848], 90.00th=[ 9110], 95.00th=[ 9372], 00:18:18.368 | 99.00th=[ 9765], 99.50th=[10028], 99.90th=[52691], 99.95th=[54264], 00:18:18.368 | 99.99th=[55313] 00:18:18.368 bw ( KiB/s): min=33256, max=34672, per=100.00%, avg=34156.00, stdev=633.45, samples=4 00:18:18.368 iops : min= 8314, max= 8668, avg=8539.00, stdev=158.36, samples=4 00:18:18.368 write: IOPS=8372, BW=32.7MiB/s (34.3MB/s)(67.0MiB/2048msec); 0 zone resets 00:18:18.368 slat (usec): min=2, max=102, avg= 2.57, stdev= 1.15 00:18:18.368 clat (usec): min=1663, max=54364, avg=6847.53, stdev=2797.31 00:18:18.368 lat (usec): min=1670, max=54366, avg=6850.11, stdev=2797.31 00:18:18.368 clat percentiles (usec): 00:18:18.368 | 1.00th=[ 5407], 5.00th=[ 5800], 10.00th=[ 5997], 20.00th=[ 6259], 00:18:18.368 | 30.00th=[ 6390], 40.00th=[ 6521], 50.00th=[ 6718], 60.00th=[ 6849], 00:18:18.368 | 70.00th=[ 6980], 80.00th=[ 7111], 90.00th=[ 7373], 95.00th=[ 7570], 00:18:18.368 | 99.00th=[ 7963], 99.50th=[ 8291], 99.90th=[51643], 99.95th=[52691], 00:18:18.368 | 99.99th=[54264] 00:18:18.368 bw ( KiB/s): min=33280, max=35520, per=100.00%, avg=34160.00, stdev=961.24, samples=4 00:18:18.368 iops : min= 8320, max= 8880, avg=8540.00, stdev=240.31, samples=4 00:18:18.368 lat (msec) : 2=0.02%, 4=0.11%, 10=99.42%, 20=0.08%, 50=0.13% 00:18:18.368 lat (msec) : 100=0.25% 00:18:18.368 cpu : usr=62.29%, sys=34.54%, ctx=98, majf=0, minf=5 00:18:18.368 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:18:18.368 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:18.368 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:18.368 issued rwts: total=17138,17147,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:18.368 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:18.368 00:18:18.368 Run status group 0 (all jobs): 00:18:18.368 READ: bw=32.7MiB/s (34.3MB/s), 32.7MiB/s-32.7MiB/s (34.3MB/s-34.3MB/s), io=66.9MiB (70.2MB), run=2048-2048msec 00:18:18.368 WRITE: bw=32.7MiB/s (34.3MB/s), 32.7MiB/s-32.7MiB/s (34.3MB/s-34.3MB/s), io=67.0MiB (70.2MB), run=2048-2048msec 00:18:18.368 03:29:42 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:18:18.368 03:29:42 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:18:18.368 03:29:42 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:18:18.368 03:29:42 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:18:18.368 03:29:42 -- common/autotest_common.sh@1325 -- # local sanitizers 00:18:18.368 03:29:42 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:18:18.368 03:29:42 -- common/autotest_common.sh@1327 -- # shift 00:18:18.368 03:29:42 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:18:18.368 03:29:42 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:18:18.368 03:29:42 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:18:18.368 03:29:42 -- common/autotest_common.sh@1331 -- # grep libasan 00:18:18.368 03:29:42 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:18:18.368 03:29:42 -- common/autotest_common.sh@1331 -- # asan_lib= 00:18:18.368 03:29:42 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:18:18.368 03:29:42 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:18:18.368 03:29:42 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:18:18.368 03:29:42 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:18:18.368 03:29:42 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:18:18.368 03:29:42 -- common/autotest_common.sh@1331 -- # asan_lib= 00:18:18.368 03:29:42 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:18:18.368 03:29:42 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:18:18.368 03:29:42 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:18:18.368 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:18:18.368 fio-3.35 00:18:18.368 Starting 1 thread 00:18:18.368 EAL: No free 2048 kB hugepages reported on node 1 00:18:20.896 [2024-04-27 03:29:45.597773] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x566a90 is same with the state(5) to be set 00:18:20.896 00:18:20.896 test: (groupid=0, jobs=1): err= 0: pid=1493071: Sat Apr 27 03:29:45 2024 00:18:20.896 read: IOPS=8119, BW=127MiB/s (133MB/s)(255MiB/2010msec) 00:18:20.896 slat (nsec): min=2858, max=93222, avg=3571.87, stdev=1567.18 00:18:20.896 clat (usec): min=2602, max=17516, avg=8975.60, stdev=2135.40 00:18:20.896 lat (usec): min=2605, max=17520, avg=8979.17, stdev=2135.44 00:18:20.896 clat percentiles (usec): 00:18:20.896 | 1.00th=[ 4686], 5.00th=[ 5669], 10.00th=[ 6325], 20.00th=[ 7177], 00:18:20.896 | 30.00th=[ 7832], 40.00th=[ 8356], 50.00th=[ 8848], 60.00th=[ 9241], 00:18:20.896 | 70.00th=[ 9896], 80.00th=[10814], 90.00th=[11731], 95.00th=[12649], 00:18:20.896 | 99.00th=[15008], 99.50th=[15533], 99.90th=[16581], 99.95th=[16909], 00:18:20.896 | 99.99th=[17171] 00:18:20.896 bw ( KiB/s): min=54464, max=76608, per=52.21%, avg=67824.00, stdev=10446.89, samples=4 00:18:20.896 iops : min= 3404, max= 4788, avg=4239.00, stdev=652.93, samples=4 00:18:20.896 write: IOPS=4978, BW=77.8MiB/s (81.6MB/s)(139MiB/1785msec); 0 zone resets 00:18:20.896 slat (usec): min=30, max=140, avg=33.25, stdev= 4.65 00:18:20.896 clat (usec): min=4083, max=20680, avg=11511.23, stdev=2078.49 00:18:20.896 lat (usec): min=4118, max=20712, avg=11544.48, stdev=2078.52 00:18:20.896 clat percentiles (usec): 00:18:20.896 | 1.00th=[ 7504], 5.00th=[ 8586], 10.00th=[ 9110], 20.00th=[ 9634], 00:18:20.896 | 30.00th=[10159], 40.00th=[10683], 50.00th=[11338], 60.00th=[11863], 00:18:20.896 | 70.00th=[12518], 80.00th=[13304], 90.00th=[14353], 95.00th=[15139], 00:18:20.896 | 99.00th=[16909], 99.50th=[17695], 99.90th=[19268], 99.95th=[19530], 00:18:20.896 | 99.99th=[20579] 00:18:20.896 bw ( KiB/s): min=57120, max=79200, per=88.53%, avg=70520.00, stdev=10615.11, samples=4 00:18:20.896 iops : min= 3570, max= 4950, avg=4407.50, stdev=663.44, samples=4 00:18:20.896 lat (msec) : 4=0.12%, 10=55.46%, 20=44.41%, 50=0.01% 00:18:20.896 cpu : usr=74.76%, sys=22.90%, ctx=46, majf=0, minf=1 00:18:20.896 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:18:20.896 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:20.896 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:20.896 issued rwts: total=16321,8887,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:20.896 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:20.896 00:18:20.896 Run status group 0 (all jobs): 00:18:20.896 READ: bw=127MiB/s (133MB/s), 127MiB/s-127MiB/s (133MB/s-133MB/s), io=255MiB (267MB), run=2010-2010msec 00:18:20.896 WRITE: bw=77.8MiB/s (81.6MB/s), 77.8MiB/s-77.8MiB/s (81.6MB/s-81.6MB/s), io=139MiB (146MB), run=1785-1785msec 00:18:20.896 03:29:45 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:20.896 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.896 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:18:20.896 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.896 03:29:45 -- host/fio.sh@47 -- # '[' 0 -eq 1 ']' 00:18:20.897 03:29:45 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:18:20.897 03:29:45 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:18:20.897 03:29:45 -- host/fio.sh@84 -- # nvmftestfini 00:18:20.897 03:29:45 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:20.897 03:29:45 -- nvmf/common.sh@117 -- # sync 00:18:20.897 03:29:45 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:18:20.897 03:29:45 -- nvmf/common.sh@120 -- # set +e 00:18:20.897 03:29:45 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:20.897 03:29:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:18:20.897 rmmod nvme_tcp 00:18:20.897 rmmod nvme_fabrics 00:18:20.897 rmmod nvme_keyring 00:18:20.897 03:29:45 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:20.897 03:29:45 -- nvmf/common.sh@124 -- # set -e 00:18:20.897 03:29:45 -- nvmf/common.sh@125 -- # return 0 00:18:20.897 03:29:45 -- nvmf/common.sh@478 -- # '[' -n 1492521 ']' 00:18:20.897 03:29:45 -- nvmf/common.sh@479 -- # killprocess 1492521 00:18:20.897 03:29:45 -- common/autotest_common.sh@936 -- # '[' -z 1492521 ']' 00:18:20.897 03:29:45 -- common/autotest_common.sh@940 -- # kill -0 1492521 00:18:20.897 03:29:45 -- common/autotest_common.sh@941 -- # uname 00:18:20.897 03:29:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.897 03:29:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1492521 00:18:20.897 03:29:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:20.897 03:29:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:20.897 03:29:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1492521' 00:18:20.897 killing process with pid 1492521 00:18:20.897 03:29:45 -- common/autotest_common.sh@955 -- # kill 1492521 00:18:20.897 03:29:45 -- common/autotest_common.sh@960 -- # wait 1492521 00:18:21.154 03:29:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:21.154 03:29:46 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:18:21.154 03:29:46 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:18:21.154 03:29:46 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:21.154 03:29:46 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:18:21.154 03:29:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:21.154 03:29:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:21.154 03:29:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.690 03:29:48 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:18:23.690 00:18:23.690 real 0m10.349s 00:18:23.690 user 0m27.499s 00:18:23.690 sys 0m3.648s 00:18:23.690 03:29:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:23.690 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:18:23.690 ************************************ 00:18:23.690 END TEST nvmf_fio_host 00:18:23.690 ************************************ 00:18:23.690 03:29:48 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:18:23.690 03:29:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:23.690 03:29:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:23.690 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:18:23.690 ************************************ 00:18:23.690 START TEST nvmf_failover 00:18:23.690 ************************************ 00:18:23.690 03:29:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:18:23.690 * Looking for test storage... 00:18:23.690 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:18:23.690 03:29:48 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:23.690 03:29:48 -- nvmf/common.sh@7 -- # uname -s 00:18:23.690 03:29:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:23.690 03:29:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:23.690 03:29:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:23.690 03:29:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:23.690 03:29:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:23.690 03:29:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:23.690 03:29:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:23.690 03:29:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:23.690 03:29:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:23.690 03:29:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:23.690 03:29:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:18:23.690 03:29:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:18:23.690 03:29:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:23.690 03:29:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:23.690 03:29:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:23.690 03:29:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:23.690 03:29:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:23.690 03:29:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:23.690 03:29:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:23.690 03:29:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:23.690 03:29:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.690 03:29:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.690 03:29:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.690 03:29:48 -- paths/export.sh@5 -- # export PATH 00:18:23.690 03:29:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.690 03:29:48 -- nvmf/common.sh@47 -- # : 0 00:18:23.690 03:29:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:23.690 03:29:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:23.690 03:29:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:23.690 03:29:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:23.690 03:29:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:23.690 03:29:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:23.690 03:29:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:23.690 03:29:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:23.690 03:29:48 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:23.690 03:29:48 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:23.690 03:29:48 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:23.690 03:29:48 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:23.690 03:29:48 -- host/failover.sh@18 -- # nvmftestinit 00:18:23.690 03:29:48 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:18:23.690 03:29:48 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:23.690 03:29:48 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:23.690 03:29:48 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:23.690 03:29:48 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:23.690 03:29:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.690 03:29:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.690 03:29:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.690 03:29:48 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:23.690 03:29:48 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:23.690 03:29:48 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:23.690 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:18:25.596 03:29:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:25.596 03:29:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:25.596 03:29:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:25.596 03:29:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:25.596 03:29:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:25.596 03:29:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:25.596 03:29:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:25.596 03:29:50 -- nvmf/common.sh@295 -- # net_devs=() 00:18:25.596 03:29:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:25.596 03:29:50 -- nvmf/common.sh@296 -- # e810=() 00:18:25.596 03:29:50 -- nvmf/common.sh@296 -- # local -ga e810 00:18:25.596 03:29:50 -- nvmf/common.sh@297 -- # x722=() 00:18:25.596 03:29:50 -- nvmf/common.sh@297 -- # local -ga x722 00:18:25.596 03:29:50 -- nvmf/common.sh@298 -- # mlx=() 00:18:25.596 03:29:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:25.596 03:29:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:25.596 03:29:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:25.596 03:29:50 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:25.596 03:29:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:25.596 03:29:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:25.596 03:29:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:18:25.596 Found 0000:09:00.0 (0x8086 - 0x159b) 00:18:25.596 03:29:50 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:25.596 03:29:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:18:25.596 Found 0000:09:00.1 (0x8086 - 0x159b) 00:18:25.596 03:29:50 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:25.596 03:29:50 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:25.596 03:29:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.596 03:29:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:25.596 03:29:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.596 03:29:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:18:25.596 Found net devices under 0000:09:00.0: cvl_0_0 00:18:25.596 03:29:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.596 03:29:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:25.596 03:29:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.596 03:29:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:25.596 03:29:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.596 03:29:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:18:25.596 Found net devices under 0000:09:00.1: cvl_0_1 00:18:25.596 03:29:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.596 03:29:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:25.596 03:29:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:25.596 03:29:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:18:25.596 03:29:50 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:25.596 03:29:50 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:25.596 03:29:50 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:25.596 03:29:50 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:18:25.596 03:29:50 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:25.596 03:29:50 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:25.596 03:29:50 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:18:25.596 03:29:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:25.596 03:29:50 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:25.596 03:29:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:18:25.596 03:29:50 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:18:25.596 03:29:50 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:18:25.596 03:29:50 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:25.596 03:29:50 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:25.596 03:29:50 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:25.596 03:29:50 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:18:25.596 03:29:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:25.596 03:29:50 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:25.596 03:29:50 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:25.596 03:29:50 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:18:25.596 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:25.596 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:18:25.596 00:18:25.596 --- 10.0.0.2 ping statistics --- 00:18:25.596 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:25.596 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:18:25.596 03:29:50 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:25.596 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:25.596 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:18:25.596 00:18:25.596 --- 10.0.0.1 ping statistics --- 00:18:25.596 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:25.596 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:18:25.596 03:29:50 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:25.596 03:29:50 -- nvmf/common.sh@411 -- # return 0 00:18:25.596 03:29:50 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:25.596 03:29:50 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:25.596 03:29:50 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:18:25.596 03:29:50 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:25.596 03:29:50 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:18:25.596 03:29:50 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:18:25.596 03:29:50 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:18:25.596 03:29:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:25.596 03:29:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:25.596 03:29:50 -- common/autotest_common.sh@10 -- # set +x 00:18:25.596 03:29:50 -- nvmf/common.sh@470 -- # nvmfpid=1495268 00:18:25.596 03:29:50 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:18:25.596 03:29:50 -- nvmf/common.sh@471 -- # waitforlisten 1495268 00:18:25.596 03:29:50 -- common/autotest_common.sh@817 -- # '[' -z 1495268 ']' 00:18:25.596 03:29:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:25.596 03:29:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:25.596 03:29:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:25.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:25.596 03:29:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:25.596 03:29:50 -- common/autotest_common.sh@10 -- # set +x 00:18:25.596 [2024-04-27 03:29:50.339212] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:18:25.597 [2024-04-27 03:29:50.339302] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:25.597 EAL: No free 2048 kB hugepages reported on node 1 00:18:25.597 [2024-04-27 03:29:50.405639] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:18:25.597 [2024-04-27 03:29:50.507723] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:25.597 [2024-04-27 03:29:50.507780] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:25.597 [2024-04-27 03:29:50.507810] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:25.597 [2024-04-27 03:29:50.507821] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:25.597 [2024-04-27 03:29:50.507848] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:25.597 [2024-04-27 03:29:50.507967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:25.597 [2024-04-27 03:29:50.508034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:25.597 [2024-04-27 03:29:50.508037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:25.855 03:29:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:25.855 03:29:50 -- common/autotest_common.sh@850 -- # return 0 00:18:25.855 03:29:50 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:25.855 03:29:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:25.855 03:29:50 -- common/autotest_common.sh@10 -- # set +x 00:18:25.855 03:29:50 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:25.855 03:29:50 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:18:26.113 [2024-04-27 03:29:50.883702] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:26.113 03:29:50 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:18:26.371 Malloc0 00:18:26.371 03:29:51 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:26.629 03:29:51 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:26.887 03:29:51 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:27.145 [2024-04-27 03:29:51.866011] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:27.145 03:29:51 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:27.403 [2024-04-27 03:29:52.154856] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:18:27.403 03:29:52 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:18:27.662 [2024-04-27 03:29:52.411616] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:18:27.662 03:29:52 -- host/failover.sh@31 -- # bdevperf_pid=1495556 00:18:27.662 03:29:52 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:18:27.662 03:29:52 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:27.662 03:29:52 -- host/failover.sh@34 -- # waitforlisten 1495556 /var/tmp/bdevperf.sock 00:18:27.662 03:29:52 -- common/autotest_common.sh@817 -- # '[' -z 1495556 ']' 00:18:27.662 03:29:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:27.662 03:29:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:27.662 03:29:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:27.662 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:27.662 03:29:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:27.662 03:29:52 -- common/autotest_common.sh@10 -- # set +x 00:18:27.920 03:29:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:27.920 03:29:52 -- common/autotest_common.sh@850 -- # return 0 00:18:27.920 03:29:52 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:28.177 NVMe0n1 00:18:28.177 03:29:53 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:28.742 00:18:28.742 03:29:53 -- host/failover.sh@39 -- # run_test_pid=1495692 00:18:28.742 03:29:53 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:28.742 03:29:53 -- host/failover.sh@41 -- # sleep 1 00:18:29.677 03:29:54 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:29.935 [2024-04-27 03:29:54.697849] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.935 [2024-04-27 03:29:54.697968] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.935 [2024-04-27 03:29:54.697984] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.935 [2024-04-27 03:29:54.698010] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.935 [2024-04-27 03:29:54.698023] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.935 [2024-04-27 03:29:54.698034] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.935 [2024-04-27 03:29:54.698047] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.935 [2024-04-27 03:29:54.698059] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.935 [2024-04-27 03:29:54.698071] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.935 [2024-04-27 03:29:54.698083] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698094] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698106] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698118] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698130] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698141] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698153] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698165] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698176] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698188] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698200] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698211] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698223] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698258] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698273] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698297] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698310] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698321] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698333] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698345] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698357] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698369] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698381] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698393] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698405] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698418] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698430] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 [2024-04-27 03:29:54.698442] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbdb00 is same with the state(5) to be set 00:18:29.936 03:29:54 -- host/failover.sh@45 -- # sleep 3 00:18:33.223 03:29:57 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:33.482 00:18:33.482 03:29:58 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:33.482 [2024-04-27 03:29:58.455807] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.455867] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.455882] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.455895] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.455907] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.455919] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.455931] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.455943] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.455955] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.455967] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.455979] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456002] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456014] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456037] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456048] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456060] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456072] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456084] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456096] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456109] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456120] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456132] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456144] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456156] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456167] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456179] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456190] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456202] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456214] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456225] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456237] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456256] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456270] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456281] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456294] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456305] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456317] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456328] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456344] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456356] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456368] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456380] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456391] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456403] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456414] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456426] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456437] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456449] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456460] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456473] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456484] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456496] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456508] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456520] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456532] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456543] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456555] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456567] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456579] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456591] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.482 [2024-04-27 03:29:58.456603] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456614] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456626] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456638] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456649] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456665] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456678] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456690] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456702] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456713] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456725] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456737] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456748] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456767] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456778] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456791] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456803] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456815] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456832] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456844] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456855] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456867] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456878] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456890] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456902] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456914] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456925] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456937] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456949] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456960] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456972] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.456984] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457003] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457016] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457027] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457039] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457051] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457062] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457075] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457087] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457098] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457110] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457122] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457133] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.483 [2024-04-27 03:29:58.457145] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fbe6c0 is same with the state(5) to be set 00:18:33.740 03:29:58 -- host/failover.sh@50 -- # sleep 3 00:18:37.036 03:30:01 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:37.036 [2024-04-27 03:30:01.727177] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:37.036 03:30:01 -- host/failover.sh@55 -- # sleep 1 00:18:37.970 03:30:02 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:18:38.228 [2024-04-27 03:30:03.028577] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028657] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028686] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028698] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028710] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028721] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028733] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028744] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028756] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028767] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028778] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028801] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028814] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028825] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028836] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028848] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028860] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028871] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028882] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028894] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028905] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028916] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028928] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028939] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028950] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028962] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028973] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028985] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.028996] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029008] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029019] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029030] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029042] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029053] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029064] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029075] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029087] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029098] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029113] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029125] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029137] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029148] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029159] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029170] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 [2024-04-27 03:30:03.029181] tcp.c:1587:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e153f0 is same with the state(5) to be set 00:18:38.228 03:30:03 -- host/failover.sh@59 -- # wait 1495692 00:18:44.808 0 00:18:44.808 03:30:08 -- host/failover.sh@61 -- # killprocess 1495556 00:18:44.808 03:30:08 -- common/autotest_common.sh@936 -- # '[' -z 1495556 ']' 00:18:44.808 03:30:08 -- common/autotest_common.sh@940 -- # kill -0 1495556 00:18:44.808 03:30:08 -- common/autotest_common.sh@941 -- # uname 00:18:44.808 03:30:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:44.808 03:30:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1495556 00:18:44.808 03:30:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:44.808 03:30:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:44.808 03:30:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1495556' 00:18:44.808 killing process with pid 1495556 00:18:44.808 03:30:08 -- common/autotest_common.sh@955 -- # kill 1495556 00:18:44.808 03:30:08 -- common/autotest_common.sh@960 -- # wait 1495556 00:18:44.808 03:30:08 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:18:44.808 [2024-04-27 03:29:52.473746] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:18:44.808 [2024-04-27 03:29:52.473820] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1495556 ] 00:18:44.808 EAL: No free 2048 kB hugepages reported on node 1 00:18:44.808 [2024-04-27 03:29:52.531459] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:44.808 [2024-04-27 03:29:52.634534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:44.808 Running I/O for 15 seconds... 00:18:44.808 [2024-04-27 03:29:54.699894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:76976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.808 [2024-04-27 03:29:54.699938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.808 [2024-04-27 03:29:54.699967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:76984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.808 [2024-04-27 03:29:54.699984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.808 [2024-04-27 03:29:54.700001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:76992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.808 [2024-04-27 03:29:54.700015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.808 [2024-04-27 03:29:54.700031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:77000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.808 [2024-04-27 03:29:54.700044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.808 [2024-04-27 03:29:54.700060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:77008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.808 [2024-04-27 03:29:54.700073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.808 [2024-04-27 03:29:54.700089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:77016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.808 [2024-04-27 03:29:54.700102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.808 [2024-04-27 03:29:54.700118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:77024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.808 [2024-04-27 03:29:54.700131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.808 [2024-04-27 03:29:54.700146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:77032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.808 [2024-04-27 03:29:54.700161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.808 [2024-04-27 03:29:54.700176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:77040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.808 [2024-04-27 03:29:54.700189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.808 [2024-04-27 03:29:54.700204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:77048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.808 [2024-04-27 03:29:54.700218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:77056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:77064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:77072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:77080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:77088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:77096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:77104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:77112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:77120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:77128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:77136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:77144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:77152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:77160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:77168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:77176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:77184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:77192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:77200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:77208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:77216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:77224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:77232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:77240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.700978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:77248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.700991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:77256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.701020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:77264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.701052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:77272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.701079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:77280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.809 [2024-04-27 03:29:54.701108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:77304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:77312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:77320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:77328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:77336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:77344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:77352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:77360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:77368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:77376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:77384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:77392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:77400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:77408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:77416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:77424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:77432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:77440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:77448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:77456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:77464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:77472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:77480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:77488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:77496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:77504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:77512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:77520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.701978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:77528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.701992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.702007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:77536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.702020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.702035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:77544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.702048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.702063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:77552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.702076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.702091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:77560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.702104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.702119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:77568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.702132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.702147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:77576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.702161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.702179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:77584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.702193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.702209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:77592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.809 [2024-04-27 03:29:54.702223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.809 [2024-04-27 03:29:54.702262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:77600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:77608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:77616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:77624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:77632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:77640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:77648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:77664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:77672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:77680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.810 [2024-04-27 03:29:54.702584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702617] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.702635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77688 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.702648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702665] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.702676] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.702687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77696 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.702700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702714] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.702724] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.702735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77704 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.702747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702760] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.702771] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.702781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77712 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.702794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702806] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.702817] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.702828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77720 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.702856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702869] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.702880] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.702891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77728 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.702904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702916] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.702927] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.702939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77736 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.702951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.702964] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.702975] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.702986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77744 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703016] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703027] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77752 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703064] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703075] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77760 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703113] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703123] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77768 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703160] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703171] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77776 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703208] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703219] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77784 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703263] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703275] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77792 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703319] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703331] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77800 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703368] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703379] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77808 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703422] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703433] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77816 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703470] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703481] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77824 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703519] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703529] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77832 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703566] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703577] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77840 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703614] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703624] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77848 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703660] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703671] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77856 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703708] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703719] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77864 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703760] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703771] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77872 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703809] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703820] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77880 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703856] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703867] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77888 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703902] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703913] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77896 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703949] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.703960] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.703971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77904 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.703984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.703996] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.704007] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.704018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77912 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.704030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.704043] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.704054] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.704065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77920 len:8 PRP1 0x0 PRP2 0x0 00:18:44.810 [2024-04-27 03:29:54.704078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.810 [2024-04-27 03:29:54.704090] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.810 [2024-04-27 03:29:54.704101] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.810 [2024-04-27 03:29:54.704112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77928 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704141] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.811 [2024-04-27 03:29:54.704153] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.811 [2024-04-27 03:29:54.704164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77936 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704190] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.811 [2024-04-27 03:29:54.704201] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.811 [2024-04-27 03:29:54.704212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77944 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704237] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.811 [2024-04-27 03:29:54.704256] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.811 [2024-04-27 03:29:54.704269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77952 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704294] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.811 [2024-04-27 03:29:54.704305] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.811 [2024-04-27 03:29:54.704316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77960 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704342] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.811 [2024-04-27 03:29:54.704353] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.811 [2024-04-27 03:29:54.704364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77968 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704389] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.811 [2024-04-27 03:29:54.704400] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.811 [2024-04-27 03:29:54.704410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77976 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704435] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.811 [2024-04-27 03:29:54.704446] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.811 [2024-04-27 03:29:54.704457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77984 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704482] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.811 [2024-04-27 03:29:54.704493] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.811 [2024-04-27 03:29:54.704511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77992 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704538] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.811 [2024-04-27 03:29:54.704548] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.811 [2024-04-27 03:29:54.704559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:77288 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704585] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.811 [2024-04-27 03:29:54.704596] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.811 [2024-04-27 03:29:54.704607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:77296 len:8 PRP1 0x0 PRP2 0x0 00:18:44.811 [2024-04-27 03:29:54.704619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704683] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1aca040 was disconnected and freed. reset controller. 00:18:44.811 [2024-04-27 03:29:54.704703] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:18:44.811 [2024-04-27 03:29:54.704734] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.811 [2024-04-27 03:29:54.704752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704767] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.811 [2024-04-27 03:29:54.704780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704794] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.811 [2024-04-27 03:29:54.704807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704821] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.811 [2024-04-27 03:29:54.704833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:54.704846] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:44.811 [2024-04-27 03:29:54.704894] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1aab520 (9): Bad file descriptor 00:18:44.811 [2024-04-27 03:29:54.708082] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:44.811 [2024-04-27 03:29:54.739173] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:44.811 [2024-04-27 03:29:58.457309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:78840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:78848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:78856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:78864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:78872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:78880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:78888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:78896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:78904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:78912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:78920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.811 [2024-04-27 03:29:58.457703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.811 [2024-04-27 03:29:58.457719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:78928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.457732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.457747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:78936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.457775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.457791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:78944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.457804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.457819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:78952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.457832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.457852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:78960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.457866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.457881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:78968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.457895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.457910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:78976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.457923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.457938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:78984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.457951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.457965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:78992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.457978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.457993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:79000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:79008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:79016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:79024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:79032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:79040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:79048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:79056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:79064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:79072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:79080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:79088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:79096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:79104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:79112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:79120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:79128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:79136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:79144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:79152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:79160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:79168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:79176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:79184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:79192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:79200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:79208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.812 [2024-04-27 03:29:58.458874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.812 [2024-04-27 03:29:58.458889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:79216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.813 [2024-04-27 03:29:58.458902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.458917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:79224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.813 [2024-04-27 03:29:58.458930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.458962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:79232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.813 [2024-04-27 03:29:58.458976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.458991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:79240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.813 [2024-04-27 03:29:58.459005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:79248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.813 [2024-04-27 03:29:58.459034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:79256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.813 [2024-04-27 03:29:58.459066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:79328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:79336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:79344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:79352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:79360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:79368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:79376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:79384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:79392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:79400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:79408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:79416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:79424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:79432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:79440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:79448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:79456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:79464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:79472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:79480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:79488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:79264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.813 [2024-04-27 03:29:58.459784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:79496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:79504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:79512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:79520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:79528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:79536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.459977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:79544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.459991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.460006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:79552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.460020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.460035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:79560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.460050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.460065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:79568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.460079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.460094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:79576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.460108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.460123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:79584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.460137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.460152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:79592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.460166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.460181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:79600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.460195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.460210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:79608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.460224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.813 [2024-04-27 03:29:58.460239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:79616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.813 [2024-04-27 03:29:58.460265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:79624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:79632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:79640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:79648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:79656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:79664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:79672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:79680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:79688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:79704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:79712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:79720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:79728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:79736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:79744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.814 [2024-04-27 03:29:58.460742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460772] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.460789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79752 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.460803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460820] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.460832] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.460843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79760 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.460856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460869] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.460880] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.460891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79768 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.460904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460922] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.460933] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.460944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79776 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.460957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.460970] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.460981] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.460992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79784 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.461004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.461017] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.461028] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.461043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79792 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.461056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.461069] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.461080] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.461092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79800 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.461104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.461117] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.461128] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.461139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79808 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.461152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.461167] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.461179] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.461190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79816 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.461203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.461216] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.461228] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.461239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79824 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.461263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.461278] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.461289] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.461301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79832 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.461314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.461332] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.461344] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.461356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79840 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.461370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.461383] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.461394] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.461405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79848 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.461418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.461431] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.814 [2024-04-27 03:29:58.461446] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.814 [2024-04-27 03:29:58.461458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79856 len:8 PRP1 0x0 PRP2 0x0 00:18:44.814 [2024-04-27 03:29:58.461471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.814 [2024-04-27 03:29:58.461484] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.815 [2024-04-27 03:29:58.461495] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.815 [2024-04-27 03:29:58.461507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:79272 len:8 PRP1 0x0 PRP2 0x0 00:18:44.815 [2024-04-27 03:29:58.461519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.461533] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.815 [2024-04-27 03:29:58.461544] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.815 [2024-04-27 03:29:58.461556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:79280 len:8 PRP1 0x0 PRP2 0x0 00:18:44.815 [2024-04-27 03:29:58.461569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.461582] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.815 [2024-04-27 03:29:58.461594] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.815 [2024-04-27 03:29:58.461606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:79288 len:8 PRP1 0x0 PRP2 0x0 00:18:44.815 [2024-04-27 03:29:58.461629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.461650] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.815 [2024-04-27 03:29:58.461662] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.815 [2024-04-27 03:29:58.461685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:79296 len:8 PRP1 0x0 PRP2 0x0 00:18:44.815 [2024-04-27 03:29:58.461713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.461727] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.815 [2024-04-27 03:29:58.461739] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.815 [2024-04-27 03:29:58.461751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:79304 len:8 PRP1 0x0 PRP2 0x0 00:18:44.815 [2024-04-27 03:29:58.461763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.461777] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.815 [2024-04-27 03:29:58.461789] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.815 [2024-04-27 03:29:58.461802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:79312 len:8 PRP1 0x0 PRP2 0x0 00:18:44.815 [2024-04-27 03:29:58.461815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.461828] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.815 [2024-04-27 03:29:58.461840] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.815 [2024-04-27 03:29:58.461851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:79320 len:8 PRP1 0x0 PRP2 0x0 00:18:44.815 [2024-04-27 03:29:58.461864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.461929] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ab7a10 was disconnected and freed. reset controller. 00:18:44.815 [2024-04-27 03:29:58.461949] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:18:44.815 [2024-04-27 03:29:58.461981] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.815 [2024-04-27 03:29:58.462007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.462022] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.815 [2024-04-27 03:29:58.462036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.462050] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.815 [2024-04-27 03:29:58.462072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.462085] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.815 [2024-04-27 03:29:58.462098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:29:58.462117] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:44.815 [2024-04-27 03:29:58.465410] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:44.815 [2024-04-27 03:29:58.465449] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1aab520 (9): Bad file descriptor 00:18:44.815 [2024-04-27 03:29:58.538351] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:44.815 [2024-04-27 03:30:03.029846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:12856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.029887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.029914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:12864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.029930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.029947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:12872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.029961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.029976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:12880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.029990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:12888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:12896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:12904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:12912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:12920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:12928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:12936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:12944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:12968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:12976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:12984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:12992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:13008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:13016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:13032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:13040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:13048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.815 [2024-04-27 03:30:03.030653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.815 [2024-04-27 03:30:03.030667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:13056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:13064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:13072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:13080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:13088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:13096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:13104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:13112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:13120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:13128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:13136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.030973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.030988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:13144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.031001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.031030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:44.816 [2024-04-27 03:30:03.031058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:13184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:13192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:13200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:13208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:13216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:13224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:13232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:13240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:13248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:13256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:13264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:13272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:13280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:13288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:13296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:13304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:13312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:13328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:13336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:13344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:13352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:13360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:13368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.816 [2024-04-27 03:30:03.031816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.816 [2024-04-27 03:30:03.031830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.031845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:13384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.031859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.031874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:13392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.031888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.031903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:13400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.031916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.031931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:13408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.031945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.031959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:13416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.031973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.031991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:13424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:13432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:13440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:13448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:13456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:13464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:13472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:13480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:13488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:13496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:13504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:13512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:13520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:13528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:13536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:13544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:13552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:13560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:44.817 [2024-04-27 03:30:03.032540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032578] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.032595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13568 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.032609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032627] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.032639] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.032650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13576 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.032663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032677] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.032688] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.032699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13584 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.032712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032725] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.032736] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.032747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13592 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.032759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032772] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.032783] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.032794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13600 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.032811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032825] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.032836] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.032847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13608 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.032860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032873] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.032884] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.032895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13616 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.032908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032920] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.032931] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.032942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13624 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.032955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.032968] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.032978] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.032993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13632 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.033007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.033020] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.033032] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.033043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13640 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.033056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.033069] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.033081] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.033093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13648 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.033106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.033119] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.033131] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.033143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13656 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.033156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.033169] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.033180] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.033196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13664 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.033209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.033223] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.817 [2024-04-27 03:30:03.033234] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.817 [2024-04-27 03:30:03.033252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13672 len:8 PRP1 0x0 PRP2 0x0 00:18:44.817 [2024-04-27 03:30:03.033267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.817 [2024-04-27 03:30:03.033281] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033293] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13680 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033332] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033344] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13688 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033382] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033393] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13696 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033431] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033442] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13704 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033481] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033492] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13712 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033534] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033545] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13720 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033583] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033605] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13728 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033643] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033655] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13736 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033692] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033702] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13744 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033739] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033750] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13752 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033786] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033797] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13760 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033833] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033843] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13768 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033880] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033890] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13776 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033934] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033945] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.033956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13784 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.033968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.033985] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.033997] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13792 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034034] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034045] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13800 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034082] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034092] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13808 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034129] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034140] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13816 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034176] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034187] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13824 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034224] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034235] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13832 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034278] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034291] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13840 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034333] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034345] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13848 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034385] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034396] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13856 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034433] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034444] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13864 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034480] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034491] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13872 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034528] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034539] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13168 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034576] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:44.818 [2024-04-27 03:30:03.034587] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:44.818 [2024-04-27 03:30:03.034599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13176 len:8 PRP1 0x0 PRP2 0x0 00:18:44.818 [2024-04-27 03:30:03.034611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034677] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ad7de0 was disconnected and freed. reset controller. 00:18:44.818 [2024-04-27 03:30:03.034697] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:18:44.818 [2024-04-27 03:30:03.034730] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.818 [2024-04-27 03:30:03.034747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034762] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.818 [2024-04-27 03:30:03.034775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.818 [2024-04-27 03:30:03.034789] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.819 [2024-04-27 03:30:03.034802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.819 [2024-04-27 03:30:03.034820] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.819 [2024-04-27 03:30:03.034834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.819 [2024-04-27 03:30:03.034847] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:44.819 [2024-04-27 03:30:03.038052] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:44.819 [2024-04-27 03:30:03.038091] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1aab520 (9): Bad file descriptor 00:18:44.819 [2024-04-27 03:30:03.072348] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:44.819 00:18:44.819 Latency(us) 00:18:44.819 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:44.819 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:18:44.819 Verification LBA range: start 0x0 length 0x4000 00:18:44.819 NVMe0n1 : 15.06 8206.42 32.06 337.20 0.00 14914.03 567.37 43884.85 00:18:44.819 =================================================================================================================== 00:18:44.819 Total : 8206.42 32.06 337.20 0.00 14914.03 567.37 43884.85 00:18:44.819 Received shutdown signal, test time was about 15.000000 seconds 00:18:44.819 00:18:44.819 Latency(us) 00:18:44.819 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:44.819 =================================================================================================================== 00:18:44.819 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:44.819 03:30:08 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:18:44.819 03:30:08 -- host/failover.sh@65 -- # count=3 00:18:44.819 03:30:08 -- host/failover.sh@67 -- # (( count != 3 )) 00:18:44.819 03:30:08 -- host/failover.sh@73 -- # bdevperf_pid=1498001 00:18:44.819 03:30:08 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:18:44.819 03:30:08 -- host/failover.sh@75 -- # waitforlisten 1498001 /var/tmp/bdevperf.sock 00:18:44.819 03:30:08 -- common/autotest_common.sh@817 -- # '[' -z 1498001 ']' 00:18:44.819 03:30:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:44.819 03:30:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:44.819 03:30:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:44.819 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:44.819 03:30:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:44.819 03:30:08 -- common/autotest_common.sh@10 -- # set +x 00:18:44.819 03:30:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:44.819 03:30:09 -- common/autotest_common.sh@850 -- # return 0 00:18:44.819 03:30:09 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:44.819 [2024-04-27 03:30:09.485152] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:18:44.819 03:30:09 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:18:44.819 [2024-04-27 03:30:09.721773] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:18:44.819 03:30:09 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:45.385 NVMe0n1 00:18:45.385 03:30:10 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:45.643 00:18:45.643 03:30:10 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:45.901 00:18:45.901 03:30:10 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:18:45.901 03:30:10 -- host/failover.sh@82 -- # grep -q NVMe0 00:18:46.159 03:30:11 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:46.418 03:30:11 -- host/failover.sh@87 -- # sleep 3 00:18:49.705 03:30:14 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:18:49.705 03:30:14 -- host/failover.sh@88 -- # grep -q NVMe0 00:18:49.705 03:30:14 -- host/failover.sh@90 -- # run_test_pid=1498813 00:18:49.705 03:30:14 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:49.705 03:30:14 -- host/failover.sh@92 -- # wait 1498813 00:18:51.082 0 00:18:51.082 03:30:15 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:18:51.082 [2024-04-27 03:30:08.983572] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:18:51.082 [2024-04-27 03:30:08.983677] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1498001 ] 00:18:51.082 EAL: No free 2048 kB hugepages reported on node 1 00:18:51.082 [2024-04-27 03:30:09.047608] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:51.082 [2024-04-27 03:30:09.150877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:51.082 [2024-04-27 03:30:11.343688] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:18:51.082 [2024-04-27 03:30:11.343770] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:18:51.082 [2024-04-27 03:30:11.343792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:51.082 [2024-04-27 03:30:11.343823] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:51.082 [2024-04-27 03:30:11.343838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:51.082 [2024-04-27 03:30:11.343852] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:51.082 [2024-04-27 03:30:11.343865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:51.082 [2024-04-27 03:30:11.343878] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:51.082 [2024-04-27 03:30:11.343892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:51.082 [2024-04-27 03:30:11.343905] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:51.082 [2024-04-27 03:30:11.343962] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:51.082 [2024-04-27 03:30:11.343998] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2254520 (9): Bad file descriptor 00:18:51.082 [2024-04-27 03:30:11.355716] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:51.082 Running I/O for 1 seconds... 00:18:51.082 00:18:51.082 Latency(us) 00:18:51.082 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:51.082 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:18:51.082 Verification LBA range: start 0x0 length 0x4000 00:18:51.082 NVMe0n1 : 1.00 8296.26 32.41 0.00 0.00 15363.84 1796.17 13592.65 00:18:51.082 =================================================================================================================== 00:18:51.082 Total : 8296.26 32.41 0.00 0.00 15363.84 1796.17 13592.65 00:18:51.082 03:30:15 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:18:51.082 03:30:15 -- host/failover.sh@95 -- # grep -q NVMe0 00:18:51.082 03:30:16 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:51.649 03:30:16 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:18:51.649 03:30:16 -- host/failover.sh@99 -- # grep -q NVMe0 00:18:51.649 03:30:16 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:51.906 03:30:16 -- host/failover.sh@101 -- # sleep 3 00:18:55.198 03:30:19 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:18:55.199 03:30:19 -- host/failover.sh@103 -- # grep -q NVMe0 00:18:55.199 03:30:20 -- host/failover.sh@108 -- # killprocess 1498001 00:18:55.199 03:30:20 -- common/autotest_common.sh@936 -- # '[' -z 1498001 ']' 00:18:55.199 03:30:20 -- common/autotest_common.sh@940 -- # kill -0 1498001 00:18:55.199 03:30:20 -- common/autotest_common.sh@941 -- # uname 00:18:55.199 03:30:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:55.199 03:30:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1498001 00:18:55.199 03:30:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:55.199 03:30:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:55.199 03:30:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1498001' 00:18:55.199 killing process with pid 1498001 00:18:55.199 03:30:20 -- common/autotest_common.sh@955 -- # kill 1498001 00:18:55.199 03:30:20 -- common/autotest_common.sh@960 -- # wait 1498001 00:18:55.456 03:30:20 -- host/failover.sh@110 -- # sync 00:18:55.456 03:30:20 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:55.714 03:30:20 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:18:55.714 03:30:20 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:18:55.714 03:30:20 -- host/failover.sh@116 -- # nvmftestfini 00:18:55.714 03:30:20 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:55.714 03:30:20 -- nvmf/common.sh@117 -- # sync 00:18:55.714 03:30:20 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:18:55.714 03:30:20 -- nvmf/common.sh@120 -- # set +e 00:18:55.714 03:30:20 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:55.714 03:30:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:18:55.714 rmmod nvme_tcp 00:18:55.714 rmmod nvme_fabrics 00:18:55.714 rmmod nvme_keyring 00:18:55.714 03:30:20 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:55.714 03:30:20 -- nvmf/common.sh@124 -- # set -e 00:18:55.714 03:30:20 -- nvmf/common.sh@125 -- # return 0 00:18:55.714 03:30:20 -- nvmf/common.sh@478 -- # '[' -n 1495268 ']' 00:18:55.714 03:30:20 -- nvmf/common.sh@479 -- # killprocess 1495268 00:18:55.714 03:30:20 -- common/autotest_common.sh@936 -- # '[' -z 1495268 ']' 00:18:55.714 03:30:20 -- common/autotest_common.sh@940 -- # kill -0 1495268 00:18:55.714 03:30:20 -- common/autotest_common.sh@941 -- # uname 00:18:55.714 03:30:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:55.714 03:30:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1495268 00:18:55.974 03:30:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:55.974 03:30:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:55.974 03:30:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1495268' 00:18:55.974 killing process with pid 1495268 00:18:55.974 03:30:20 -- common/autotest_common.sh@955 -- # kill 1495268 00:18:55.974 03:30:20 -- common/autotest_common.sh@960 -- # wait 1495268 00:18:56.233 03:30:21 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:56.233 03:30:21 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:18:56.233 03:30:21 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:18:56.233 03:30:21 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:56.233 03:30:21 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:18:56.233 03:30:21 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:56.233 03:30:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:56.233 03:30:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:58.170 03:30:23 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:18:58.170 00:18:58.170 real 0m34.846s 00:18:58.170 user 2m1.165s 00:18:58.170 sys 0m6.548s 00:18:58.170 03:30:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:58.170 03:30:23 -- common/autotest_common.sh@10 -- # set +x 00:18:58.170 ************************************ 00:18:58.170 END TEST nvmf_failover 00:18:58.170 ************************************ 00:18:58.170 03:30:23 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:18:58.170 03:30:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:58.170 03:30:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:58.170 03:30:23 -- common/autotest_common.sh@10 -- # set +x 00:18:58.428 ************************************ 00:18:58.428 START TEST nvmf_discovery 00:18:58.428 ************************************ 00:18:58.428 03:30:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:18:58.428 * Looking for test storage... 00:18:58.428 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:18:58.428 03:30:23 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:58.428 03:30:23 -- nvmf/common.sh@7 -- # uname -s 00:18:58.428 03:30:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:58.428 03:30:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:58.428 03:30:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:58.428 03:30:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:58.428 03:30:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:58.428 03:30:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:58.428 03:30:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:58.428 03:30:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:58.428 03:30:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:58.428 03:30:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:58.428 03:30:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:18:58.428 03:30:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:18:58.428 03:30:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:58.428 03:30:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:58.428 03:30:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:58.428 03:30:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:58.428 03:30:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:58.428 03:30:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:58.428 03:30:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:58.428 03:30:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:58.428 03:30:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:58.428 03:30:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:58.428 03:30:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:58.428 03:30:23 -- paths/export.sh@5 -- # export PATH 00:18:58.428 03:30:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:58.428 03:30:23 -- nvmf/common.sh@47 -- # : 0 00:18:58.428 03:30:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:58.428 03:30:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:58.428 03:30:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:58.428 03:30:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:58.428 03:30:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:58.428 03:30:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:58.428 03:30:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:58.428 03:30:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:58.428 03:30:23 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:18:58.428 03:30:23 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:18:58.428 03:30:23 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:18:58.428 03:30:23 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:18:58.428 03:30:23 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:18:58.428 03:30:23 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:18:58.428 03:30:23 -- host/discovery.sh@25 -- # nvmftestinit 00:18:58.428 03:30:23 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:18:58.428 03:30:23 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:58.428 03:30:23 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:58.428 03:30:23 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:58.428 03:30:23 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:58.428 03:30:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:58.428 03:30:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:58.428 03:30:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:58.428 03:30:23 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:58.428 03:30:23 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:58.428 03:30:23 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:58.428 03:30:23 -- common/autotest_common.sh@10 -- # set +x 00:19:00.330 03:30:25 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:00.330 03:30:25 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:00.330 03:30:25 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:00.330 03:30:25 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:00.330 03:30:25 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:00.330 03:30:25 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:00.330 03:30:25 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:00.330 03:30:25 -- nvmf/common.sh@295 -- # net_devs=() 00:19:00.330 03:30:25 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:00.330 03:30:25 -- nvmf/common.sh@296 -- # e810=() 00:19:00.330 03:30:25 -- nvmf/common.sh@296 -- # local -ga e810 00:19:00.330 03:30:25 -- nvmf/common.sh@297 -- # x722=() 00:19:00.330 03:30:25 -- nvmf/common.sh@297 -- # local -ga x722 00:19:00.330 03:30:25 -- nvmf/common.sh@298 -- # mlx=() 00:19:00.330 03:30:25 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:00.330 03:30:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:00.330 03:30:25 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:00.330 03:30:25 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:00.330 03:30:25 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:00.330 03:30:25 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:00.330 03:30:25 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:00.330 03:30:25 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:00.331 03:30:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:00.331 03:30:25 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:00.331 03:30:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:00.331 03:30:25 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:00.331 03:30:25 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:00.331 03:30:25 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:00.331 03:30:25 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:00.331 03:30:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:00.331 03:30:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:19:00.331 Found 0000:09:00.0 (0x8086 - 0x159b) 00:19:00.331 03:30:25 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:00.331 03:30:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:19:00.331 Found 0000:09:00.1 (0x8086 - 0x159b) 00:19:00.331 03:30:25 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:00.331 03:30:25 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:00.331 03:30:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:00.331 03:30:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:00.331 03:30:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:00.331 03:30:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:19:00.331 Found net devices under 0000:09:00.0: cvl_0_0 00:19:00.331 03:30:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:00.331 03:30:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:00.331 03:30:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:00.331 03:30:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:00.331 03:30:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:00.331 03:30:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:19:00.331 Found net devices under 0000:09:00.1: cvl_0_1 00:19:00.331 03:30:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:00.331 03:30:25 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:00.331 03:30:25 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:00.331 03:30:25 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:19:00.331 03:30:25 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:19:00.331 03:30:25 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:00.331 03:30:25 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:00.331 03:30:25 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:00.331 03:30:25 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:19:00.331 03:30:25 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:00.331 03:30:25 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:00.331 03:30:25 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:19:00.331 03:30:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:00.331 03:30:25 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:00.331 03:30:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:19:00.331 03:30:25 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:19:00.331 03:30:25 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:19:00.331 03:30:25 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:00.331 03:30:25 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:00.331 03:30:25 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:00.331 03:30:25 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:19:00.331 03:30:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:00.591 03:30:25 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:00.591 03:30:25 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:00.591 03:30:25 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:19:00.591 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:00.591 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.162 ms 00:19:00.591 00:19:00.591 --- 10.0.0.2 ping statistics --- 00:19:00.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:00.591 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:19:00.591 03:30:25 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:00.591 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:00.591 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:19:00.591 00:19:00.591 --- 10.0.0.1 ping statistics --- 00:19:00.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:00.591 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:19:00.591 03:30:25 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:00.591 03:30:25 -- nvmf/common.sh@411 -- # return 0 00:19:00.591 03:30:25 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:00.591 03:30:25 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:00.591 03:30:25 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:19:00.591 03:30:25 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:19:00.591 03:30:25 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:00.591 03:30:25 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:19:00.591 03:30:25 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:19:00.591 03:30:25 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:19:00.591 03:30:25 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:00.591 03:30:25 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:00.591 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.591 03:30:25 -- nvmf/common.sh@470 -- # nvmfpid=1501440 00:19:00.591 03:30:25 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:00.591 03:30:25 -- nvmf/common.sh@471 -- # waitforlisten 1501440 00:19:00.591 03:30:25 -- common/autotest_common.sh@817 -- # '[' -z 1501440 ']' 00:19:00.591 03:30:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:00.591 03:30:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:00.591 03:30:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:00.591 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:00.591 03:30:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:00.591 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.591 [2024-04-27 03:30:25.416228] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:19:00.591 [2024-04-27 03:30:25.416320] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:00.591 EAL: No free 2048 kB hugepages reported on node 1 00:19:00.591 [2024-04-27 03:30:25.480434] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:00.850 [2024-04-27 03:30:25.587852] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:00.850 [2024-04-27 03:30:25.587923] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:00.850 [2024-04-27 03:30:25.587937] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:00.850 [2024-04-27 03:30:25.587948] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:00.850 [2024-04-27 03:30:25.587958] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:00.850 [2024-04-27 03:30:25.587989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:00.850 03:30:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:00.850 03:30:25 -- common/autotest_common.sh@850 -- # return 0 00:19:00.850 03:30:25 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:00.850 03:30:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:00.850 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.850 03:30:25 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:00.850 03:30:25 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:00.850 03:30:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.850 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.850 [2024-04-27 03:30:25.741203] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:00.850 03:30:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.850 03:30:25 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:19:00.850 03:30:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.850 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.850 [2024-04-27 03:30:25.749447] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:19:00.850 03:30:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.850 03:30:25 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:19:00.850 03:30:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.850 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.850 null0 00:19:00.850 03:30:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.850 03:30:25 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:19:00.850 03:30:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.850 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.850 null1 00:19:00.850 03:30:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.850 03:30:25 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:19:00.850 03:30:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.850 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.850 03:30:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.850 03:30:25 -- host/discovery.sh@45 -- # hostpid=1501462 00:19:00.850 03:30:25 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:19:00.850 03:30:25 -- host/discovery.sh@46 -- # waitforlisten 1501462 /tmp/host.sock 00:19:00.850 03:30:25 -- common/autotest_common.sh@817 -- # '[' -z 1501462 ']' 00:19:00.850 03:30:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/tmp/host.sock 00:19:00.850 03:30:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:00.850 03:30:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:19:00.850 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:19:00.850 03:30:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:00.850 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:00.850 [2024-04-27 03:30:25.821553] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:19:00.850 [2024-04-27 03:30:25.821620] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1501462 ] 00:19:01.109 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.109 [2024-04-27 03:30:25.887179] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:01.109 [2024-04-27 03:30:26.001302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:01.368 03:30:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:01.368 03:30:26 -- common/autotest_common.sh@850 -- # return 0 00:19:01.368 03:30:26 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:01.368 03:30:26 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:19:01.368 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.368 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.368 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.368 03:30:26 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:19:01.368 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.368 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.368 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.368 03:30:26 -- host/discovery.sh@72 -- # notify_id=0 00:19:01.368 03:30:26 -- host/discovery.sh@83 -- # get_subsystem_names 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:19:01.368 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.368 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # sort 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # xargs 00:19:01.368 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.368 03:30:26 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:19:01.368 03:30:26 -- host/discovery.sh@84 -- # get_bdev_list 00:19:01.368 03:30:26 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:01.368 03:30:26 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:01.368 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.368 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.368 03:30:26 -- host/discovery.sh@55 -- # sort 00:19:01.368 03:30:26 -- host/discovery.sh@55 -- # xargs 00:19:01.368 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.368 03:30:26 -- host/discovery.sh@84 -- # [[ '' == '' ]] 00:19:01.368 03:30:26 -- host/discovery.sh@86 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:19:01.368 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.368 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.368 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.368 03:30:26 -- host/discovery.sh@87 -- # get_subsystem_names 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:19:01.368 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.368 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # sort 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # xargs 00:19:01.368 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.368 03:30:26 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:19:01.368 03:30:26 -- host/discovery.sh@88 -- # get_bdev_list 00:19:01.368 03:30:26 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:01.368 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.368 03:30:26 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:01.368 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.368 03:30:26 -- host/discovery.sh@55 -- # sort 00:19:01.368 03:30:26 -- host/discovery.sh@55 -- # xargs 00:19:01.368 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.368 03:30:26 -- host/discovery.sh@88 -- # [[ '' == '' ]] 00:19:01.368 03:30:26 -- host/discovery.sh@90 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:19:01.368 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.368 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.368 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.368 03:30:26 -- host/discovery.sh@91 -- # get_subsystem_names 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:19:01.368 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:19:01.368 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # sort 00:19:01.368 03:30:26 -- host/discovery.sh@59 -- # xargs 00:19:01.627 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.627 03:30:26 -- host/discovery.sh@91 -- # [[ '' == '' ]] 00:19:01.627 03:30:26 -- host/discovery.sh@92 -- # get_bdev_list 00:19:01.627 03:30:26 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:01.627 03:30:26 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:01.627 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.627 03:30:26 -- host/discovery.sh@55 -- # sort 00:19:01.627 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.627 03:30:26 -- host/discovery.sh@55 -- # xargs 00:19:01.627 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.627 03:30:26 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:19:01.627 03:30:26 -- host/discovery.sh@96 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:19:01.627 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.627 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.627 [2024-04-27 03:30:26.427204] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:01.627 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.627 03:30:26 -- host/discovery.sh@97 -- # get_subsystem_names 00:19:01.627 03:30:26 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:19:01.627 03:30:26 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:19:01.627 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.627 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.627 03:30:26 -- host/discovery.sh@59 -- # sort 00:19:01.627 03:30:26 -- host/discovery.sh@59 -- # xargs 00:19:01.627 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.627 03:30:26 -- host/discovery.sh@97 -- # [[ '' == '' ]] 00:19:01.627 03:30:26 -- host/discovery.sh@98 -- # get_bdev_list 00:19:01.627 03:30:26 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:01.627 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.627 03:30:26 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:01.627 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.627 03:30:26 -- host/discovery.sh@55 -- # sort 00:19:01.627 03:30:26 -- host/discovery.sh@55 -- # xargs 00:19:01.627 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.627 03:30:26 -- host/discovery.sh@98 -- # [[ '' == '' ]] 00:19:01.627 03:30:26 -- host/discovery.sh@99 -- # is_notification_count_eq 0 00:19:01.627 03:30:26 -- host/discovery.sh@79 -- # expected_count=0 00:19:01.627 03:30:26 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:19:01.627 03:30:26 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:19:01.627 03:30:26 -- common/autotest_common.sh@901 -- # local max=10 00:19:01.627 03:30:26 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:01.627 03:30:26 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:19:01.627 03:30:26 -- common/autotest_common.sh@903 -- # get_notification_count 00:19:01.627 03:30:26 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:19:01.627 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.627 03:30:26 -- host/discovery.sh@74 -- # jq '. | length' 00:19:01.627 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.627 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.628 03:30:26 -- host/discovery.sh@74 -- # notification_count=0 00:19:01.628 03:30:26 -- host/discovery.sh@75 -- # notify_id=0 00:19:01.628 03:30:26 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:19:01.628 03:30:26 -- common/autotest_common.sh@904 -- # return 0 00:19:01.628 03:30:26 -- host/discovery.sh@103 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:19:01.628 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.628 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.628 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.628 03:30:26 -- host/discovery.sh@105 -- # waitforcondition '[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:19:01.628 03:30:26 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:19:01.628 03:30:26 -- common/autotest_common.sh@901 -- # local max=10 00:19:01.628 03:30:26 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:01.628 03:30:26 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_names)"' == '"nvme0"' ']]' 00:19:01.628 03:30:26 -- common/autotest_common.sh@903 -- # get_subsystem_names 00:19:01.628 03:30:26 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:19:01.628 03:30:26 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:19:01.628 03:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:01.628 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:19:01.628 03:30:26 -- host/discovery.sh@59 -- # sort 00:19:01.628 03:30:26 -- host/discovery.sh@59 -- # xargs 00:19:01.628 03:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:01.887 03:30:26 -- common/autotest_common.sh@903 -- # [[ '' == \n\v\m\e\0 ]] 00:19:01.887 03:30:26 -- common/autotest_common.sh@906 -- # sleep 1 00:19:02.457 [2024-04-27 03:30:27.188962] bdev_nvme.c:6923:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:19:02.457 [2024-04-27 03:30:27.188997] bdev_nvme.c:7003:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:19:02.457 [2024-04-27 03:30:27.189018] bdev_nvme.c:6886:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:19:02.457 [2024-04-27 03:30:27.316468] bdev_nvme.c:6852:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:19:02.457 [2024-04-27 03:30:27.420196] bdev_nvme.c:6742:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:19:02.457 [2024-04-27 03:30:27.420224] bdev_nvme.c:6701:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:19:02.716 03:30:27 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:02.716 03:30:27 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_names)"' == '"nvme0"' ']]' 00:19:02.716 03:30:27 -- common/autotest_common.sh@903 -- # get_subsystem_names 00:19:02.716 03:30:27 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:19:02.716 03:30:27 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:19:02.716 03:30:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.716 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:19:02.716 03:30:27 -- host/discovery.sh@59 -- # sort 00:19:02.716 03:30:27 -- host/discovery.sh@59 -- # xargs 00:19:02.716 03:30:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.716 03:30:27 -- common/autotest_common.sh@903 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:02.716 03:30:27 -- common/autotest_common.sh@904 -- # return 0 00:19:02.716 03:30:27 -- host/discovery.sh@106 -- # waitforcondition '[[ "$(get_bdev_list)" == "nvme0n1" ]]' 00:19:02.716 03:30:27 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_bdev_list)" == "nvme0n1" ]]' 00:19:02.716 03:30:27 -- common/autotest_common.sh@901 -- # local max=10 00:19:02.716 03:30:27 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:02.716 03:30:27 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_bdev_list)"' == '"nvme0n1"' ']]' 00:19:02.716 03:30:27 -- common/autotest_common.sh@903 -- # get_bdev_list 00:19:02.716 03:30:27 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:02.716 03:30:27 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:02.716 03:30:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.716 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:19:02.716 03:30:27 -- host/discovery.sh@55 -- # sort 00:19:02.716 03:30:27 -- host/discovery.sh@55 -- # xargs 00:19:02.716 03:30:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.974 03:30:27 -- common/autotest_common.sh@903 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:19:02.974 03:30:27 -- common/autotest_common.sh@904 -- # return 0 00:19:02.974 03:30:27 -- host/discovery.sh@107 -- # waitforcondition '[[ "$(get_subsystem_paths nvme0)" == "$NVMF_PORT" ]]' 00:19:02.974 03:30:27 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_paths nvme0)" == "$NVMF_PORT" ]]' 00:19:02.974 03:30:27 -- common/autotest_common.sh@901 -- # local max=10 00:19:02.974 03:30:27 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:02.974 03:30:27 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_paths' 'nvme0)"' == '"$NVMF_PORT"' ']]' 00:19:02.974 03:30:27 -- common/autotest_common.sh@903 -- # get_subsystem_paths nvme0 00:19:02.974 03:30:27 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:19:02.974 03:30:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.974 03:30:27 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:19:02.974 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:19:02.974 03:30:27 -- host/discovery.sh@63 -- # sort -n 00:19:02.974 03:30:27 -- host/discovery.sh@63 -- # xargs 00:19:02.974 03:30:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.974 03:30:27 -- common/autotest_common.sh@903 -- # [[ 4420 == \4\4\2\0 ]] 00:19:02.974 03:30:27 -- common/autotest_common.sh@904 -- # return 0 00:19:02.974 03:30:27 -- host/discovery.sh@108 -- # is_notification_count_eq 1 00:19:02.974 03:30:27 -- host/discovery.sh@79 -- # expected_count=1 00:19:02.974 03:30:27 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:19:02.974 03:30:27 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:19:02.974 03:30:27 -- common/autotest_common.sh@901 -- # local max=10 00:19:02.974 03:30:27 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:02.974 03:30:27 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:19:02.974 03:30:27 -- common/autotest_common.sh@903 -- # get_notification_count 00:19:02.974 03:30:27 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:19:02.974 03:30:27 -- host/discovery.sh@74 -- # jq '. | length' 00:19:02.974 03:30:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.974 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:19:02.974 03:30:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.974 03:30:27 -- host/discovery.sh@74 -- # notification_count=1 00:19:02.974 03:30:27 -- host/discovery.sh@75 -- # notify_id=1 00:19:02.974 03:30:27 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:19:02.974 03:30:27 -- common/autotest_common.sh@904 -- # return 0 00:19:02.974 03:30:27 -- host/discovery.sh@111 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:19:02.974 03:30:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.974 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:19:02.974 03:30:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.974 03:30:27 -- host/discovery.sh@113 -- # waitforcondition '[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:19:02.974 03:30:27 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:19:02.974 03:30:27 -- common/autotest_common.sh@901 -- # local max=10 00:19:02.974 03:30:27 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:02.974 03:30:27 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_bdev_list)"' == '"nvme0n1' 'nvme0n2"' ']]' 00:19:02.974 03:30:27 -- common/autotest_common.sh@903 -- # get_bdev_list 00:19:02.974 03:30:27 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:02.974 03:30:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.974 03:30:27 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:02.974 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:19:02.974 03:30:27 -- host/discovery.sh@55 -- # sort 00:19:02.974 03:30:27 -- host/discovery.sh@55 -- # xargs 00:19:02.975 03:30:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.975 03:30:27 -- common/autotest_common.sh@903 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:19:02.975 03:30:27 -- common/autotest_common.sh@904 -- # return 0 00:19:02.975 03:30:27 -- host/discovery.sh@114 -- # is_notification_count_eq 1 00:19:02.975 03:30:27 -- host/discovery.sh@79 -- # expected_count=1 00:19:02.975 03:30:27 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:19:02.975 03:30:27 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:19:02.975 03:30:27 -- common/autotest_common.sh@901 -- # local max=10 00:19:02.975 03:30:27 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:02.975 03:30:27 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:19:02.975 03:30:27 -- common/autotest_common.sh@903 -- # get_notification_count 00:19:02.975 03:30:27 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:19:02.975 03:30:27 -- host/discovery.sh@74 -- # jq '. | length' 00:19:02.975 03:30:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.975 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:19:03.233 03:30:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.233 03:30:27 -- host/discovery.sh@74 -- # notification_count=1 00:19:03.233 03:30:27 -- host/discovery.sh@75 -- # notify_id=2 00:19:03.233 03:30:27 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:19:03.233 03:30:27 -- common/autotest_common.sh@904 -- # return 0 00:19:03.233 03:30:27 -- host/discovery.sh@118 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:19:03.233 03:30:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:03.233 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:19:03.233 [2024-04-27 03:30:27.992035] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:03.233 [2024-04-27 03:30:27.992705] bdev_nvme.c:6905:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:19:03.233 [2024-04-27 03:30:27.992742] bdev_nvme.c:6886:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:19:03.233 03:30:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.233 03:30:27 -- host/discovery.sh@120 -- # waitforcondition '[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:19:03.233 03:30:27 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:19:03.233 03:30:27 -- common/autotest_common.sh@901 -- # local max=10 00:19:03.233 03:30:27 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:03.233 03:30:27 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_names)"' == '"nvme0"' ']]' 00:19:03.233 03:30:27 -- common/autotest_common.sh@903 -- # get_subsystem_names 00:19:03.233 03:30:27 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:19:03.233 03:30:27 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:19:03.233 03:30:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:03.233 03:30:27 -- host/discovery.sh@59 -- # sort 00:19:03.233 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:19:03.233 03:30:27 -- host/discovery.sh@59 -- # xargs 00:19:03.233 03:30:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.233 03:30:28 -- common/autotest_common.sh@903 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:03.233 03:30:28 -- common/autotest_common.sh@904 -- # return 0 00:19:03.233 03:30:28 -- host/discovery.sh@121 -- # waitforcondition '[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:19:03.233 03:30:28 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:19:03.233 03:30:28 -- common/autotest_common.sh@901 -- # local max=10 00:19:03.233 03:30:28 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:03.233 03:30:28 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_bdev_list)"' == '"nvme0n1' 'nvme0n2"' ']]' 00:19:03.233 03:30:28 -- common/autotest_common.sh@903 -- # get_bdev_list 00:19:03.233 03:30:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:03.233 03:30:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:03.233 03:30:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:03.233 03:30:28 -- common/autotest_common.sh@10 -- # set +x 00:19:03.233 03:30:28 -- host/discovery.sh@55 -- # sort 00:19:03.234 03:30:28 -- host/discovery.sh@55 -- # xargs 00:19:03.234 03:30:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.234 03:30:28 -- common/autotest_common.sh@903 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:19:03.234 03:30:28 -- common/autotest_common.sh@904 -- # return 0 00:19:03.234 03:30:28 -- host/discovery.sh@122 -- # waitforcondition '[[ "$(get_subsystem_paths nvme0)" == "$NVMF_PORT $NVMF_SECOND_PORT" ]]' 00:19:03.234 03:30:28 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_paths nvme0)" == "$NVMF_PORT $NVMF_SECOND_PORT" ]]' 00:19:03.234 03:30:28 -- common/autotest_common.sh@901 -- # local max=10 00:19:03.234 03:30:28 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:03.234 03:30:28 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_paths' 'nvme0)"' == '"$NVMF_PORT' '$NVMF_SECOND_PORT"' ']]' 00:19:03.234 03:30:28 -- common/autotest_common.sh@903 -- # get_subsystem_paths nvme0 00:19:03.234 03:30:28 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:19:03.234 03:30:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:03.234 03:30:28 -- common/autotest_common.sh@10 -- # set +x 00:19:03.234 03:30:28 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:19:03.234 03:30:28 -- host/discovery.sh@63 -- # sort -n 00:19:03.234 03:30:28 -- host/discovery.sh@63 -- # xargs 00:19:03.234 03:30:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.234 [2024-04-27 03:30:28.118535] bdev_nvme.c:6847:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:19:03.234 03:30:28 -- common/autotest_common.sh@903 -- # [[ 4420 == \4\4\2\0\ \4\4\2\1 ]] 00:19:03.234 03:30:28 -- common/autotest_common.sh@906 -- # sleep 1 00:19:03.234 [2024-04-27 03:30:28.183086] bdev_nvme.c:6742:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:19:03.234 [2024-04-27 03:30:28.183112] bdev_nvme.c:6701:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:19:03.234 [2024-04-27 03:30:28.183122] bdev_nvme.c:6701:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:19:04.169 03:30:29 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:04.169 03:30:29 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_paths' 'nvme0)"' == '"$NVMF_PORT' '$NVMF_SECOND_PORT"' ']]' 00:19:04.169 03:30:29 -- common/autotest_common.sh@903 -- # get_subsystem_paths nvme0 00:19:04.169 03:30:29 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:19:04.169 03:30:29 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:19:04.169 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.169 03:30:29 -- host/discovery.sh@63 -- # sort -n 00:19:04.169 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.169 03:30:29 -- host/discovery.sh@63 -- # xargs 00:19:04.169 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.429 03:30:29 -- common/autotest_common.sh@903 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:19:04.429 03:30:29 -- common/autotest_common.sh@904 -- # return 0 00:19:04.429 03:30:29 -- host/discovery.sh@123 -- # is_notification_count_eq 0 00:19:04.429 03:30:29 -- host/discovery.sh@79 -- # expected_count=0 00:19:04.429 03:30:29 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:19:04.429 03:30:29 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:19:04.429 03:30:29 -- common/autotest_common.sh@901 -- # local max=10 00:19:04.429 03:30:29 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:04.429 03:30:29 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:19:04.429 03:30:29 -- common/autotest_common.sh@903 -- # get_notification_count 00:19:04.429 03:30:29 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:19:04.429 03:30:29 -- host/discovery.sh@74 -- # jq '. | length' 00:19:04.429 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.429 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.429 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.429 03:30:29 -- host/discovery.sh@74 -- # notification_count=0 00:19:04.429 03:30:29 -- host/discovery.sh@75 -- # notify_id=2 00:19:04.429 03:30:29 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:19:04.429 03:30:29 -- common/autotest_common.sh@904 -- # return 0 00:19:04.429 03:30:29 -- host/discovery.sh@127 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:19:04.429 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.429 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.429 [2024-04-27 03:30:29.224520] bdev_nvme.c:6905:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:19:04.429 [2024-04-27 03:30:29.224566] bdev_nvme.c:6886:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:19:04.429 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.429 03:30:29 -- host/discovery.sh@129 -- # waitforcondition '[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:19:04.429 03:30:29 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_names)" == "nvme0" ]]' 00:19:04.429 03:30:29 -- common/autotest_common.sh@901 -- # local max=10 00:19:04.429 03:30:29 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:04.429 03:30:29 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_names)"' == '"nvme0"' ']]' 00:19:04.429 [2024-04-27 03:30:29.228868] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:19:04.429 [2024-04-27 03:30:29.228942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:04.429 [2024-04-27 03:30:29.228964] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:04.429 [2024-04-27 03:30:29.228979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:04.429 [2024-04-27 03:30:29.228994] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:04.429 [2024-04-27 03:30:29.229008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:04.429 [2024-04-27 03:30:29.229023] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:04.429 [2024-04-27 03:30:29.229037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:04.429 [2024-04-27 03:30:29.229052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42a80 is same with the state(5) to be set 00:19:04.429 03:30:29 -- common/autotest_common.sh@903 -- # get_subsystem_names 00:19:04.429 03:30:29 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:19:04.429 03:30:29 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:19:04.430 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.430 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.430 03:30:29 -- host/discovery.sh@59 -- # sort 00:19:04.430 03:30:29 -- host/discovery.sh@59 -- # xargs 00:19:04.430 [2024-04-27 03:30:29.238871] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a42a80 (9): Bad file descriptor 00:19:04.430 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.430 [2024-04-27 03:30:29.248928] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:19:04.430 [2024-04-27 03:30:29.249170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.249336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.249364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a42a80 with addr=10.0.0.2, port=4420 00:19:04.430 [2024-04-27 03:30:29.249386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42a80 is same with the state(5) to be set 00:19:04.430 [2024-04-27 03:30:29.249410] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a42a80 (9): Bad file descriptor 00:19:04.430 [2024-04-27 03:30:29.249445] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:19:04.430 [2024-04-27 03:30:29.249463] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:19:04.430 [2024-04-27 03:30:29.249478] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:19:04.430 [2024-04-27 03:30:29.249498] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:04.430 [2024-04-27 03:30:29.259016] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:19:04.430 [2024-04-27 03:30:29.259151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.259301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.259328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a42a80 with addr=10.0.0.2, port=4420 00:19:04.430 [2024-04-27 03:30:29.259344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42a80 is same with the state(5) to be set 00:19:04.430 [2024-04-27 03:30:29.259366] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a42a80 (9): Bad file descriptor 00:19:04.430 [2024-04-27 03:30:29.259386] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:19:04.430 [2024-04-27 03:30:29.259400] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:19:04.430 [2024-04-27 03:30:29.259413] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:19:04.430 [2024-04-27 03:30:29.259431] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:04.430 [2024-04-27 03:30:29.269092] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:19:04.430 [2024-04-27 03:30:29.269276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.269417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.269443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a42a80 with addr=10.0.0.2, port=4420 00:19:04.430 [2024-04-27 03:30:29.269460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42a80 is same with the state(5) to be set 00:19:04.430 [2024-04-27 03:30:29.269481] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a42a80 (9): Bad file descriptor 00:19:04.430 [2024-04-27 03:30:29.269516] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:19:04.430 [2024-04-27 03:30:29.269551] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:19:04.430 [2024-04-27 03:30:29.269567] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:19:04.430 [2024-04-27 03:30:29.269589] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:04.430 03:30:29 -- common/autotest_common.sh@903 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:04.430 03:30:29 -- common/autotest_common.sh@904 -- # return 0 00:19:04.430 03:30:29 -- host/discovery.sh@130 -- # waitforcondition '[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:19:04.430 03:30:29 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_bdev_list)" == "nvme0n1 nvme0n2" ]]' 00:19:04.430 03:30:29 -- common/autotest_common.sh@901 -- # local max=10 00:19:04.430 03:30:29 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:04.430 03:30:29 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_bdev_list)"' == '"nvme0n1' 'nvme0n2"' ']]' 00:19:04.430 03:30:29 -- common/autotest_common.sh@903 -- # get_bdev_list 00:19:04.430 03:30:29 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:04.430 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.430 03:30:29 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:04.430 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.430 03:30:29 -- host/discovery.sh@55 -- # sort 00:19:04.430 03:30:29 -- host/discovery.sh@55 -- # xargs 00:19:04.430 [2024-04-27 03:30:29.279174] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:19:04.430 [2024-04-27 03:30:29.279355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.279472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.279498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a42a80 with addr=10.0.0.2, port=4420 00:19:04.430 [2024-04-27 03:30:29.279514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42a80 is same with the state(5) to be set 00:19:04.430 [2024-04-27 03:30:29.279553] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a42a80 (9): Bad file descriptor 00:19:04.430 [2024-04-27 03:30:29.279590] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:19:04.430 [2024-04-27 03:30:29.279610] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:19:04.430 [2024-04-27 03:30:29.279642] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:19:04.430 [2024-04-27 03:30:29.279663] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:04.430 [2024-04-27 03:30:29.289263] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:19:04.430 [2024-04-27 03:30:29.289418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.289523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.289549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a42a80 with addr=10.0.0.2, port=4420 00:19:04.430 [2024-04-27 03:30:29.289566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42a80 is same with the state(5) to be set 00:19:04.430 [2024-04-27 03:30:29.289588] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a42a80 (9): Bad file descriptor 00:19:04.430 [2024-04-27 03:30:29.289634] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:19:04.430 [2024-04-27 03:30:29.289653] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:19:04.430 [2024-04-27 03:30:29.289667] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:19:04.430 [2024-04-27 03:30:29.289686] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:04.430 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.430 [2024-04-27 03:30:29.299334] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:19:04.430 [2024-04-27 03:30:29.299467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.299604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.299630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a42a80 with addr=10.0.0.2, port=4420 00:19:04.430 [2024-04-27 03:30:29.299646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42a80 is same with the state(5) to be set 00:19:04.430 [2024-04-27 03:30:29.299668] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a42a80 (9): Bad file descriptor 00:19:04.430 [2024-04-27 03:30:29.299702] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:19:04.430 [2024-04-27 03:30:29.299720] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:19:04.430 [2024-04-27 03:30:29.299750] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:19:04.430 [2024-04-27 03:30:29.299770] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:04.430 [2024-04-27 03:30:29.309406] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:19:04.430 [2024-04-27 03:30:29.309543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.309663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:04.430 [2024-04-27 03:30:29.309689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a42a80 with addr=10.0.0.2, port=4420 00:19:04.430 [2024-04-27 03:30:29.309705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a42a80 is same with the state(5) to be set 00:19:04.430 [2024-04-27 03:30:29.309726] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a42a80 (9): Bad file descriptor 00:19:04.430 [2024-04-27 03:30:29.309771] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:19:04.430 [2024-04-27 03:30:29.309806] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:19:04.430 [2024-04-27 03:30:29.309819] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:19:04.430 [2024-04-27 03:30:29.309838] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:04.430 [2024-04-27 03:30:29.310761] bdev_nvme.c:6710:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:19:04.430 [2024-04-27 03:30:29.310788] bdev_nvme.c:6701:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:19:04.430 03:30:29 -- common/autotest_common.sh@903 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:19:04.430 03:30:29 -- common/autotest_common.sh@904 -- # return 0 00:19:04.430 03:30:29 -- host/discovery.sh@131 -- # waitforcondition '[[ "$(get_subsystem_paths nvme0)" == "$NVMF_SECOND_PORT" ]]' 00:19:04.430 03:30:29 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_paths nvme0)" == "$NVMF_SECOND_PORT" ]]' 00:19:04.430 03:30:29 -- common/autotest_common.sh@901 -- # local max=10 00:19:04.430 03:30:29 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:04.430 03:30:29 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_paths' 'nvme0)"' == '"$NVMF_SECOND_PORT"' ']]' 00:19:04.430 03:30:29 -- common/autotest_common.sh@903 -- # get_subsystem_paths nvme0 00:19:04.430 03:30:29 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:19:04.431 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.431 03:30:29 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:19:04.431 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.431 03:30:29 -- host/discovery.sh@63 -- # sort -n 00:19:04.431 03:30:29 -- host/discovery.sh@63 -- # xargs 00:19:04.431 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.431 03:30:29 -- common/autotest_common.sh@903 -- # [[ 4421 == \4\4\2\1 ]] 00:19:04.431 03:30:29 -- common/autotest_common.sh@904 -- # return 0 00:19:04.431 03:30:29 -- host/discovery.sh@132 -- # is_notification_count_eq 0 00:19:04.431 03:30:29 -- host/discovery.sh@79 -- # expected_count=0 00:19:04.431 03:30:29 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:19:04.431 03:30:29 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:19:04.431 03:30:29 -- common/autotest_common.sh@901 -- # local max=10 00:19:04.431 03:30:29 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:04.431 03:30:29 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:19:04.431 03:30:29 -- common/autotest_common.sh@903 -- # get_notification_count 00:19:04.431 03:30:29 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:19:04.431 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.431 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.431 03:30:29 -- host/discovery.sh@74 -- # jq '. | length' 00:19:04.431 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.431 03:30:29 -- host/discovery.sh@74 -- # notification_count=0 00:19:04.431 03:30:29 -- host/discovery.sh@75 -- # notify_id=2 00:19:04.431 03:30:29 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:19:04.431 03:30:29 -- common/autotest_common.sh@904 -- # return 0 00:19:04.431 03:30:29 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:19:04.431 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.431 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.691 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.691 03:30:29 -- host/discovery.sh@136 -- # waitforcondition '[[ "$(get_subsystem_names)" == "" ]]' 00:19:04.691 03:30:29 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_subsystem_names)" == "" ]]' 00:19:04.691 03:30:29 -- common/autotest_common.sh@901 -- # local max=10 00:19:04.691 03:30:29 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:04.691 03:30:29 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_subsystem_names)"' == '""' ']]' 00:19:04.691 03:30:29 -- common/autotest_common.sh@903 -- # get_subsystem_names 00:19:04.691 03:30:29 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:19:04.691 03:30:29 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:19:04.691 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.691 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.691 03:30:29 -- host/discovery.sh@59 -- # sort 00:19:04.692 03:30:29 -- host/discovery.sh@59 -- # xargs 00:19:04.692 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.692 03:30:29 -- common/autotest_common.sh@903 -- # [[ '' == '' ]] 00:19:04.692 03:30:29 -- common/autotest_common.sh@904 -- # return 0 00:19:04.692 03:30:29 -- host/discovery.sh@137 -- # waitforcondition '[[ "$(get_bdev_list)" == "" ]]' 00:19:04.692 03:30:29 -- common/autotest_common.sh@900 -- # local 'cond=[[ "$(get_bdev_list)" == "" ]]' 00:19:04.692 03:30:29 -- common/autotest_common.sh@901 -- # local max=10 00:19:04.692 03:30:29 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:04.692 03:30:29 -- common/autotest_common.sh@903 -- # eval '[[' '"$(get_bdev_list)"' == '""' ']]' 00:19:04.692 03:30:29 -- common/autotest_common.sh@903 -- # get_bdev_list 00:19:04.692 03:30:29 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:04.692 03:30:29 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:04.692 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.692 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.692 03:30:29 -- host/discovery.sh@55 -- # sort 00:19:04.692 03:30:29 -- host/discovery.sh@55 -- # xargs 00:19:04.692 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.692 03:30:29 -- common/autotest_common.sh@903 -- # [[ '' == '' ]] 00:19:04.692 03:30:29 -- common/autotest_common.sh@904 -- # return 0 00:19:04.692 03:30:29 -- host/discovery.sh@138 -- # is_notification_count_eq 2 00:19:04.692 03:30:29 -- host/discovery.sh@79 -- # expected_count=2 00:19:04.692 03:30:29 -- host/discovery.sh@80 -- # waitforcondition 'get_notification_count && ((notification_count == expected_count))' 00:19:04.692 03:30:29 -- common/autotest_common.sh@900 -- # local 'cond=get_notification_count && ((notification_count == expected_count))' 00:19:04.692 03:30:29 -- common/autotest_common.sh@901 -- # local max=10 00:19:04.692 03:30:29 -- common/autotest_common.sh@902 -- # (( max-- )) 00:19:04.692 03:30:29 -- common/autotest_common.sh@903 -- # eval get_notification_count '&&' '((notification_count' == 'expected_count))' 00:19:04.692 03:30:29 -- common/autotest_common.sh@903 -- # get_notification_count 00:19:04.692 03:30:29 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:19:04.692 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.692 03:30:29 -- host/discovery.sh@74 -- # jq '. | length' 00:19:04.692 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:04.692 03:30:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:04.692 03:30:29 -- host/discovery.sh@74 -- # notification_count=2 00:19:04.692 03:30:29 -- host/discovery.sh@75 -- # notify_id=4 00:19:04.692 03:30:29 -- common/autotest_common.sh@903 -- # (( notification_count == expected_count )) 00:19:04.692 03:30:29 -- common/autotest_common.sh@904 -- # return 0 00:19:04.692 03:30:29 -- host/discovery.sh@141 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:19:04.692 03:30:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:04.692 03:30:29 -- common/autotest_common.sh@10 -- # set +x 00:19:05.632 [2024-04-27 03:30:30.588055] bdev_nvme.c:6923:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:19:05.633 [2024-04-27 03:30:30.588098] bdev_nvme.c:7003:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:19:05.633 [2024-04-27 03:30:30.588124] bdev_nvme.c:6886:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:19:05.891 [2024-04-27 03:30:30.715560] bdev_nvme.c:6852:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:19:05.891 [2024-04-27 03:30:30.822848] bdev_nvme.c:6742:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:19:05.891 [2024-04-27 03:30:30.822898] bdev_nvme.c:6701:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:19:05.891 03:30:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:05.891 03:30:30 -- host/discovery.sh@143 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:19:05.891 03:30:30 -- common/autotest_common.sh@638 -- # local es=0 00:19:05.891 03:30:30 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:19:05.891 03:30:30 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:19:05.891 03:30:30 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:05.891 03:30:30 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:19:05.891 03:30:30 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:05.891 03:30:30 -- common/autotest_common.sh@641 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:19:05.891 03:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:05.891 03:30:30 -- common/autotest_common.sh@10 -- # set +x 00:19:05.891 request: 00:19:05.891 { 00:19:05.891 "name": "nvme", 00:19:05.891 "trtype": "tcp", 00:19:05.891 "traddr": "10.0.0.2", 00:19:05.891 "hostnqn": "nqn.2021-12.io.spdk:test", 00:19:05.891 "adrfam": "ipv4", 00:19:05.891 "trsvcid": "8009", 00:19:05.891 "wait_for_attach": true, 00:19:05.891 "method": "bdev_nvme_start_discovery", 00:19:05.891 "req_id": 1 00:19:05.891 } 00:19:05.891 Got JSON-RPC error response 00:19:05.891 response: 00:19:05.891 { 00:19:05.891 "code": -17, 00:19:05.891 "message": "File exists" 00:19:05.891 } 00:19:05.891 03:30:30 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:19:05.891 03:30:30 -- common/autotest_common.sh@641 -- # es=1 00:19:05.891 03:30:30 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:19:05.891 03:30:30 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:19:05.891 03:30:30 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:19:05.891 03:30:30 -- host/discovery.sh@145 -- # get_discovery_ctrlrs 00:19:05.891 03:30:30 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:19:05.891 03:30:30 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:19:05.891 03:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:05.891 03:30:30 -- common/autotest_common.sh@10 -- # set +x 00:19:05.891 03:30:30 -- host/discovery.sh@67 -- # sort 00:19:05.891 03:30:30 -- host/discovery.sh@67 -- # xargs 00:19:05.891 03:30:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:06.151 03:30:30 -- host/discovery.sh@145 -- # [[ nvme == \n\v\m\e ]] 00:19:06.151 03:30:30 -- host/discovery.sh@146 -- # get_bdev_list 00:19:06.151 03:30:30 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:06.151 03:30:30 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:06.151 03:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:06.151 03:30:30 -- common/autotest_common.sh@10 -- # set +x 00:19:06.151 03:30:30 -- host/discovery.sh@55 -- # sort 00:19:06.151 03:30:30 -- host/discovery.sh@55 -- # xargs 00:19:06.151 03:30:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:06.151 03:30:30 -- host/discovery.sh@146 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:19:06.151 03:30:30 -- host/discovery.sh@149 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:19:06.151 03:30:30 -- common/autotest_common.sh@638 -- # local es=0 00:19:06.151 03:30:30 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:19:06.151 03:30:30 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:19:06.151 03:30:30 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:06.151 03:30:30 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:19:06.151 03:30:30 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:06.151 03:30:30 -- common/autotest_common.sh@641 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:19:06.151 03:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:06.151 03:30:30 -- common/autotest_common.sh@10 -- # set +x 00:19:06.151 request: 00:19:06.151 { 00:19:06.151 "name": "nvme_second", 00:19:06.151 "trtype": "tcp", 00:19:06.151 "traddr": "10.0.0.2", 00:19:06.151 "hostnqn": "nqn.2021-12.io.spdk:test", 00:19:06.151 "adrfam": "ipv4", 00:19:06.151 "trsvcid": "8009", 00:19:06.151 "wait_for_attach": true, 00:19:06.151 "method": "bdev_nvme_start_discovery", 00:19:06.151 "req_id": 1 00:19:06.151 } 00:19:06.151 Got JSON-RPC error response 00:19:06.151 response: 00:19:06.151 { 00:19:06.151 "code": -17, 00:19:06.151 "message": "File exists" 00:19:06.151 } 00:19:06.151 03:30:30 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:19:06.151 03:30:30 -- common/autotest_common.sh@641 -- # es=1 00:19:06.151 03:30:30 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:19:06.151 03:30:30 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:19:06.151 03:30:30 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:19:06.151 03:30:30 -- host/discovery.sh@151 -- # get_discovery_ctrlrs 00:19:06.151 03:30:30 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:19:06.151 03:30:30 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:19:06.151 03:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:06.151 03:30:30 -- common/autotest_common.sh@10 -- # set +x 00:19:06.151 03:30:30 -- host/discovery.sh@67 -- # sort 00:19:06.151 03:30:30 -- host/discovery.sh@67 -- # xargs 00:19:06.151 03:30:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:06.151 03:30:30 -- host/discovery.sh@151 -- # [[ nvme == \n\v\m\e ]] 00:19:06.151 03:30:30 -- host/discovery.sh@152 -- # get_bdev_list 00:19:06.151 03:30:30 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:06.151 03:30:30 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:19:06.151 03:30:30 -- host/discovery.sh@55 -- # sort 00:19:06.151 03:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:06.151 03:30:30 -- common/autotest_common.sh@10 -- # set +x 00:19:06.151 03:30:30 -- host/discovery.sh@55 -- # xargs 00:19:06.151 03:30:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:06.151 03:30:31 -- host/discovery.sh@152 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:19:06.151 03:30:31 -- host/discovery.sh@155 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:19:06.151 03:30:31 -- common/autotest_common.sh@638 -- # local es=0 00:19:06.151 03:30:31 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:19:06.151 03:30:31 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:19:06.151 03:30:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:06.151 03:30:31 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:19:06.151 03:30:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:19:06.151 03:30:31 -- common/autotest_common.sh@641 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:19:06.151 03:30:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:06.151 03:30:31 -- common/autotest_common.sh@10 -- # set +x 00:19:07.088 [2024-04-27 03:30:32.034262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:07.088 [2024-04-27 03:30:32.034444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:07.088 [2024-04-27 03:30:32.034474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a72c10 with addr=10.0.0.2, port=8010 00:19:07.088 [2024-04-27 03:30:32.034497] nvme_tcp.c:2699:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:19:07.088 [2024-04-27 03:30:32.034510] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:19:07.088 [2024-04-27 03:30:32.034550] bdev_nvme.c:6985:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:19:08.490 [2024-04-27 03:30:33.036665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:08.490 [2024-04-27 03:30:33.036828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:19:08.490 [2024-04-27 03:30:33.036858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a573d0 with addr=10.0.0.2, port=8010 00:19:08.490 [2024-04-27 03:30:33.036879] nvme_tcp.c:2699:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:19:08.490 [2024-04-27 03:30:33.036894] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:19:08.490 [2024-04-27 03:30:33.036907] bdev_nvme.c:6985:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:19:09.430 [2024-04-27 03:30:34.038960] bdev_nvme.c:6966:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:19:09.430 request: 00:19:09.430 { 00:19:09.430 "name": "nvme_second", 00:19:09.430 "trtype": "tcp", 00:19:09.430 "traddr": "10.0.0.2", 00:19:09.430 "hostnqn": "nqn.2021-12.io.spdk:test", 00:19:09.430 "adrfam": "ipv4", 00:19:09.430 "trsvcid": "8010", 00:19:09.430 "attach_timeout_ms": 3000, 00:19:09.430 "method": "bdev_nvme_start_discovery", 00:19:09.430 "req_id": 1 00:19:09.430 } 00:19:09.430 Got JSON-RPC error response 00:19:09.430 response: 00:19:09.430 { 00:19:09.430 "code": -110, 00:19:09.430 "message": "Connection timed out" 00:19:09.430 } 00:19:09.430 03:30:34 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:19:09.430 03:30:34 -- common/autotest_common.sh@641 -- # es=1 00:19:09.430 03:30:34 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:19:09.430 03:30:34 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:19:09.430 03:30:34 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:19:09.430 03:30:34 -- host/discovery.sh@157 -- # get_discovery_ctrlrs 00:19:09.430 03:30:34 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:19:09.430 03:30:34 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:19:09.430 03:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:09.430 03:30:34 -- common/autotest_common.sh@10 -- # set +x 00:19:09.430 03:30:34 -- host/discovery.sh@67 -- # sort 00:19:09.430 03:30:34 -- host/discovery.sh@67 -- # xargs 00:19:09.430 03:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:09.430 03:30:34 -- host/discovery.sh@157 -- # [[ nvme == \n\v\m\e ]] 00:19:09.430 03:30:34 -- host/discovery.sh@159 -- # trap - SIGINT SIGTERM EXIT 00:19:09.430 03:30:34 -- host/discovery.sh@161 -- # kill 1501462 00:19:09.430 03:30:34 -- host/discovery.sh@162 -- # nvmftestfini 00:19:09.430 03:30:34 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:09.430 03:30:34 -- nvmf/common.sh@117 -- # sync 00:19:09.430 03:30:34 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:19:09.430 03:30:34 -- nvmf/common.sh@120 -- # set +e 00:19:09.430 03:30:34 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:09.430 03:30:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:19:09.430 rmmod nvme_tcp 00:19:09.430 rmmod nvme_fabrics 00:19:09.430 rmmod nvme_keyring 00:19:09.430 03:30:34 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:09.430 03:30:34 -- nvmf/common.sh@124 -- # set -e 00:19:09.430 03:30:34 -- nvmf/common.sh@125 -- # return 0 00:19:09.430 03:30:34 -- nvmf/common.sh@478 -- # '[' -n 1501440 ']' 00:19:09.430 03:30:34 -- nvmf/common.sh@479 -- # killprocess 1501440 00:19:09.430 03:30:34 -- common/autotest_common.sh@936 -- # '[' -z 1501440 ']' 00:19:09.430 03:30:34 -- common/autotest_common.sh@940 -- # kill -0 1501440 00:19:09.430 03:30:34 -- common/autotest_common.sh@941 -- # uname 00:19:09.430 03:30:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:09.430 03:30:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1501440 00:19:09.430 03:30:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:09.430 03:30:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:09.430 03:30:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1501440' 00:19:09.430 killing process with pid 1501440 00:19:09.430 03:30:34 -- common/autotest_common.sh@955 -- # kill 1501440 00:19:09.430 03:30:34 -- common/autotest_common.sh@960 -- # wait 1501440 00:19:09.691 03:30:34 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:09.691 03:30:34 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:19:09.691 03:30:34 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:19:09.691 03:30:34 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:09.691 03:30:34 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:19:09.691 03:30:34 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:09.691 03:30:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:09.691 03:30:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:11.593 03:30:36 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:19:11.593 00:19:11.593 real 0m13.354s 00:19:11.594 user 0m19.325s 00:19:11.594 sys 0m2.897s 00:19:11.594 03:30:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:11.594 03:30:36 -- common/autotest_common.sh@10 -- # set +x 00:19:11.594 ************************************ 00:19:11.594 END TEST nvmf_discovery 00:19:11.594 ************************************ 00:19:11.594 03:30:36 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:19:11.594 03:30:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:11.594 03:30:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:11.594 03:30:36 -- common/autotest_common.sh@10 -- # set +x 00:19:11.852 ************************************ 00:19:11.852 START TEST nvmf_discovery_remove_ifc 00:19:11.852 ************************************ 00:19:11.852 03:30:36 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:19:11.852 * Looking for test storage... 00:19:11.852 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:19:11.852 03:30:36 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:11.852 03:30:36 -- nvmf/common.sh@7 -- # uname -s 00:19:11.852 03:30:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:11.852 03:30:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:11.852 03:30:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:11.852 03:30:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:11.852 03:30:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:11.852 03:30:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:11.852 03:30:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:11.852 03:30:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:11.852 03:30:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:11.852 03:30:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:11.852 03:30:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:19:11.852 03:30:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:19:11.852 03:30:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:11.852 03:30:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:11.852 03:30:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:11.852 03:30:36 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:11.852 03:30:36 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:11.852 03:30:36 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:11.852 03:30:36 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:11.852 03:30:36 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:11.852 03:30:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:11.852 03:30:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:11.852 03:30:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:11.852 03:30:36 -- paths/export.sh@5 -- # export PATH 00:19:11.852 03:30:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:11.852 03:30:36 -- nvmf/common.sh@47 -- # : 0 00:19:11.852 03:30:36 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:11.852 03:30:36 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:11.852 03:30:36 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:11.852 03:30:36 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:11.852 03:30:36 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:11.852 03:30:36 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:11.852 03:30:36 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:11.852 03:30:36 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:11.852 03:30:36 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:19:11.852 03:30:36 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:19:11.852 03:30:36 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:19:11.852 03:30:36 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:19:11.852 03:30:36 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:19:11.852 03:30:36 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:19:11.852 03:30:36 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:19:11.852 03:30:36 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:19:11.852 03:30:36 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:11.852 03:30:36 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:11.852 03:30:36 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:11.852 03:30:36 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:11.852 03:30:36 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:11.852 03:30:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:11.852 03:30:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:11.852 03:30:36 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:11.852 03:30:36 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:11.852 03:30:36 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:11.852 03:30:36 -- common/autotest_common.sh@10 -- # set +x 00:19:13.760 03:30:38 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:13.760 03:30:38 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:13.760 03:30:38 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:13.760 03:30:38 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:13.760 03:30:38 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:13.760 03:30:38 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:13.760 03:30:38 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:13.760 03:30:38 -- nvmf/common.sh@295 -- # net_devs=() 00:19:13.760 03:30:38 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:13.760 03:30:38 -- nvmf/common.sh@296 -- # e810=() 00:19:13.760 03:30:38 -- nvmf/common.sh@296 -- # local -ga e810 00:19:13.760 03:30:38 -- nvmf/common.sh@297 -- # x722=() 00:19:13.760 03:30:38 -- nvmf/common.sh@297 -- # local -ga x722 00:19:13.760 03:30:38 -- nvmf/common.sh@298 -- # mlx=() 00:19:13.760 03:30:38 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:13.760 03:30:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:13.760 03:30:38 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:13.760 03:30:38 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:13.760 03:30:38 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:13.760 03:30:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:13.760 03:30:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:19:13.760 Found 0000:09:00.0 (0x8086 - 0x159b) 00:19:13.760 03:30:38 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:13.760 03:30:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:19:13.760 Found 0000:09:00.1 (0x8086 - 0x159b) 00:19:13.760 03:30:38 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:13.760 03:30:38 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:19:13.760 03:30:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:13.760 03:30:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:13.760 03:30:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:13.760 03:30:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:13.760 03:30:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:19:13.760 Found net devices under 0000:09:00.0: cvl_0_0 00:19:13.760 03:30:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:13.760 03:30:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:13.761 03:30:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:13.761 03:30:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:13.761 03:30:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:13.761 03:30:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:19:13.761 Found net devices under 0000:09:00.1: cvl_0_1 00:19:13.761 03:30:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:13.761 03:30:38 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:13.761 03:30:38 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:13.761 03:30:38 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:13.761 03:30:38 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:19:13.761 03:30:38 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:19:13.761 03:30:38 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:13.761 03:30:38 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:13.761 03:30:38 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:13.761 03:30:38 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:19:13.761 03:30:38 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:13.761 03:30:38 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:13.761 03:30:38 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:19:13.761 03:30:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:13.761 03:30:38 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:13.761 03:30:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:19:13.761 03:30:38 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:19:13.761 03:30:38 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:19:13.761 03:30:38 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:13.761 03:30:38 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:13.761 03:30:38 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:13.761 03:30:38 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:19:13.761 03:30:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:13.761 03:30:38 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:13.761 03:30:38 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:13.761 03:30:38 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:19:13.761 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:13.761 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:19:13.761 00:19:13.761 --- 10.0.0.2 ping statistics --- 00:19:13.761 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:13.761 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:19:13.761 03:30:38 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:14.019 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:14.019 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:19:14.019 00:19:14.019 --- 10.0.0.1 ping statistics --- 00:19:14.019 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:14.019 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:19:14.019 03:30:38 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:14.019 03:30:38 -- nvmf/common.sh@411 -- # return 0 00:19:14.019 03:30:38 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:14.019 03:30:38 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:14.019 03:30:38 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:19:14.019 03:30:38 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:19:14.019 03:30:38 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:14.019 03:30:38 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:19:14.019 03:30:38 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:19:14.019 03:30:38 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:19:14.019 03:30:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:14.019 03:30:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:14.019 03:30:38 -- common/autotest_common.sh@10 -- # set +x 00:19:14.019 03:30:38 -- nvmf/common.sh@470 -- # nvmfpid=1504625 00:19:14.019 03:30:38 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:14.019 03:30:38 -- nvmf/common.sh@471 -- # waitforlisten 1504625 00:19:14.019 03:30:38 -- common/autotest_common.sh@817 -- # '[' -z 1504625 ']' 00:19:14.019 03:30:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:14.019 03:30:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:14.019 03:30:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:14.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:14.019 03:30:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:14.019 03:30:38 -- common/autotest_common.sh@10 -- # set +x 00:19:14.019 [2024-04-27 03:30:38.816610] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:19:14.019 [2024-04-27 03:30:38.816683] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:14.019 EAL: No free 2048 kB hugepages reported on node 1 00:19:14.019 [2024-04-27 03:30:38.879462] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:14.019 [2024-04-27 03:30:38.979730] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:14.019 [2024-04-27 03:30:38.979785] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:14.019 [2024-04-27 03:30:38.979814] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:14.019 [2024-04-27 03:30:38.979827] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:14.019 [2024-04-27 03:30:38.979838] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:14.019 [2024-04-27 03:30:38.979887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:14.277 03:30:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:14.277 03:30:39 -- common/autotest_common.sh@850 -- # return 0 00:19:14.277 03:30:39 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:14.277 03:30:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:14.277 03:30:39 -- common/autotest_common.sh@10 -- # set +x 00:19:14.277 03:30:39 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:14.277 03:30:39 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:19:14.277 03:30:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:14.277 03:30:39 -- common/autotest_common.sh@10 -- # set +x 00:19:14.277 [2024-04-27 03:30:39.132698] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:14.277 [2024-04-27 03:30:39.140925] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:19:14.277 null0 00:19:14.277 [2024-04-27 03:30:39.172840] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:14.277 03:30:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:14.277 03:30:39 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1504646 00:19:14.277 03:30:39 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:19:14.277 03:30:39 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1504646 /tmp/host.sock 00:19:14.277 03:30:39 -- common/autotest_common.sh@817 -- # '[' -z 1504646 ']' 00:19:14.277 03:30:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/tmp/host.sock 00:19:14.277 03:30:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:14.277 03:30:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:19:14.277 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:19:14.277 03:30:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:14.277 03:30:39 -- common/autotest_common.sh@10 -- # set +x 00:19:14.278 [2024-04-27 03:30:39.236634] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:19:14.278 [2024-04-27 03:30:39.236711] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1504646 ] 00:19:14.536 EAL: No free 2048 kB hugepages reported on node 1 00:19:14.536 [2024-04-27 03:30:39.298425] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:14.536 [2024-04-27 03:30:39.410442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:14.536 03:30:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:14.536 03:30:39 -- common/autotest_common.sh@850 -- # return 0 00:19:14.536 03:30:39 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:14.536 03:30:39 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:19:14.536 03:30:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:14.536 03:30:39 -- common/autotest_common.sh@10 -- # set +x 00:19:14.536 03:30:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:14.536 03:30:39 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:19:14.536 03:30:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:14.536 03:30:39 -- common/autotest_common.sh@10 -- # set +x 00:19:14.796 03:30:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:14.796 03:30:39 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:19:14.796 03:30:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:14.796 03:30:39 -- common/autotest_common.sh@10 -- # set +x 00:19:15.735 [2024-04-27 03:30:40.651954] bdev_nvme.c:6923:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:19:15.736 [2024-04-27 03:30:40.651993] bdev_nvme.c:7003:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:19:15.736 [2024-04-27 03:30:40.652030] bdev_nvme.c:6886:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:19:15.996 [2024-04-27 03:30:40.780428] bdev_nvme.c:6852:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:19:15.996 [2024-04-27 03:30:40.963489] bdev_nvme.c:7713:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:19:15.996 [2024-04-27 03:30:40.963568] bdev_nvme.c:7713:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:19:15.996 [2024-04-27 03:30:40.963623] bdev_nvme.c:7713:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:19:15.996 [2024-04-27 03:30:40.963652] bdev_nvme.c:6742:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:19:15.996 [2024-04-27 03:30:40.963689] bdev_nvme.c:6701:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:19:15.996 03:30:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:15.996 03:30:40 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:19:15.996 03:30:40 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:15.996 03:30:40 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:15.996 03:30:40 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:15.996 03:30:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:15.996 03:30:40 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:15.996 03:30:40 -- common/autotest_common.sh@10 -- # set +x 00:19:15.996 03:30:40 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:16.281 03:30:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.281 [2024-04-27 03:30:41.009940] bdev_nvme.c:1606:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1ba8310 was disconnected and freed. delete nvme_qpair. 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:16.281 03:30:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.281 03:30:41 -- common/autotest_common.sh@10 -- # set +x 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:16.281 03:30:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:19:16.281 03:30:41 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:19:17.216 03:30:42 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:17.216 03:30:42 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:17.216 03:30:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:17.216 03:30:42 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:17.216 03:30:42 -- common/autotest_common.sh@10 -- # set +x 00:19:17.216 03:30:42 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:17.216 03:30:42 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:17.216 03:30:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:17.216 03:30:42 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:19:17.216 03:30:42 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:19:18.604 03:30:43 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:18.604 03:30:43 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:18.604 03:30:43 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:18.604 03:30:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:18.604 03:30:43 -- common/autotest_common.sh@10 -- # set +x 00:19:18.604 03:30:43 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:18.604 03:30:43 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:18.604 03:30:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:18.604 03:30:43 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:19:18.605 03:30:43 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:19:19.536 03:30:44 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:19.536 03:30:44 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:19.537 03:30:44 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:19.537 03:30:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:19.537 03:30:44 -- common/autotest_common.sh@10 -- # set +x 00:19:19.537 03:30:44 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:19.537 03:30:44 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:19.537 03:30:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:19.537 03:30:44 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:19:19.537 03:30:44 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:19:20.528 03:30:45 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:20.528 03:30:45 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:20.528 03:30:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:20.528 03:30:45 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:20.528 03:30:45 -- common/autotest_common.sh@10 -- # set +x 00:19:20.528 03:30:45 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:20.528 03:30:45 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:20.528 03:30:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:20.528 03:30:45 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:19:20.528 03:30:45 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:19:21.459 03:30:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:21.459 03:30:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:21.459 03:30:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:21.459 03:30:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:21.459 03:30:46 -- common/autotest_common.sh@10 -- # set +x 00:19:21.459 03:30:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:21.459 03:30:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:21.459 03:30:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:21.459 03:30:46 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:19:21.459 03:30:46 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:19:21.459 [2024-04-27 03:30:46.404535] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:19:21.459 [2024-04-27 03:30:46.404600] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:19:21.459 [2024-04-27 03:30:46.404622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:21.459 [2024-04-27 03:30:46.404641] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:21.459 [2024-04-27 03:30:46.404656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:21.459 [2024-04-27 03:30:46.404672] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:21.459 [2024-04-27 03:30:46.404687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:21.459 [2024-04-27 03:30:46.404702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:21.459 [2024-04-27 03:30:46.404716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:21.459 [2024-04-27 03:30:46.404731] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:21.459 [2024-04-27 03:30:46.404745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:21.459 [2024-04-27 03:30:46.404760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b6e800 is same with the state(5) to be set 00:19:21.459 [2024-04-27 03:30:46.414542] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b6e800 (9): Bad file descriptor 00:19:21.459 [2024-04-27 03:30:46.424606] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:19:22.391 03:30:47 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:22.391 03:30:47 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:22.391 03:30:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:22.391 03:30:47 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:22.391 03:30:47 -- common/autotest_common.sh@10 -- # set +x 00:19:22.391 03:30:47 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:22.391 03:30:47 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:22.649 [2024-04-27 03:30:47.433297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:19:23.584 [2024-04-27 03:30:48.457288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:19:23.584 [2024-04-27 03:30:48.457341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b6e800 with addr=10.0.0.2, port=4420 00:19:23.584 [2024-04-27 03:30:48.457366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b6e800 is same with the state(5) to be set 00:19:23.584 [2024-04-27 03:30:48.457830] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b6e800 (9): Bad file descriptor 00:19:23.584 [2024-04-27 03:30:48.457874] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:23.584 [2024-04-27 03:30:48.457921] bdev_nvme.c:6674:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:19:23.584 [2024-04-27 03:30:48.457959] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:19:23.584 [2024-04-27 03:30:48.457981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:23.584 [2024-04-27 03:30:48.458001] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:23.584 [2024-04-27 03:30:48.458015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:23.584 [2024-04-27 03:30:48.458031] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:23.584 [2024-04-27 03:30:48.458045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:23.584 [2024-04-27 03:30:48.458061] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:23.584 [2024-04-27 03:30:48.458075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:23.584 [2024-04-27 03:30:48.458090] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:23.584 [2024-04-27 03:30:48.458104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:23.584 [2024-04-27 03:30:48.458118] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:19:23.584 [2024-04-27 03:30:48.458400] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b6ec10 (9): Bad file descriptor 00:19:23.584 [2024-04-27 03:30:48.459417] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:19:23.584 [2024-04-27 03:30:48.459438] nvme_ctrlr.c:1148:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:19:23.584 03:30:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:23.584 03:30:48 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:19:23.584 03:30:48 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:19:24.517 03:30:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:24.517 03:30:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:24.517 03:30:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:24.517 03:30:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:24.517 03:30:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:24.517 03:30:49 -- common/autotest_common.sh@10 -- # set +x 00:19:24.517 03:30:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:24.517 03:30:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:24.774 03:30:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:24.774 03:30:49 -- common/autotest_common.sh@10 -- # set +x 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:24.774 03:30:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:19:24.774 03:30:49 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:19:25.705 [2024-04-27 03:30:50.517407] bdev_nvme.c:6923:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:19:25.706 [2024-04-27 03:30:50.517437] bdev_nvme.c:7003:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:19:25.706 [2024-04-27 03:30:50.517458] bdev_nvme.c:6886:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:19:25.706 [2024-04-27 03:30:50.603769] bdev_nvme.c:6852:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:19:25.706 03:30:50 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:25.706 03:30:50 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:25.706 03:30:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:25.706 03:30:50 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:25.706 03:30:50 -- common/autotest_common.sh@10 -- # set +x 00:19:25.706 03:30:50 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:25.706 03:30:50 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:25.706 03:30:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:25.706 03:30:50 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:19:25.706 03:30:50 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:19:25.963 [2024-04-27 03:30:50.788035] bdev_nvme.c:7713:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:19:25.963 [2024-04-27 03:30:50.788087] bdev_nvme.c:7713:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:19:25.963 [2024-04-27 03:30:50.788126] bdev_nvme.c:7713:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:19:25.963 [2024-04-27 03:30:50.788151] bdev_nvme.c:6742:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:19:25.963 [2024-04-27 03:30:50.788167] bdev_nvme.c:6701:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:19:25.963 [2024-04-27 03:30:50.795322] bdev_nvme.c:1606:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1bb2c30 was disconnected and freed. delete nvme_qpair. 00:19:26.896 03:30:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:19:26.896 03:30:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:19:26.896 03:30:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:19:26.896 03:30:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:26.896 03:30:51 -- common/autotest_common.sh@10 -- # set +x 00:19:26.896 03:30:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:19:26.897 03:30:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:19:26.897 03:30:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:26.897 03:30:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:19:26.897 03:30:51 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:19:26.897 03:30:51 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1504646 00:19:26.897 03:30:51 -- common/autotest_common.sh@936 -- # '[' -z 1504646 ']' 00:19:26.897 03:30:51 -- common/autotest_common.sh@940 -- # kill -0 1504646 00:19:26.897 03:30:51 -- common/autotest_common.sh@941 -- # uname 00:19:26.897 03:30:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:26.897 03:30:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1504646 00:19:26.897 03:30:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:26.897 03:30:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:26.897 03:30:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1504646' 00:19:26.897 killing process with pid 1504646 00:19:26.897 03:30:51 -- common/autotest_common.sh@955 -- # kill 1504646 00:19:26.897 03:30:51 -- common/autotest_common.sh@960 -- # wait 1504646 00:19:27.155 03:30:51 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:19:27.155 03:30:51 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:27.155 03:30:51 -- nvmf/common.sh@117 -- # sync 00:19:27.155 03:30:51 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:19:27.155 03:30:51 -- nvmf/common.sh@120 -- # set +e 00:19:27.155 03:30:51 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:27.155 03:30:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:19:27.155 rmmod nvme_tcp 00:19:27.155 rmmod nvme_fabrics 00:19:27.155 rmmod nvme_keyring 00:19:27.155 03:30:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:27.155 03:30:52 -- nvmf/common.sh@124 -- # set -e 00:19:27.155 03:30:52 -- nvmf/common.sh@125 -- # return 0 00:19:27.155 03:30:52 -- nvmf/common.sh@478 -- # '[' -n 1504625 ']' 00:19:27.155 03:30:52 -- nvmf/common.sh@479 -- # killprocess 1504625 00:19:27.155 03:30:52 -- common/autotest_common.sh@936 -- # '[' -z 1504625 ']' 00:19:27.155 03:30:52 -- common/autotest_common.sh@940 -- # kill -0 1504625 00:19:27.155 03:30:52 -- common/autotest_common.sh@941 -- # uname 00:19:27.155 03:30:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:27.155 03:30:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1504625 00:19:27.155 03:30:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:27.155 03:30:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:27.155 03:30:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1504625' 00:19:27.155 killing process with pid 1504625 00:19:27.155 03:30:52 -- common/autotest_common.sh@955 -- # kill 1504625 00:19:27.155 03:30:52 -- common/autotest_common.sh@960 -- # wait 1504625 00:19:27.413 03:30:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:27.413 03:30:52 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:19:27.413 03:30:52 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:19:27.413 03:30:52 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:27.413 03:30:52 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:19:27.413 03:30:52 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:27.413 03:30:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:27.413 03:30:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:29.947 03:30:54 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:19:29.947 00:19:29.947 real 0m17.728s 00:19:29.947 user 0m24.815s 00:19:29.947 sys 0m2.989s 00:19:29.947 03:30:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:29.947 03:30:54 -- common/autotest_common.sh@10 -- # set +x 00:19:29.947 ************************************ 00:19:29.947 END TEST nvmf_discovery_remove_ifc 00:19:29.947 ************************************ 00:19:29.947 03:30:54 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=tcp 00:19:29.947 03:30:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:29.947 03:30:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:29.947 03:30:54 -- common/autotest_common.sh@10 -- # set +x 00:19:29.947 ************************************ 00:19:29.947 START TEST nvmf_identify_kernel_target 00:19:29.947 ************************************ 00:19:29.948 03:30:54 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=tcp 00:19:29.948 * Looking for test storage... 00:19:29.948 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:19:29.948 03:30:54 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:29.948 03:30:54 -- nvmf/common.sh@7 -- # uname -s 00:19:29.948 03:30:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:29.948 03:30:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:29.948 03:30:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:29.948 03:30:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:29.948 03:30:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:29.948 03:30:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:29.948 03:30:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:29.948 03:30:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:29.948 03:30:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:29.948 03:30:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:29.948 03:30:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:19:29.948 03:30:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:19:29.948 03:30:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:29.948 03:30:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:29.948 03:30:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:29.948 03:30:54 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:29.948 03:30:54 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:29.948 03:30:54 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:29.948 03:30:54 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:29.948 03:30:54 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:29.948 03:30:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:29.948 03:30:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:29.948 03:30:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:29.948 03:30:54 -- paths/export.sh@5 -- # export PATH 00:19:29.948 03:30:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:29.948 03:30:54 -- nvmf/common.sh@47 -- # : 0 00:19:29.948 03:30:54 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:29.948 03:30:54 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:29.948 03:30:54 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:29.948 03:30:54 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:29.948 03:30:54 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:29.948 03:30:54 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:29.948 03:30:54 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:29.948 03:30:54 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:29.948 03:30:54 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:19:29.948 03:30:54 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:19:29.948 03:30:54 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:29.948 03:30:54 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:29.948 03:30:54 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:29.948 03:30:54 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:29.948 03:30:54 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:29.948 03:30:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:29.948 03:30:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:29.948 03:30:54 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:29.948 03:30:54 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:29.948 03:30:54 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:29.948 03:30:54 -- common/autotest_common.sh@10 -- # set +x 00:19:31.877 03:30:56 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:31.877 03:30:56 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:31.877 03:30:56 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:31.877 03:30:56 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:31.877 03:30:56 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:31.877 03:30:56 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:31.877 03:30:56 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:31.877 03:30:56 -- nvmf/common.sh@295 -- # net_devs=() 00:19:31.877 03:30:56 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:31.877 03:30:56 -- nvmf/common.sh@296 -- # e810=() 00:19:31.877 03:30:56 -- nvmf/common.sh@296 -- # local -ga e810 00:19:31.877 03:30:56 -- nvmf/common.sh@297 -- # x722=() 00:19:31.877 03:30:56 -- nvmf/common.sh@297 -- # local -ga x722 00:19:31.877 03:30:56 -- nvmf/common.sh@298 -- # mlx=() 00:19:31.877 03:30:56 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:31.877 03:30:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:31.877 03:30:56 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:31.877 03:30:56 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:31.877 03:30:56 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:31.877 03:30:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:31.877 03:30:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:19:31.877 Found 0000:09:00.0 (0x8086 - 0x159b) 00:19:31.877 03:30:56 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:31.877 03:30:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:19:31.877 Found 0000:09:00.1 (0x8086 - 0x159b) 00:19:31.877 03:30:56 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:31.877 03:30:56 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:31.877 03:30:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:31.877 03:30:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:31.877 03:30:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:31.877 03:30:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:19:31.877 Found net devices under 0000:09:00.0: cvl_0_0 00:19:31.877 03:30:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:31.877 03:30:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:31.877 03:30:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:31.877 03:30:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:31.877 03:30:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:31.877 03:30:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:19:31.877 Found net devices under 0000:09:00.1: cvl_0_1 00:19:31.877 03:30:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:31.877 03:30:56 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:31.877 03:30:56 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:31.877 03:30:56 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:19:31.877 03:30:56 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:19:31.877 03:30:56 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:31.878 03:30:56 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:31.878 03:30:56 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:31.878 03:30:56 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:19:31.878 03:30:56 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:31.878 03:30:56 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:31.878 03:30:56 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:19:31.878 03:30:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:31.878 03:30:56 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:31.878 03:30:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:19:31.878 03:30:56 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:19:31.878 03:30:56 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:19:31.878 03:30:56 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:31.878 03:30:56 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:31.878 03:30:56 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:31.878 03:30:56 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:19:31.878 03:30:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:31.878 03:30:56 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:31.878 03:30:56 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:31.878 03:30:56 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:19:31.878 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:31.878 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:19:31.878 00:19:31.878 --- 10.0.0.2 ping statistics --- 00:19:31.878 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:31.878 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:19:31.878 03:30:56 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:31.878 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:31.878 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:19:31.878 00:19:31.878 --- 10.0.0.1 ping statistics --- 00:19:31.878 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:31.878 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:19:31.878 03:30:56 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:31.878 03:30:56 -- nvmf/common.sh@411 -- # return 0 00:19:31.878 03:30:56 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:31.878 03:30:56 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:31.878 03:30:56 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:19:31.878 03:30:56 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:19:31.878 03:30:56 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:31.878 03:30:56 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:19:31.878 03:30:56 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:19:31.878 03:30:56 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:19:31.878 03:30:56 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:19:31.878 03:30:56 -- nvmf/common.sh@717 -- # local ip 00:19:31.878 03:30:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:31.878 03:30:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:31.878 03:30:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:31.878 03:30:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:31.878 03:30:56 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:31.878 03:30:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:31.878 03:30:56 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:31.878 03:30:56 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:31.878 03:30:56 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:31.878 03:30:56 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=10.0.0.1 00:19:31.878 03:30:56 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 10.0.0.1 00:19:31.878 03:30:56 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=10.0.0.1 00:19:31.878 03:30:56 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:19:31.878 03:30:56 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:19:31.878 03:30:56 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:19:31.878 03:30:56 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:19:31.878 03:30:56 -- nvmf/common.sh@628 -- # local block nvme 00:19:31.878 03:30:56 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:19:31.878 03:30:56 -- nvmf/common.sh@631 -- # modprobe nvmet 00:19:31.878 03:30:56 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:19:31.878 03:30:56 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:19:33.254 Waiting for block devices as requested 00:19:33.254 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:19:33.254 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:19:33.254 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:19:33.254 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:19:33.254 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:19:33.512 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:19:33.512 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:19:33.512 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:19:33.512 0000:0b:00.0 (8086 0a54): vfio-pci -> nvme 00:19:33.771 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:19:33.771 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:19:33.771 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:19:34.031 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:19:34.031 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:19:34.031 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:19:34.290 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:19:34.290 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:19:34.290 03:30:59 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:19:34.290 03:30:59 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:19:34.290 03:30:59 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:19:34.290 03:30:59 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:19:34.290 03:30:59 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:19:34.290 03:30:59 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:19:34.290 03:30:59 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:19:34.290 03:30:59 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:19:34.290 03:30:59 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:19:34.290 No valid GPT data, bailing 00:19:34.549 03:30:59 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:19:34.549 03:30:59 -- scripts/common.sh@391 -- # pt= 00:19:34.549 03:30:59 -- scripts/common.sh@392 -- # return 1 00:19:34.549 03:30:59 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:19:34.549 03:30:59 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:19:34.549 03:30:59 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:19:34.549 03:30:59 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:19:34.549 03:30:59 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:19:34.549 03:30:59 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:19:34.549 03:30:59 -- nvmf/common.sh@656 -- # echo 1 00:19:34.549 03:30:59 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:19:34.549 03:30:59 -- nvmf/common.sh@658 -- # echo 1 00:19:34.549 03:30:59 -- nvmf/common.sh@660 -- # echo 10.0.0.1 00:19:34.549 03:30:59 -- nvmf/common.sh@661 -- # echo tcp 00:19:34.549 03:30:59 -- nvmf/common.sh@662 -- # echo 4420 00:19:34.549 03:30:59 -- nvmf/common.sh@663 -- # echo ipv4 00:19:34.549 03:30:59 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:19:34.549 03:30:59 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -a 10.0.0.1 -t tcp -s 4420 00:19:34.549 00:19:34.549 Discovery Log Number of Records 2, Generation counter 2 00:19:34.549 =====Discovery Log Entry 0====== 00:19:34.549 trtype: tcp 00:19:34.549 adrfam: ipv4 00:19:34.549 subtype: current discovery subsystem 00:19:34.549 treq: not specified, sq flow control disable supported 00:19:34.549 portid: 1 00:19:34.549 trsvcid: 4420 00:19:34.549 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:19:34.549 traddr: 10.0.0.1 00:19:34.549 eflags: none 00:19:34.549 sectype: none 00:19:34.549 =====Discovery Log Entry 1====== 00:19:34.549 trtype: tcp 00:19:34.549 adrfam: ipv4 00:19:34.549 subtype: nvme subsystem 00:19:34.549 treq: not specified, sq flow control disable supported 00:19:34.549 portid: 1 00:19:34.549 trsvcid: 4420 00:19:34.549 subnqn: nqn.2016-06.io.spdk:testnqn 00:19:34.549 traddr: 10.0.0.1 00:19:34.549 eflags: none 00:19:34.549 sectype: none 00:19:34.549 03:30:59 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.1 00:19:34.549 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:19:34.549 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.549 ===================================================== 00:19:34.549 NVMe over Fabrics controller at 10.0.0.1:4420: nqn.2014-08.org.nvmexpress.discovery 00:19:34.549 ===================================================== 00:19:34.549 Controller Capabilities/Features 00:19:34.549 ================================ 00:19:34.549 Vendor ID: 0000 00:19:34.549 Subsystem Vendor ID: 0000 00:19:34.549 Serial Number: 8254d89a9afce566a0b7 00:19:34.549 Model Number: Linux 00:19:34.549 Firmware Version: 6.7.0-68 00:19:34.549 Recommended Arb Burst: 0 00:19:34.549 IEEE OUI Identifier: 00 00 00 00:19:34.549 Multi-path I/O 00:19:34.549 May have multiple subsystem ports: No 00:19:34.549 May have multiple controllers: No 00:19:34.549 Associated with SR-IOV VF: No 00:19:34.549 Max Data Transfer Size: Unlimited 00:19:34.549 Max Number of Namespaces: 0 00:19:34.549 Max Number of I/O Queues: 1024 00:19:34.549 NVMe Specification Version (VS): 1.3 00:19:34.549 NVMe Specification Version (Identify): 1.3 00:19:34.549 Maximum Queue Entries: 1024 00:19:34.549 Contiguous Queues Required: No 00:19:34.549 Arbitration Mechanisms Supported 00:19:34.549 Weighted Round Robin: Not Supported 00:19:34.549 Vendor Specific: Not Supported 00:19:34.549 Reset Timeout: 7500 ms 00:19:34.549 Doorbell Stride: 4 bytes 00:19:34.549 NVM Subsystem Reset: Not Supported 00:19:34.549 Command Sets Supported 00:19:34.549 NVM Command Set: Supported 00:19:34.549 Boot Partition: Not Supported 00:19:34.549 Memory Page Size Minimum: 4096 bytes 00:19:34.549 Memory Page Size Maximum: 4096 bytes 00:19:34.549 Persistent Memory Region: Not Supported 00:19:34.549 Optional Asynchronous Events Supported 00:19:34.549 Namespace Attribute Notices: Not Supported 00:19:34.549 Firmware Activation Notices: Not Supported 00:19:34.549 ANA Change Notices: Not Supported 00:19:34.550 PLE Aggregate Log Change Notices: Not Supported 00:19:34.550 LBA Status Info Alert Notices: Not Supported 00:19:34.550 EGE Aggregate Log Change Notices: Not Supported 00:19:34.550 Normal NVM Subsystem Shutdown event: Not Supported 00:19:34.550 Zone Descriptor Change Notices: Not Supported 00:19:34.550 Discovery Log Change Notices: Supported 00:19:34.550 Controller Attributes 00:19:34.550 128-bit Host Identifier: Not Supported 00:19:34.550 Non-Operational Permissive Mode: Not Supported 00:19:34.550 NVM Sets: Not Supported 00:19:34.550 Read Recovery Levels: Not Supported 00:19:34.550 Endurance Groups: Not Supported 00:19:34.550 Predictable Latency Mode: Not Supported 00:19:34.550 Traffic Based Keep ALive: Not Supported 00:19:34.550 Namespace Granularity: Not Supported 00:19:34.550 SQ Associations: Not Supported 00:19:34.550 UUID List: Not Supported 00:19:34.550 Multi-Domain Subsystem: Not Supported 00:19:34.550 Fixed Capacity Management: Not Supported 00:19:34.550 Variable Capacity Management: Not Supported 00:19:34.550 Delete Endurance Group: Not Supported 00:19:34.550 Delete NVM Set: Not Supported 00:19:34.550 Extended LBA Formats Supported: Not Supported 00:19:34.550 Flexible Data Placement Supported: Not Supported 00:19:34.550 00:19:34.550 Controller Memory Buffer Support 00:19:34.550 ================================ 00:19:34.550 Supported: No 00:19:34.550 00:19:34.550 Persistent Memory Region Support 00:19:34.550 ================================ 00:19:34.550 Supported: No 00:19:34.550 00:19:34.550 Admin Command Set Attributes 00:19:34.550 ============================ 00:19:34.550 Security Send/Receive: Not Supported 00:19:34.550 Format NVM: Not Supported 00:19:34.550 Firmware Activate/Download: Not Supported 00:19:34.550 Namespace Management: Not Supported 00:19:34.550 Device Self-Test: Not Supported 00:19:34.550 Directives: Not Supported 00:19:34.550 NVMe-MI: Not Supported 00:19:34.550 Virtualization Management: Not Supported 00:19:34.550 Doorbell Buffer Config: Not Supported 00:19:34.550 Get LBA Status Capability: Not Supported 00:19:34.550 Command & Feature Lockdown Capability: Not Supported 00:19:34.550 Abort Command Limit: 1 00:19:34.550 Async Event Request Limit: 1 00:19:34.550 Number of Firmware Slots: N/A 00:19:34.550 Firmware Slot 1 Read-Only: N/A 00:19:34.550 Firmware Activation Without Reset: N/A 00:19:34.550 Multiple Update Detection Support: N/A 00:19:34.550 Firmware Update Granularity: No Information Provided 00:19:34.550 Per-Namespace SMART Log: No 00:19:34.550 Asymmetric Namespace Access Log Page: Not Supported 00:19:34.550 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:19:34.550 Command Effects Log Page: Not Supported 00:19:34.550 Get Log Page Extended Data: Supported 00:19:34.550 Telemetry Log Pages: Not Supported 00:19:34.550 Persistent Event Log Pages: Not Supported 00:19:34.550 Supported Log Pages Log Page: May Support 00:19:34.550 Commands Supported & Effects Log Page: Not Supported 00:19:34.550 Feature Identifiers & Effects Log Page:May Support 00:19:34.550 NVMe-MI Commands & Effects Log Page: May Support 00:19:34.550 Data Area 4 for Telemetry Log: Not Supported 00:19:34.550 Error Log Page Entries Supported: 1 00:19:34.550 Keep Alive: Not Supported 00:19:34.550 00:19:34.550 NVM Command Set Attributes 00:19:34.550 ========================== 00:19:34.550 Submission Queue Entry Size 00:19:34.550 Max: 1 00:19:34.550 Min: 1 00:19:34.550 Completion Queue Entry Size 00:19:34.550 Max: 1 00:19:34.550 Min: 1 00:19:34.550 Number of Namespaces: 0 00:19:34.550 Compare Command: Not Supported 00:19:34.550 Write Uncorrectable Command: Not Supported 00:19:34.550 Dataset Management Command: Not Supported 00:19:34.550 Write Zeroes Command: Not Supported 00:19:34.550 Set Features Save Field: Not Supported 00:19:34.550 Reservations: Not Supported 00:19:34.550 Timestamp: Not Supported 00:19:34.550 Copy: Not Supported 00:19:34.550 Volatile Write Cache: Not Present 00:19:34.550 Atomic Write Unit (Normal): 1 00:19:34.550 Atomic Write Unit (PFail): 1 00:19:34.550 Atomic Compare & Write Unit: 1 00:19:34.550 Fused Compare & Write: Not Supported 00:19:34.550 Scatter-Gather List 00:19:34.550 SGL Command Set: Supported 00:19:34.550 SGL Keyed: Not Supported 00:19:34.550 SGL Bit Bucket Descriptor: Not Supported 00:19:34.550 SGL Metadata Pointer: Not Supported 00:19:34.550 Oversized SGL: Not Supported 00:19:34.550 SGL Metadata Address: Not Supported 00:19:34.550 SGL Offset: Supported 00:19:34.550 Transport SGL Data Block: Not Supported 00:19:34.550 Replay Protected Memory Block: Not Supported 00:19:34.550 00:19:34.550 Firmware Slot Information 00:19:34.550 ========================= 00:19:34.550 Active slot: 0 00:19:34.550 00:19:34.550 00:19:34.550 Error Log 00:19:34.550 ========= 00:19:34.550 00:19:34.550 Active Namespaces 00:19:34.550 ================= 00:19:34.550 Discovery Log Page 00:19:34.550 ================== 00:19:34.550 Generation Counter: 2 00:19:34.550 Number of Records: 2 00:19:34.550 Record Format: 0 00:19:34.550 00:19:34.550 Discovery Log Entry 0 00:19:34.550 ---------------------- 00:19:34.550 Transport Type: 3 (TCP) 00:19:34.550 Address Family: 1 (IPv4) 00:19:34.550 Subsystem Type: 3 (Current Discovery Subsystem) 00:19:34.550 Entry Flags: 00:19:34.550 Duplicate Returned Information: 0 00:19:34.550 Explicit Persistent Connection Support for Discovery: 0 00:19:34.550 Transport Requirements: 00:19:34.550 Secure Channel: Not Specified 00:19:34.550 Port ID: 1 (0x0001) 00:19:34.550 Controller ID: 65535 (0xffff) 00:19:34.550 Admin Max SQ Size: 32 00:19:34.550 Transport Service Identifier: 4420 00:19:34.550 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:19:34.550 Transport Address: 10.0.0.1 00:19:34.550 Discovery Log Entry 1 00:19:34.550 ---------------------- 00:19:34.550 Transport Type: 3 (TCP) 00:19:34.550 Address Family: 1 (IPv4) 00:19:34.550 Subsystem Type: 2 (NVM Subsystem) 00:19:34.550 Entry Flags: 00:19:34.550 Duplicate Returned Information: 0 00:19:34.550 Explicit Persistent Connection Support for Discovery: 0 00:19:34.550 Transport Requirements: 00:19:34.550 Secure Channel: Not Specified 00:19:34.550 Port ID: 1 (0x0001) 00:19:34.550 Controller ID: 65535 (0xffff) 00:19:34.550 Admin Max SQ Size: 32 00:19:34.550 Transport Service Identifier: 4420 00:19:34.550 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:19:34.550 Transport Address: 10.0.0.1 00:19:34.550 03:30:59 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:19:34.550 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.550 get_feature(0x01) failed 00:19:34.550 get_feature(0x02) failed 00:19:34.550 get_feature(0x04) failed 00:19:34.550 ===================================================== 00:19:34.550 NVMe over Fabrics controller at 10.0.0.1:4420: nqn.2016-06.io.spdk:testnqn 00:19:34.550 ===================================================== 00:19:34.550 Controller Capabilities/Features 00:19:34.550 ================================ 00:19:34.550 Vendor ID: 0000 00:19:34.550 Subsystem Vendor ID: 0000 00:19:34.550 Serial Number: ec4c97b9d2ef9867384a 00:19:34.550 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:19:34.550 Firmware Version: 6.7.0-68 00:19:34.550 Recommended Arb Burst: 6 00:19:34.550 IEEE OUI Identifier: 00 00 00 00:19:34.550 Multi-path I/O 00:19:34.550 May have multiple subsystem ports: Yes 00:19:34.550 May have multiple controllers: Yes 00:19:34.550 Associated with SR-IOV VF: No 00:19:34.550 Max Data Transfer Size: Unlimited 00:19:34.550 Max Number of Namespaces: 1024 00:19:34.550 Max Number of I/O Queues: 128 00:19:34.550 NVMe Specification Version (VS): 1.3 00:19:34.550 NVMe Specification Version (Identify): 1.3 00:19:34.550 Maximum Queue Entries: 1024 00:19:34.550 Contiguous Queues Required: No 00:19:34.550 Arbitration Mechanisms Supported 00:19:34.550 Weighted Round Robin: Not Supported 00:19:34.550 Vendor Specific: Not Supported 00:19:34.550 Reset Timeout: 7500 ms 00:19:34.550 Doorbell Stride: 4 bytes 00:19:34.550 NVM Subsystem Reset: Not Supported 00:19:34.550 Command Sets Supported 00:19:34.550 NVM Command Set: Supported 00:19:34.550 Boot Partition: Not Supported 00:19:34.550 Memory Page Size Minimum: 4096 bytes 00:19:34.550 Memory Page Size Maximum: 4096 bytes 00:19:34.550 Persistent Memory Region: Not Supported 00:19:34.550 Optional Asynchronous Events Supported 00:19:34.550 Namespace Attribute Notices: Supported 00:19:34.550 Firmware Activation Notices: Not Supported 00:19:34.550 ANA Change Notices: Supported 00:19:34.550 PLE Aggregate Log Change Notices: Not Supported 00:19:34.550 LBA Status Info Alert Notices: Not Supported 00:19:34.550 EGE Aggregate Log Change Notices: Not Supported 00:19:34.550 Normal NVM Subsystem Shutdown event: Not Supported 00:19:34.550 Zone Descriptor Change Notices: Not Supported 00:19:34.550 Discovery Log Change Notices: Not Supported 00:19:34.550 Controller Attributes 00:19:34.550 128-bit Host Identifier: Supported 00:19:34.550 Non-Operational Permissive Mode: Not Supported 00:19:34.550 NVM Sets: Not Supported 00:19:34.550 Read Recovery Levels: Not Supported 00:19:34.550 Endurance Groups: Not Supported 00:19:34.550 Predictable Latency Mode: Not Supported 00:19:34.550 Traffic Based Keep ALive: Supported 00:19:34.550 Namespace Granularity: Not Supported 00:19:34.550 SQ Associations: Not Supported 00:19:34.550 UUID List: Not Supported 00:19:34.550 Multi-Domain Subsystem: Not Supported 00:19:34.550 Fixed Capacity Management: Not Supported 00:19:34.550 Variable Capacity Management: Not Supported 00:19:34.550 Delete Endurance Group: Not Supported 00:19:34.551 Delete NVM Set: Not Supported 00:19:34.551 Extended LBA Formats Supported: Not Supported 00:19:34.551 Flexible Data Placement Supported: Not Supported 00:19:34.551 00:19:34.551 Controller Memory Buffer Support 00:19:34.551 ================================ 00:19:34.551 Supported: No 00:19:34.551 00:19:34.551 Persistent Memory Region Support 00:19:34.551 ================================ 00:19:34.551 Supported: No 00:19:34.551 00:19:34.551 Admin Command Set Attributes 00:19:34.551 ============================ 00:19:34.551 Security Send/Receive: Not Supported 00:19:34.551 Format NVM: Not Supported 00:19:34.551 Firmware Activate/Download: Not Supported 00:19:34.551 Namespace Management: Not Supported 00:19:34.551 Device Self-Test: Not Supported 00:19:34.551 Directives: Not Supported 00:19:34.551 NVMe-MI: Not Supported 00:19:34.551 Virtualization Management: Not Supported 00:19:34.551 Doorbell Buffer Config: Not Supported 00:19:34.551 Get LBA Status Capability: Not Supported 00:19:34.551 Command & Feature Lockdown Capability: Not Supported 00:19:34.551 Abort Command Limit: 4 00:19:34.551 Async Event Request Limit: 4 00:19:34.551 Number of Firmware Slots: N/A 00:19:34.551 Firmware Slot 1 Read-Only: N/A 00:19:34.551 Firmware Activation Without Reset: N/A 00:19:34.551 Multiple Update Detection Support: N/A 00:19:34.551 Firmware Update Granularity: No Information Provided 00:19:34.551 Per-Namespace SMART Log: Yes 00:19:34.551 Asymmetric Namespace Access Log Page: Supported 00:19:34.551 ANA Transition Time : 10 sec 00:19:34.551 00:19:34.551 Asymmetric Namespace Access Capabilities 00:19:34.551 ANA Optimized State : Supported 00:19:34.551 ANA Non-Optimized State : Supported 00:19:34.551 ANA Inaccessible State : Supported 00:19:34.551 ANA Persistent Loss State : Supported 00:19:34.551 ANA Change State : Supported 00:19:34.551 ANAGRPID is not changed : No 00:19:34.551 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:19:34.551 00:19:34.551 ANA Group Identifier Maximum : 128 00:19:34.551 Number of ANA Group Identifiers : 128 00:19:34.551 Max Number of Allowed Namespaces : 1024 00:19:34.551 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:19:34.551 Command Effects Log Page: Supported 00:19:34.551 Get Log Page Extended Data: Supported 00:19:34.551 Telemetry Log Pages: Not Supported 00:19:34.551 Persistent Event Log Pages: Not Supported 00:19:34.551 Supported Log Pages Log Page: May Support 00:19:34.551 Commands Supported & Effects Log Page: Not Supported 00:19:34.551 Feature Identifiers & Effects Log Page:May Support 00:19:34.551 NVMe-MI Commands & Effects Log Page: May Support 00:19:34.551 Data Area 4 for Telemetry Log: Not Supported 00:19:34.551 Error Log Page Entries Supported: 128 00:19:34.551 Keep Alive: Supported 00:19:34.551 Keep Alive Granularity: 1000 ms 00:19:34.551 00:19:34.551 NVM Command Set Attributes 00:19:34.551 ========================== 00:19:34.551 Submission Queue Entry Size 00:19:34.551 Max: 64 00:19:34.551 Min: 64 00:19:34.551 Completion Queue Entry Size 00:19:34.551 Max: 16 00:19:34.551 Min: 16 00:19:34.551 Number of Namespaces: 1024 00:19:34.551 Compare Command: Not Supported 00:19:34.551 Write Uncorrectable Command: Not Supported 00:19:34.551 Dataset Management Command: Supported 00:19:34.551 Write Zeroes Command: Supported 00:19:34.551 Set Features Save Field: Not Supported 00:19:34.551 Reservations: Not Supported 00:19:34.551 Timestamp: Not Supported 00:19:34.551 Copy: Not Supported 00:19:34.551 Volatile Write Cache: Present 00:19:34.551 Atomic Write Unit (Normal): 1 00:19:34.551 Atomic Write Unit (PFail): 1 00:19:34.551 Atomic Compare & Write Unit: 1 00:19:34.551 Fused Compare & Write: Not Supported 00:19:34.551 Scatter-Gather List 00:19:34.551 SGL Command Set: Supported 00:19:34.551 SGL Keyed: Not Supported 00:19:34.551 SGL Bit Bucket Descriptor: Not Supported 00:19:34.551 SGL Metadata Pointer: Not Supported 00:19:34.551 Oversized SGL: Not Supported 00:19:34.551 SGL Metadata Address: Not Supported 00:19:34.551 SGL Offset: Supported 00:19:34.551 Transport SGL Data Block: Not Supported 00:19:34.551 Replay Protected Memory Block: Not Supported 00:19:34.551 00:19:34.551 Firmware Slot Information 00:19:34.551 ========================= 00:19:34.551 Active slot: 0 00:19:34.551 00:19:34.551 Asymmetric Namespace Access 00:19:34.551 =========================== 00:19:34.551 Change Count : 0 00:19:34.551 Number of ANA Group Descriptors : 1 00:19:34.551 ANA Group Descriptor : 0 00:19:34.551 ANA Group ID : 1 00:19:34.551 Number of NSID Values : 1 00:19:34.551 Change Count : 0 00:19:34.551 ANA State : 1 00:19:34.551 Namespace Identifier : 1 00:19:34.551 00:19:34.551 Commands Supported and Effects 00:19:34.551 ============================== 00:19:34.551 Admin Commands 00:19:34.551 -------------- 00:19:34.551 Get Log Page (02h): Supported 00:19:34.551 Identify (06h): Supported 00:19:34.551 Abort (08h): Supported 00:19:34.551 Set Features (09h): Supported 00:19:34.551 Get Features (0Ah): Supported 00:19:34.551 Asynchronous Event Request (0Ch): Supported 00:19:34.551 Keep Alive (18h): Supported 00:19:34.551 I/O Commands 00:19:34.551 ------------ 00:19:34.551 Flush (00h): Supported 00:19:34.551 Write (01h): Supported LBA-Change 00:19:34.551 Read (02h): Supported 00:19:34.551 Write Zeroes (08h): Supported LBA-Change 00:19:34.551 Dataset Management (09h): Supported 00:19:34.551 00:19:34.551 Error Log 00:19:34.551 ========= 00:19:34.551 Entry: 0 00:19:34.551 Error Count: 0x3 00:19:34.551 Submission Queue Id: 0x0 00:19:34.551 Command Id: 0x5 00:19:34.551 Phase Bit: 0 00:19:34.551 Status Code: 0x2 00:19:34.551 Status Code Type: 0x0 00:19:34.551 Do Not Retry: 1 00:19:34.841 Error Location: 0x28 00:19:34.841 LBA: 0x0 00:19:34.841 Namespace: 0x0 00:19:34.841 Vendor Log Page: 0x0 00:19:34.841 ----------- 00:19:34.841 Entry: 1 00:19:34.841 Error Count: 0x2 00:19:34.841 Submission Queue Id: 0x0 00:19:34.841 Command Id: 0x5 00:19:34.841 Phase Bit: 0 00:19:34.841 Status Code: 0x2 00:19:34.841 Status Code Type: 0x0 00:19:34.841 Do Not Retry: 1 00:19:34.841 Error Location: 0x28 00:19:34.841 LBA: 0x0 00:19:34.841 Namespace: 0x0 00:19:34.841 Vendor Log Page: 0x0 00:19:34.841 ----------- 00:19:34.841 Entry: 2 00:19:34.841 Error Count: 0x1 00:19:34.841 Submission Queue Id: 0x0 00:19:34.841 Command Id: 0x4 00:19:34.841 Phase Bit: 0 00:19:34.841 Status Code: 0x2 00:19:34.841 Status Code Type: 0x0 00:19:34.841 Do Not Retry: 1 00:19:34.841 Error Location: 0x28 00:19:34.841 LBA: 0x0 00:19:34.841 Namespace: 0x0 00:19:34.841 Vendor Log Page: 0x0 00:19:34.841 00:19:34.841 Number of Queues 00:19:34.841 ================ 00:19:34.841 Number of I/O Submission Queues: 128 00:19:34.841 Number of I/O Completion Queues: 128 00:19:34.841 00:19:34.841 ZNS Specific Controller Data 00:19:34.841 ============================ 00:19:34.841 Zone Append Size Limit: 0 00:19:34.841 00:19:34.841 00:19:34.841 Active Namespaces 00:19:34.841 ================= 00:19:34.841 get_feature(0x05) failed 00:19:34.841 Namespace ID:1 00:19:34.841 Command Set Identifier: NVM (00h) 00:19:34.841 Deallocate: Supported 00:19:34.841 Deallocated/Unwritten Error: Not Supported 00:19:34.841 Deallocated Read Value: Unknown 00:19:34.841 Deallocate in Write Zeroes: Not Supported 00:19:34.841 Deallocated Guard Field: 0xFFFF 00:19:34.841 Flush: Supported 00:19:34.841 Reservation: Not Supported 00:19:34.841 Namespace Sharing Capabilities: Multiple Controllers 00:19:34.841 Size (in LBAs): 1953525168 (931GiB) 00:19:34.841 Capacity (in LBAs): 1953525168 (931GiB) 00:19:34.841 Utilization (in LBAs): 1953525168 (931GiB) 00:19:34.841 UUID: 7a66c96d-381e-4647-836e-305931ecff37 00:19:34.841 Thin Provisioning: Not Supported 00:19:34.841 Per-NS Atomic Units: Yes 00:19:34.841 Atomic Boundary Size (Normal): 0 00:19:34.841 Atomic Boundary Size (PFail): 0 00:19:34.841 Atomic Boundary Offset: 0 00:19:34.841 NGUID/EUI64 Never Reused: No 00:19:34.841 ANA group ID: 1 00:19:34.841 Namespace Write Protected: No 00:19:34.841 Number of LBA Formats: 1 00:19:34.841 Current LBA Format: LBA Format #00 00:19:34.841 LBA Format #00: Data Size: 512 Metadata Size: 0 00:19:34.841 00:19:34.841 03:30:59 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:19:34.841 03:30:59 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:34.841 03:30:59 -- nvmf/common.sh@117 -- # sync 00:19:34.841 03:30:59 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:19:34.841 03:30:59 -- nvmf/common.sh@120 -- # set +e 00:19:34.841 03:30:59 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:34.841 03:30:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:19:34.841 rmmod nvme_tcp 00:19:34.841 rmmod nvme_fabrics 00:19:34.841 03:30:59 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:34.841 03:30:59 -- nvmf/common.sh@124 -- # set -e 00:19:34.841 03:30:59 -- nvmf/common.sh@125 -- # return 0 00:19:34.841 03:30:59 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:19:34.841 03:30:59 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:34.841 03:30:59 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:19:34.841 03:30:59 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:19:34.841 03:30:59 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:34.841 03:30:59 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:19:34.841 03:30:59 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:34.841 03:30:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:34.841 03:30:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:36.744 03:31:01 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:19:36.744 03:31:01 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:19:36.744 03:31:01 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:19:36.744 03:31:01 -- nvmf/common.sh@675 -- # echo 0 00:19:36.744 03:31:01 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:19:36.744 03:31:01 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:19:36.744 03:31:01 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:19:36.744 03:31:01 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:19:36.744 03:31:01 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:19:36.744 03:31:01 -- nvmf/common.sh@684 -- # modprobe -r nvmet_tcp nvmet 00:19:36.744 03:31:01 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:19:38.118 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:19:38.118 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:19:38.118 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:19:38.118 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:19:38.118 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:19:38.118 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:19:38.118 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:19:38.118 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:19:38.118 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:19:38.118 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:19:38.118 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:19:38.118 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:19:38.118 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:19:38.118 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:19:38.118 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:19:38.118 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:19:39.053 0000:0b:00.0 (8086 0a54): nvme -> vfio-pci 00:19:39.053 00:19:39.053 real 0m9.472s 00:19:39.053 user 0m1.952s 00:19:39.053 sys 0m3.467s 00:19:39.053 03:31:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:39.053 03:31:03 -- common/autotest_common.sh@10 -- # set +x 00:19:39.053 ************************************ 00:19:39.053 END TEST nvmf_identify_kernel_target 00:19:39.053 ************************************ 00:19:39.053 03:31:04 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=tcp 00:19:39.053 03:31:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:39.053 03:31:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:39.053 03:31:04 -- common/autotest_common.sh@10 -- # set +x 00:19:39.312 ************************************ 00:19:39.312 START TEST nvmf_auth 00:19:39.312 ************************************ 00:19:39.312 03:31:04 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=tcp 00:19:39.312 * Looking for test storage... 00:19:39.312 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:19:39.312 03:31:04 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:39.312 03:31:04 -- nvmf/common.sh@7 -- # uname -s 00:19:39.312 03:31:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:39.312 03:31:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:39.312 03:31:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:39.312 03:31:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:39.312 03:31:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:39.312 03:31:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:39.312 03:31:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:39.312 03:31:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:39.312 03:31:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:39.312 03:31:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:39.312 03:31:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:19:39.312 03:31:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:19:39.312 03:31:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:39.312 03:31:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:39.312 03:31:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:39.312 03:31:04 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:39.312 03:31:04 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:39.312 03:31:04 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:39.312 03:31:04 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:39.312 03:31:04 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:39.312 03:31:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.312 03:31:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.312 03:31:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.312 03:31:04 -- paths/export.sh@5 -- # export PATH 00:19:39.312 03:31:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.312 03:31:04 -- nvmf/common.sh@47 -- # : 0 00:19:39.312 03:31:04 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:39.312 03:31:04 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:39.312 03:31:04 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:39.312 03:31:04 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:39.312 03:31:04 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:39.312 03:31:04 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:39.312 03:31:04 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:39.312 03:31:04 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:39.312 03:31:04 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:19:39.312 03:31:04 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:19:39.312 03:31:04 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:19:39.312 03:31:04 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:19:39.312 03:31:04 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:19:39.312 03:31:04 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:19:39.312 03:31:04 -- host/auth.sh@21 -- # keys=() 00:19:39.312 03:31:04 -- host/auth.sh@77 -- # nvmftestinit 00:19:39.312 03:31:04 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:19:39.312 03:31:04 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:39.312 03:31:04 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:39.312 03:31:04 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:39.312 03:31:04 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:39.312 03:31:04 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:39.312 03:31:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:39.312 03:31:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:39.312 03:31:04 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:39.312 03:31:04 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:39.312 03:31:04 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:39.312 03:31:04 -- common/autotest_common.sh@10 -- # set +x 00:19:41.213 03:31:06 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:41.213 03:31:06 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:41.213 03:31:06 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:41.213 03:31:06 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:41.213 03:31:06 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:41.213 03:31:06 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:41.213 03:31:06 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:41.213 03:31:06 -- nvmf/common.sh@295 -- # net_devs=() 00:19:41.213 03:31:06 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:41.213 03:31:06 -- nvmf/common.sh@296 -- # e810=() 00:19:41.213 03:31:06 -- nvmf/common.sh@296 -- # local -ga e810 00:19:41.213 03:31:06 -- nvmf/common.sh@297 -- # x722=() 00:19:41.213 03:31:06 -- nvmf/common.sh@297 -- # local -ga x722 00:19:41.213 03:31:06 -- nvmf/common.sh@298 -- # mlx=() 00:19:41.213 03:31:06 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:41.213 03:31:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:41.213 03:31:06 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:41.213 03:31:06 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:41.213 03:31:06 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:41.213 03:31:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:41.213 03:31:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:19:41.213 Found 0000:09:00.0 (0x8086 - 0x159b) 00:19:41.213 03:31:06 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:41.213 03:31:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:19:41.213 Found 0000:09:00.1 (0x8086 - 0x159b) 00:19:41.213 03:31:06 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:19:41.213 03:31:06 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:41.213 03:31:06 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:41.214 03:31:06 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:19:41.214 03:31:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:41.214 03:31:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.214 03:31:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:41.214 03:31:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.214 03:31:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:19:41.214 Found net devices under 0000:09:00.0: cvl_0_0 00:19:41.214 03:31:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.214 03:31:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:41.214 03:31:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.214 03:31:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:41.214 03:31:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.214 03:31:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:19:41.214 Found net devices under 0000:09:00.1: cvl_0_1 00:19:41.214 03:31:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.214 03:31:06 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:41.214 03:31:06 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:41.214 03:31:06 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:41.214 03:31:06 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:19:41.214 03:31:06 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:19:41.214 03:31:06 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:41.214 03:31:06 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:41.214 03:31:06 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:41.214 03:31:06 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:19:41.214 03:31:06 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:41.214 03:31:06 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:41.214 03:31:06 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:19:41.214 03:31:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:41.214 03:31:06 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:41.214 03:31:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:19:41.214 03:31:06 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:19:41.214 03:31:06 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:19:41.214 03:31:06 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:41.472 03:31:06 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:41.472 03:31:06 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:41.472 03:31:06 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:19:41.472 03:31:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:41.472 03:31:06 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:41.472 03:31:06 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:41.472 03:31:06 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:19:41.472 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:41.472 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.154 ms 00:19:41.472 00:19:41.472 --- 10.0.0.2 ping statistics --- 00:19:41.472 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:41.472 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:19:41.472 03:31:06 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:41.472 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:41.472 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:19:41.472 00:19:41.472 --- 10.0.0.1 ping statistics --- 00:19:41.472 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:41.472 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:19:41.472 03:31:06 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:41.472 03:31:06 -- nvmf/common.sh@411 -- # return 0 00:19:41.472 03:31:06 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:41.472 03:31:06 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:41.472 03:31:06 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:19:41.472 03:31:06 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:19:41.472 03:31:06 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:41.472 03:31:06 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:19:41.472 03:31:06 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:19:41.472 03:31:06 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:19:41.472 03:31:06 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:41.472 03:31:06 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:41.472 03:31:06 -- common/autotest_common.sh@10 -- # set +x 00:19:41.472 03:31:06 -- nvmf/common.sh@470 -- # nvmfpid=1511860 00:19:41.472 03:31:06 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:19:41.472 03:31:06 -- nvmf/common.sh@471 -- # waitforlisten 1511860 00:19:41.472 03:31:06 -- common/autotest_common.sh@817 -- # '[' -z 1511860 ']' 00:19:41.472 03:31:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:41.472 03:31:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:41.472 03:31:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:41.472 03:31:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:41.472 03:31:06 -- common/autotest_common.sh@10 -- # set +x 00:19:41.731 03:31:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:41.731 03:31:06 -- common/autotest_common.sh@850 -- # return 0 00:19:41.731 03:31:06 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:41.731 03:31:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:41.731 03:31:06 -- common/autotest_common.sh@10 -- # set +x 00:19:41.731 03:31:06 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:41.731 03:31:06 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:19:41.731 03:31:06 -- host/auth.sh@81 -- # gen_key null 32 00:19:41.731 03:31:06 -- host/auth.sh@53 -- # local digest len file key 00:19:41.731 03:31:06 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:19:41.731 03:31:06 -- host/auth.sh@54 -- # local -A digests 00:19:41.731 03:31:06 -- host/auth.sh@56 -- # digest=null 00:19:41.731 03:31:06 -- host/auth.sh@56 -- # len=32 00:19:41.731 03:31:06 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:19:41.731 03:31:06 -- host/auth.sh@57 -- # key=07de07e3bb9787dfd1de10977b6dbe2c 00:19:41.731 03:31:06 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:19:41.731 03:31:06 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.7OM 00:19:41.731 03:31:06 -- host/auth.sh@59 -- # format_dhchap_key 07de07e3bb9787dfd1de10977b6dbe2c 0 00:19:41.731 03:31:06 -- nvmf/common.sh@708 -- # format_key DHHC-1 07de07e3bb9787dfd1de10977b6dbe2c 0 00:19:41.731 03:31:06 -- nvmf/common.sh@691 -- # local prefix key digest 00:19:41.731 03:31:06 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:19:41.731 03:31:06 -- nvmf/common.sh@693 -- # key=07de07e3bb9787dfd1de10977b6dbe2c 00:19:41.731 03:31:06 -- nvmf/common.sh@693 -- # digest=0 00:19:41.731 03:31:06 -- nvmf/common.sh@694 -- # python - 00:19:41.989 03:31:06 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.7OM 00:19:41.989 03:31:06 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.7OM 00:19:41.989 03:31:06 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.7OM 00:19:41.989 03:31:06 -- host/auth.sh@82 -- # gen_key null 48 00:19:41.989 03:31:06 -- host/auth.sh@53 -- # local digest len file key 00:19:41.989 03:31:06 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:19:41.989 03:31:06 -- host/auth.sh@54 -- # local -A digests 00:19:41.989 03:31:06 -- host/auth.sh@56 -- # digest=null 00:19:41.989 03:31:06 -- host/auth.sh@56 -- # len=48 00:19:41.989 03:31:06 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:19:41.989 03:31:06 -- host/auth.sh@57 -- # key=ede866a7ad6e132485afccadd4d8ede3300bf2bec1cb0f62 00:19:41.989 03:31:06 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:19:41.989 03:31:06 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.Nyx 00:19:41.989 03:31:06 -- host/auth.sh@59 -- # format_dhchap_key ede866a7ad6e132485afccadd4d8ede3300bf2bec1cb0f62 0 00:19:41.989 03:31:06 -- nvmf/common.sh@708 -- # format_key DHHC-1 ede866a7ad6e132485afccadd4d8ede3300bf2bec1cb0f62 0 00:19:41.989 03:31:06 -- nvmf/common.sh@691 -- # local prefix key digest 00:19:41.989 03:31:06 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:19:41.989 03:31:06 -- nvmf/common.sh@693 -- # key=ede866a7ad6e132485afccadd4d8ede3300bf2bec1cb0f62 00:19:41.989 03:31:06 -- nvmf/common.sh@693 -- # digest=0 00:19:41.989 03:31:06 -- nvmf/common.sh@694 -- # python - 00:19:41.989 03:31:06 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.Nyx 00:19:41.989 03:31:06 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.Nyx 00:19:41.989 03:31:06 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.Nyx 00:19:41.989 03:31:06 -- host/auth.sh@83 -- # gen_key sha256 32 00:19:41.989 03:31:06 -- host/auth.sh@53 -- # local digest len file key 00:19:41.989 03:31:06 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:19:41.989 03:31:06 -- host/auth.sh@54 -- # local -A digests 00:19:41.989 03:31:06 -- host/auth.sh@56 -- # digest=sha256 00:19:41.989 03:31:06 -- host/auth.sh@56 -- # len=32 00:19:41.989 03:31:06 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:19:41.989 03:31:06 -- host/auth.sh@57 -- # key=4e3acb6b0d95c0f6527cfe26699c5681 00:19:41.989 03:31:06 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:19:41.989 03:31:06 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.cNd 00:19:41.989 03:31:06 -- host/auth.sh@59 -- # format_dhchap_key 4e3acb6b0d95c0f6527cfe26699c5681 1 00:19:41.989 03:31:06 -- nvmf/common.sh@708 -- # format_key DHHC-1 4e3acb6b0d95c0f6527cfe26699c5681 1 00:19:41.989 03:31:06 -- nvmf/common.sh@691 -- # local prefix key digest 00:19:41.989 03:31:06 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:19:41.989 03:31:06 -- nvmf/common.sh@693 -- # key=4e3acb6b0d95c0f6527cfe26699c5681 00:19:41.989 03:31:06 -- nvmf/common.sh@693 -- # digest=1 00:19:41.989 03:31:06 -- nvmf/common.sh@694 -- # python - 00:19:41.989 03:31:06 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.cNd 00:19:41.989 03:31:06 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.cNd 00:19:41.989 03:31:06 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.cNd 00:19:41.989 03:31:06 -- host/auth.sh@84 -- # gen_key sha384 48 00:19:41.989 03:31:06 -- host/auth.sh@53 -- # local digest len file key 00:19:41.989 03:31:06 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:19:41.989 03:31:06 -- host/auth.sh@54 -- # local -A digests 00:19:41.989 03:31:06 -- host/auth.sh@56 -- # digest=sha384 00:19:41.989 03:31:06 -- host/auth.sh@56 -- # len=48 00:19:41.989 03:31:06 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:19:41.989 03:31:06 -- host/auth.sh@57 -- # key=285186c70383c2411a16bb392b53744fe57490d878c36e37 00:19:41.989 03:31:06 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:19:41.989 03:31:06 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.iwP 00:19:41.989 03:31:06 -- host/auth.sh@59 -- # format_dhchap_key 285186c70383c2411a16bb392b53744fe57490d878c36e37 2 00:19:41.989 03:31:06 -- nvmf/common.sh@708 -- # format_key DHHC-1 285186c70383c2411a16bb392b53744fe57490d878c36e37 2 00:19:41.989 03:31:06 -- nvmf/common.sh@691 -- # local prefix key digest 00:19:41.989 03:31:06 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:19:41.989 03:31:06 -- nvmf/common.sh@693 -- # key=285186c70383c2411a16bb392b53744fe57490d878c36e37 00:19:41.989 03:31:06 -- nvmf/common.sh@693 -- # digest=2 00:19:41.989 03:31:06 -- nvmf/common.sh@694 -- # python - 00:19:41.989 03:31:06 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.iwP 00:19:41.989 03:31:06 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.iwP 00:19:41.989 03:31:06 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.iwP 00:19:41.989 03:31:06 -- host/auth.sh@85 -- # gen_key sha512 64 00:19:41.990 03:31:06 -- host/auth.sh@53 -- # local digest len file key 00:19:41.990 03:31:06 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:19:41.990 03:31:06 -- host/auth.sh@54 -- # local -A digests 00:19:41.990 03:31:06 -- host/auth.sh@56 -- # digest=sha512 00:19:41.990 03:31:06 -- host/auth.sh@56 -- # len=64 00:19:41.990 03:31:06 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:19:41.990 03:31:06 -- host/auth.sh@57 -- # key=e116891cd091c8d96545717df6130caed356f9c0313c7ac23e907c2624dd4a0a 00:19:41.990 03:31:06 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:19:41.990 03:31:06 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.n4j 00:19:41.990 03:31:06 -- host/auth.sh@59 -- # format_dhchap_key e116891cd091c8d96545717df6130caed356f9c0313c7ac23e907c2624dd4a0a 3 00:19:41.990 03:31:06 -- nvmf/common.sh@708 -- # format_key DHHC-1 e116891cd091c8d96545717df6130caed356f9c0313c7ac23e907c2624dd4a0a 3 00:19:41.990 03:31:06 -- nvmf/common.sh@691 -- # local prefix key digest 00:19:41.990 03:31:06 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:19:41.990 03:31:06 -- nvmf/common.sh@693 -- # key=e116891cd091c8d96545717df6130caed356f9c0313c7ac23e907c2624dd4a0a 00:19:41.990 03:31:06 -- nvmf/common.sh@693 -- # digest=3 00:19:41.990 03:31:06 -- nvmf/common.sh@694 -- # python - 00:19:41.990 03:31:06 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.n4j 00:19:41.990 03:31:06 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.n4j 00:19:41.990 03:31:06 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.n4j 00:19:41.990 03:31:06 -- host/auth.sh@87 -- # waitforlisten 1511860 00:19:41.990 03:31:06 -- common/autotest_common.sh@817 -- # '[' -z 1511860 ']' 00:19:41.990 03:31:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:41.990 03:31:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:41.990 03:31:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:41.990 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:41.990 03:31:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:41.990 03:31:06 -- common/autotest_common.sh@10 -- # set +x 00:19:42.249 03:31:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:42.249 03:31:07 -- common/autotest_common.sh@850 -- # return 0 00:19:42.249 03:31:07 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:19:42.249 03:31:07 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.7OM 00:19:42.249 03:31:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:42.249 03:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:42.249 03:31:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:42.249 03:31:07 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:19:42.249 03:31:07 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.Nyx 00:19:42.249 03:31:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:42.249 03:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:42.249 03:31:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:42.249 03:31:07 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:19:42.249 03:31:07 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.cNd 00:19:42.249 03:31:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:42.249 03:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:42.249 03:31:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:42.249 03:31:07 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:19:42.249 03:31:07 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.iwP 00:19:42.249 03:31:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:42.249 03:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:42.249 03:31:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:42.249 03:31:07 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:19:42.249 03:31:07 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.n4j 00:19:42.249 03:31:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:42.249 03:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:42.249 03:31:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:42.249 03:31:07 -- host/auth.sh@92 -- # nvmet_auth_init 00:19:42.249 03:31:07 -- host/auth.sh@35 -- # get_main_ns_ip 00:19:42.249 03:31:07 -- nvmf/common.sh@717 -- # local ip 00:19:42.249 03:31:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:42.249 03:31:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:42.249 03:31:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:42.249 03:31:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:42.249 03:31:07 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:42.249 03:31:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:42.249 03:31:07 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:42.249 03:31:07 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:42.249 03:31:07 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:42.249 03:31:07 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 10.0.0.1 00:19:42.249 03:31:07 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=10.0.0.1 00:19:42.249 03:31:07 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:19:42.249 03:31:07 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:19:42.249 03:31:07 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:19:42.249 03:31:07 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:19:42.249 03:31:07 -- nvmf/common.sh@628 -- # local block nvme 00:19:42.249 03:31:07 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:19:42.249 03:31:07 -- nvmf/common.sh@631 -- # modprobe nvmet 00:19:42.507 03:31:07 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:19:42.507 03:31:07 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:19:43.441 Waiting for block devices as requested 00:19:43.441 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:19:43.700 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:19:43.700 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:19:43.700 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:19:43.700 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:19:43.957 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:19:43.957 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:19:43.957 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:19:44.217 0000:0b:00.0 (8086 0a54): vfio-pci -> nvme 00:19:44.217 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:19:44.217 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:19:44.475 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:19:44.475 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:19:44.475 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:19:44.733 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:19:44.733 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:19:44.733 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:19:45.300 03:31:10 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:19:45.300 03:31:10 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:19:45.300 03:31:10 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:19:45.300 03:31:10 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:19:45.300 03:31:10 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:19:45.300 03:31:10 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:19:45.300 03:31:10 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:19:45.300 03:31:10 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:19:45.300 03:31:10 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:19:45.300 No valid GPT data, bailing 00:19:45.300 03:31:10 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:19:45.300 03:31:10 -- scripts/common.sh@391 -- # pt= 00:19:45.300 03:31:10 -- scripts/common.sh@392 -- # return 1 00:19:45.300 03:31:10 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:19:45.300 03:31:10 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:19:45.300 03:31:10 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:19:45.300 03:31:10 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:19:45.300 03:31:10 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:19:45.300 03:31:10 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:19:45.300 03:31:10 -- nvmf/common.sh@656 -- # echo 1 00:19:45.300 03:31:10 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:19:45.300 03:31:10 -- nvmf/common.sh@658 -- # echo 1 00:19:45.300 03:31:10 -- nvmf/common.sh@660 -- # echo 10.0.0.1 00:19:45.300 03:31:10 -- nvmf/common.sh@661 -- # echo tcp 00:19:45.300 03:31:10 -- nvmf/common.sh@662 -- # echo 4420 00:19:45.300 03:31:10 -- nvmf/common.sh@663 -- # echo ipv4 00:19:45.300 03:31:10 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:19:45.300 03:31:10 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -a 10.0.0.1 -t tcp -s 4420 00:19:45.300 00:19:45.300 Discovery Log Number of Records 2, Generation counter 2 00:19:45.300 =====Discovery Log Entry 0====== 00:19:45.300 trtype: tcp 00:19:45.300 adrfam: ipv4 00:19:45.300 subtype: current discovery subsystem 00:19:45.300 treq: not specified, sq flow control disable supported 00:19:45.300 portid: 1 00:19:45.300 trsvcid: 4420 00:19:45.300 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:19:45.300 traddr: 10.0.0.1 00:19:45.300 eflags: none 00:19:45.300 sectype: none 00:19:45.300 =====Discovery Log Entry 1====== 00:19:45.300 trtype: tcp 00:19:45.300 adrfam: ipv4 00:19:45.300 subtype: nvme subsystem 00:19:45.300 treq: not specified, sq flow control disable supported 00:19:45.300 portid: 1 00:19:45.300 trsvcid: 4420 00:19:45.300 subnqn: nqn.2024-02.io.spdk:cnode0 00:19:45.300 traddr: 10.0.0.1 00:19:45.300 eflags: none 00:19:45.300 sectype: none 00:19:45.300 03:31:10 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:19:45.300 03:31:10 -- host/auth.sh@37 -- # echo 0 00:19:45.300 03:31:10 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:19:45.300 03:31:10 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:19:45.300 03:31:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:45.300 03:31:10 -- host/auth.sh@44 -- # digest=sha256 00:19:45.300 03:31:10 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:45.300 03:31:10 -- host/auth.sh@44 -- # keyid=1 00:19:45.300 03:31:10 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:45.300 03:31:10 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:45.300 03:31:10 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:45.300 03:31:10 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:45.300 03:31:10 -- host/auth.sh@100 -- # IFS=, 00:19:45.300 03:31:10 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:19:45.300 03:31:10 -- host/auth.sh@100 -- # IFS=, 00:19:45.300 03:31:10 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:19:45.300 03:31:10 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:19:45.300 03:31:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:45.300 03:31:10 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:19:45.300 03:31:10 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:19:45.301 03:31:10 -- host/auth.sh@68 -- # keyid=1 00:19:45.301 03:31:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:19:45.301 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.301 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.301 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.301 03:31:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:45.301 03:31:10 -- nvmf/common.sh@717 -- # local ip 00:19:45.301 03:31:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:45.301 03:31:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:45.301 03:31:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:45.301 03:31:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:45.301 03:31:10 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:45.301 03:31:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:45.301 03:31:10 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:45.301 03:31:10 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:45.301 03:31:10 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:45.301 03:31:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:19:45.301 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.301 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.559 nvme0n1 00:19:45.559 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.559 03:31:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:45.559 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.559 03:31:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:45.559 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.559 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.559 03:31:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:45.559 03:31:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:45.559 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.559 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.559 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.559 03:31:10 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:19:45.559 03:31:10 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:19:45.559 03:31:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:45.559 03:31:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:19:45.559 03:31:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:45.559 03:31:10 -- host/auth.sh@44 -- # digest=sha256 00:19:45.559 03:31:10 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:45.559 03:31:10 -- host/auth.sh@44 -- # keyid=0 00:19:45.559 03:31:10 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:45.559 03:31:10 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:45.559 03:31:10 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:45.559 03:31:10 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:45.559 03:31:10 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:19:45.559 03:31:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:45.559 03:31:10 -- host/auth.sh@68 -- # digest=sha256 00:19:45.559 03:31:10 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:19:45.559 03:31:10 -- host/auth.sh@68 -- # keyid=0 00:19:45.559 03:31:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:19:45.559 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.559 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.559 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.559 03:31:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:45.559 03:31:10 -- nvmf/common.sh@717 -- # local ip 00:19:45.559 03:31:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:45.559 03:31:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:45.559 03:31:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:45.559 03:31:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:45.559 03:31:10 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:45.559 03:31:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:45.559 03:31:10 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:45.559 03:31:10 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:45.559 03:31:10 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:45.559 03:31:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:19:45.559 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.559 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.559 nvme0n1 00:19:45.559 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.817 03:31:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:45.817 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.817 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.817 03:31:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:45.817 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.817 03:31:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:45.817 03:31:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:45.817 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.817 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.817 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.817 03:31:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:45.817 03:31:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:19:45.817 03:31:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:45.817 03:31:10 -- host/auth.sh@44 -- # digest=sha256 00:19:45.817 03:31:10 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:45.817 03:31:10 -- host/auth.sh@44 -- # keyid=1 00:19:45.817 03:31:10 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:45.817 03:31:10 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:45.817 03:31:10 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:45.817 03:31:10 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:45.817 03:31:10 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:19:45.817 03:31:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:45.817 03:31:10 -- host/auth.sh@68 -- # digest=sha256 00:19:45.817 03:31:10 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:19:45.817 03:31:10 -- host/auth.sh@68 -- # keyid=1 00:19:45.817 03:31:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:19:45.817 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.817 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.817 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.817 03:31:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:45.817 03:31:10 -- nvmf/common.sh@717 -- # local ip 00:19:45.817 03:31:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:45.817 03:31:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:45.817 03:31:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:45.817 03:31:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:45.817 03:31:10 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:45.817 03:31:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:45.817 03:31:10 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:45.817 03:31:10 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:45.817 03:31:10 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:45.817 03:31:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:19:45.817 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.817 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.817 nvme0n1 00:19:45.817 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.817 03:31:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:45.817 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.817 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:45.817 03:31:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:45.817 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.075 03:31:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:46.075 03:31:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:46.075 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.075 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:46.075 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.075 03:31:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:46.075 03:31:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:19:46.075 03:31:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:46.075 03:31:10 -- host/auth.sh@44 -- # digest=sha256 00:19:46.075 03:31:10 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:46.075 03:31:10 -- host/auth.sh@44 -- # keyid=2 00:19:46.075 03:31:10 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:46.075 03:31:10 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:46.075 03:31:10 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:46.075 03:31:10 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:46.075 03:31:10 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:19:46.075 03:31:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:46.075 03:31:10 -- host/auth.sh@68 -- # digest=sha256 00:19:46.075 03:31:10 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:19:46.075 03:31:10 -- host/auth.sh@68 -- # keyid=2 00:19:46.075 03:31:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:19:46.075 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.075 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:46.075 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.075 03:31:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:46.075 03:31:10 -- nvmf/common.sh@717 -- # local ip 00:19:46.075 03:31:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:46.075 03:31:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:46.075 03:31:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:46.075 03:31:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:46.075 03:31:10 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:46.075 03:31:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:46.075 03:31:10 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:46.075 03:31:10 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:46.075 03:31:10 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:46.075 03:31:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:19:46.075 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.075 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:46.075 nvme0n1 00:19:46.075 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.075 03:31:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:46.075 03:31:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.075 03:31:10 -- common/autotest_common.sh@10 -- # set +x 00:19:46.075 03:31:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:46.075 03:31:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.075 03:31:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:46.075 03:31:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:46.075 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.075 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.075 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.075 03:31:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:46.075 03:31:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:19:46.075 03:31:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:46.075 03:31:11 -- host/auth.sh@44 -- # digest=sha256 00:19:46.075 03:31:11 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:46.075 03:31:11 -- host/auth.sh@44 -- # keyid=3 00:19:46.075 03:31:11 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:46.075 03:31:11 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:46.075 03:31:11 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:46.075 03:31:11 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:46.075 03:31:11 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:19:46.075 03:31:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:46.075 03:31:11 -- host/auth.sh@68 -- # digest=sha256 00:19:46.076 03:31:11 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:19:46.076 03:31:11 -- host/auth.sh@68 -- # keyid=3 00:19:46.076 03:31:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:19:46.076 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.076 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.076 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.076 03:31:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:46.076 03:31:11 -- nvmf/common.sh@717 -- # local ip 00:19:46.076 03:31:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:46.076 03:31:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:46.334 03:31:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:46.334 03:31:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:46.334 03:31:11 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:46.334 03:31:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:46.334 03:31:11 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:46.334 03:31:11 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:46.334 03:31:11 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:46.334 03:31:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:19:46.334 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.334 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.334 nvme0n1 00:19:46.334 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.334 03:31:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:46.334 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.334 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.334 03:31:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:46.334 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.334 03:31:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:46.334 03:31:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:46.334 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.334 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.334 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.334 03:31:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:46.334 03:31:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:19:46.334 03:31:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:46.334 03:31:11 -- host/auth.sh@44 -- # digest=sha256 00:19:46.334 03:31:11 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:46.334 03:31:11 -- host/auth.sh@44 -- # keyid=4 00:19:46.334 03:31:11 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:46.334 03:31:11 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:46.334 03:31:11 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:46.334 03:31:11 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:46.334 03:31:11 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:19:46.334 03:31:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:46.334 03:31:11 -- host/auth.sh@68 -- # digest=sha256 00:19:46.334 03:31:11 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:19:46.334 03:31:11 -- host/auth.sh@68 -- # keyid=4 00:19:46.334 03:31:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:19:46.334 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.334 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.334 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.334 03:31:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:46.334 03:31:11 -- nvmf/common.sh@717 -- # local ip 00:19:46.334 03:31:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:46.334 03:31:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:46.334 03:31:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:46.334 03:31:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:46.334 03:31:11 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:46.334 03:31:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:46.334 03:31:11 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:46.334 03:31:11 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:46.334 03:31:11 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:46.334 03:31:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:19:46.334 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.334 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.592 nvme0n1 00:19:46.592 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.592 03:31:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:46.592 03:31:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:46.592 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.592 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.592 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.592 03:31:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:46.592 03:31:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:46.592 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.592 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.592 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.592 03:31:11 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:19:46.592 03:31:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:46.592 03:31:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:19:46.592 03:31:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:46.592 03:31:11 -- host/auth.sh@44 -- # digest=sha256 00:19:46.592 03:31:11 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:19:46.592 03:31:11 -- host/auth.sh@44 -- # keyid=0 00:19:46.592 03:31:11 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:46.592 03:31:11 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:46.592 03:31:11 -- host/auth.sh@48 -- # echo ffdhe3072 00:19:46.592 03:31:11 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:46.592 03:31:11 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:19:46.592 03:31:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:46.592 03:31:11 -- host/auth.sh@68 -- # digest=sha256 00:19:46.592 03:31:11 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:19:46.592 03:31:11 -- host/auth.sh@68 -- # keyid=0 00:19:46.592 03:31:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:19:46.592 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.592 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.592 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.592 03:31:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:46.592 03:31:11 -- nvmf/common.sh@717 -- # local ip 00:19:46.592 03:31:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:46.592 03:31:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:46.592 03:31:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:46.592 03:31:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:46.592 03:31:11 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:46.592 03:31:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:46.592 03:31:11 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:46.592 03:31:11 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:46.592 03:31:11 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:46.592 03:31:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:19:46.592 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.592 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.851 nvme0n1 00:19:46.851 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.851 03:31:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:46.851 03:31:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:46.851 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.851 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.851 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.851 03:31:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:46.851 03:31:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:46.851 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.851 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.851 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.851 03:31:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:46.851 03:31:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:19:46.851 03:31:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:46.851 03:31:11 -- host/auth.sh@44 -- # digest=sha256 00:19:46.851 03:31:11 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:19:46.851 03:31:11 -- host/auth.sh@44 -- # keyid=1 00:19:46.851 03:31:11 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:46.851 03:31:11 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:46.851 03:31:11 -- host/auth.sh@48 -- # echo ffdhe3072 00:19:46.851 03:31:11 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:46.851 03:31:11 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:19:46.851 03:31:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:46.851 03:31:11 -- host/auth.sh@68 -- # digest=sha256 00:19:46.851 03:31:11 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:19:46.851 03:31:11 -- host/auth.sh@68 -- # keyid=1 00:19:46.851 03:31:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:19:46.851 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.851 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:46.851 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:46.851 03:31:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:46.851 03:31:11 -- nvmf/common.sh@717 -- # local ip 00:19:46.851 03:31:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:46.851 03:31:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:46.851 03:31:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:46.851 03:31:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:46.851 03:31:11 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:46.851 03:31:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:46.851 03:31:11 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:46.851 03:31:11 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:46.851 03:31:11 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:46.851 03:31:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:19:46.851 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:46.851 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:47.110 nvme0n1 00:19:47.110 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.110 03:31:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:47.110 03:31:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:47.110 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.110 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:47.110 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.110 03:31:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:47.110 03:31:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:47.110 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.110 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:47.110 03:31:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.110 03:31:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:47.110 03:31:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:19:47.110 03:31:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:47.110 03:31:11 -- host/auth.sh@44 -- # digest=sha256 00:19:47.110 03:31:11 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:19:47.110 03:31:11 -- host/auth.sh@44 -- # keyid=2 00:19:47.110 03:31:11 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:47.110 03:31:11 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:47.110 03:31:11 -- host/auth.sh@48 -- # echo ffdhe3072 00:19:47.110 03:31:11 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:47.110 03:31:11 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:19:47.110 03:31:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:47.110 03:31:11 -- host/auth.sh@68 -- # digest=sha256 00:19:47.110 03:31:11 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:19:47.110 03:31:11 -- host/auth.sh@68 -- # keyid=2 00:19:47.110 03:31:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:19:47.110 03:31:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.110 03:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:47.110 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.110 03:31:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:47.110 03:31:12 -- nvmf/common.sh@717 -- # local ip 00:19:47.110 03:31:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:47.110 03:31:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:47.110 03:31:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:47.110 03:31:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:47.110 03:31:12 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:47.110 03:31:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:47.110 03:31:12 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:47.110 03:31:12 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:47.110 03:31:12 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:47.110 03:31:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:19:47.110 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.110 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.369 nvme0n1 00:19:47.369 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.369 03:31:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:47.369 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.369 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.369 03:31:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:47.369 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.369 03:31:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:47.369 03:31:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:47.369 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.369 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.369 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.369 03:31:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:47.369 03:31:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:19:47.369 03:31:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:47.369 03:31:12 -- host/auth.sh@44 -- # digest=sha256 00:19:47.369 03:31:12 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:19:47.369 03:31:12 -- host/auth.sh@44 -- # keyid=3 00:19:47.369 03:31:12 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:47.369 03:31:12 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:47.369 03:31:12 -- host/auth.sh@48 -- # echo ffdhe3072 00:19:47.369 03:31:12 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:47.369 03:31:12 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:19:47.369 03:31:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:47.369 03:31:12 -- host/auth.sh@68 -- # digest=sha256 00:19:47.369 03:31:12 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:19:47.369 03:31:12 -- host/auth.sh@68 -- # keyid=3 00:19:47.369 03:31:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:19:47.369 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.369 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.369 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.369 03:31:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:47.369 03:31:12 -- nvmf/common.sh@717 -- # local ip 00:19:47.369 03:31:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:47.369 03:31:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:47.369 03:31:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:47.369 03:31:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:47.369 03:31:12 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:47.369 03:31:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:47.369 03:31:12 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:47.369 03:31:12 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:47.369 03:31:12 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:47.369 03:31:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:19:47.369 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.369 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.627 nvme0n1 00:19:47.627 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.627 03:31:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:47.627 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.627 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.627 03:31:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:47.627 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.627 03:31:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:47.627 03:31:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:47.627 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.627 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.627 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.627 03:31:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:47.627 03:31:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:19:47.627 03:31:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:47.627 03:31:12 -- host/auth.sh@44 -- # digest=sha256 00:19:47.627 03:31:12 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:19:47.627 03:31:12 -- host/auth.sh@44 -- # keyid=4 00:19:47.627 03:31:12 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:47.627 03:31:12 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:47.627 03:31:12 -- host/auth.sh@48 -- # echo ffdhe3072 00:19:47.627 03:31:12 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:47.627 03:31:12 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:19:47.627 03:31:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:47.627 03:31:12 -- host/auth.sh@68 -- # digest=sha256 00:19:47.627 03:31:12 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:19:47.627 03:31:12 -- host/auth.sh@68 -- # keyid=4 00:19:47.627 03:31:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:19:47.627 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.627 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.627 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.627 03:31:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:47.627 03:31:12 -- nvmf/common.sh@717 -- # local ip 00:19:47.627 03:31:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:47.627 03:31:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:47.627 03:31:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:47.627 03:31:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:47.627 03:31:12 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:47.627 03:31:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:47.627 03:31:12 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:47.627 03:31:12 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:47.627 03:31:12 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:47.627 03:31:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:19:47.627 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.627 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.885 nvme0n1 00:19:47.885 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.885 03:31:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:47.885 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.885 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.885 03:31:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:47.885 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.885 03:31:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:47.885 03:31:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:47.885 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.885 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.885 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.885 03:31:12 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:19:47.885 03:31:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:47.885 03:31:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:19:47.885 03:31:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:47.885 03:31:12 -- host/auth.sh@44 -- # digest=sha256 00:19:47.885 03:31:12 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:19:47.885 03:31:12 -- host/auth.sh@44 -- # keyid=0 00:19:47.885 03:31:12 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:47.885 03:31:12 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:47.885 03:31:12 -- host/auth.sh@48 -- # echo ffdhe4096 00:19:47.885 03:31:12 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:47.885 03:31:12 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:19:47.885 03:31:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:47.885 03:31:12 -- host/auth.sh@68 -- # digest=sha256 00:19:47.885 03:31:12 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:19:47.885 03:31:12 -- host/auth.sh@68 -- # keyid=0 00:19:47.885 03:31:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:19:47.885 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.885 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:47.885 03:31:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:47.885 03:31:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:47.885 03:31:12 -- nvmf/common.sh@717 -- # local ip 00:19:47.885 03:31:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:47.885 03:31:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:47.885 03:31:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:47.885 03:31:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:47.885 03:31:12 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:47.885 03:31:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:47.885 03:31:12 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:47.885 03:31:12 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:47.885 03:31:12 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:47.885 03:31:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:19:47.885 03:31:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:47.885 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:48.155 nvme0n1 00:19:48.155 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.155 03:31:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:48.155 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.155 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.155 03:31:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:48.155 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.155 03:31:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:48.155 03:31:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:48.155 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.155 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.418 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.418 03:31:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:48.418 03:31:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:19:48.418 03:31:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:48.418 03:31:13 -- host/auth.sh@44 -- # digest=sha256 00:19:48.418 03:31:13 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:19:48.418 03:31:13 -- host/auth.sh@44 -- # keyid=1 00:19:48.418 03:31:13 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:48.418 03:31:13 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:48.418 03:31:13 -- host/auth.sh@48 -- # echo ffdhe4096 00:19:48.418 03:31:13 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:48.418 03:31:13 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:19:48.418 03:31:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:48.418 03:31:13 -- host/auth.sh@68 -- # digest=sha256 00:19:48.418 03:31:13 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:19:48.418 03:31:13 -- host/auth.sh@68 -- # keyid=1 00:19:48.418 03:31:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:19:48.418 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.418 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.418 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.418 03:31:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:48.418 03:31:13 -- nvmf/common.sh@717 -- # local ip 00:19:48.418 03:31:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:48.418 03:31:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:48.418 03:31:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:48.418 03:31:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:48.418 03:31:13 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:48.418 03:31:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:48.418 03:31:13 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:48.418 03:31:13 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:48.418 03:31:13 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:48.418 03:31:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:19:48.418 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.418 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.676 nvme0n1 00:19:48.676 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.676 03:31:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:48.676 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.676 03:31:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:48.676 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.676 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.676 03:31:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:48.676 03:31:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:48.676 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.676 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.676 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.676 03:31:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:48.676 03:31:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:19:48.676 03:31:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:48.676 03:31:13 -- host/auth.sh@44 -- # digest=sha256 00:19:48.676 03:31:13 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:19:48.676 03:31:13 -- host/auth.sh@44 -- # keyid=2 00:19:48.676 03:31:13 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:48.676 03:31:13 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:48.676 03:31:13 -- host/auth.sh@48 -- # echo ffdhe4096 00:19:48.676 03:31:13 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:48.676 03:31:13 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:19:48.676 03:31:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:48.676 03:31:13 -- host/auth.sh@68 -- # digest=sha256 00:19:48.676 03:31:13 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:19:48.676 03:31:13 -- host/auth.sh@68 -- # keyid=2 00:19:48.676 03:31:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:19:48.676 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.676 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.676 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.676 03:31:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:48.676 03:31:13 -- nvmf/common.sh@717 -- # local ip 00:19:48.676 03:31:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:48.676 03:31:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:48.676 03:31:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:48.676 03:31:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:48.676 03:31:13 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:48.676 03:31:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:48.676 03:31:13 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:48.676 03:31:13 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:48.676 03:31:13 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:48.676 03:31:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:19:48.676 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.676 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.934 nvme0n1 00:19:48.934 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.934 03:31:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:48.934 03:31:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:48.934 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.934 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.934 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.934 03:31:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:48.934 03:31:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:48.934 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.934 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.934 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.934 03:31:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:48.934 03:31:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:19:48.934 03:31:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:48.934 03:31:13 -- host/auth.sh@44 -- # digest=sha256 00:19:48.934 03:31:13 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:19:48.934 03:31:13 -- host/auth.sh@44 -- # keyid=3 00:19:48.934 03:31:13 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:48.934 03:31:13 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:48.934 03:31:13 -- host/auth.sh@48 -- # echo ffdhe4096 00:19:48.934 03:31:13 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:48.934 03:31:13 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:19:48.934 03:31:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:48.934 03:31:13 -- host/auth.sh@68 -- # digest=sha256 00:19:48.934 03:31:13 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:19:48.934 03:31:13 -- host/auth.sh@68 -- # keyid=3 00:19:48.934 03:31:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:19:48.934 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.934 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:48.934 03:31:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:48.934 03:31:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:48.934 03:31:13 -- nvmf/common.sh@717 -- # local ip 00:19:48.934 03:31:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:48.934 03:31:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:48.934 03:31:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:48.934 03:31:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:48.934 03:31:13 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:48.934 03:31:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:48.934 03:31:13 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:48.934 03:31:13 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:48.934 03:31:13 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:48.934 03:31:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:19:48.934 03:31:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:48.934 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:49.193 nvme0n1 00:19:49.193 03:31:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:49.193 03:31:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:49.193 03:31:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:49.193 03:31:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:49.193 03:31:14 -- common/autotest_common.sh@10 -- # set +x 00:19:49.193 03:31:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:49.193 03:31:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:49.193 03:31:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:49.193 03:31:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:49.193 03:31:14 -- common/autotest_common.sh@10 -- # set +x 00:19:49.193 03:31:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:49.193 03:31:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:49.193 03:31:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:19:49.193 03:31:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:49.193 03:31:14 -- host/auth.sh@44 -- # digest=sha256 00:19:49.193 03:31:14 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:19:49.193 03:31:14 -- host/auth.sh@44 -- # keyid=4 00:19:49.193 03:31:14 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:49.193 03:31:14 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:49.193 03:31:14 -- host/auth.sh@48 -- # echo ffdhe4096 00:19:49.193 03:31:14 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:49.193 03:31:14 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:19:49.193 03:31:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:49.193 03:31:14 -- host/auth.sh@68 -- # digest=sha256 00:19:49.193 03:31:14 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:19:49.193 03:31:14 -- host/auth.sh@68 -- # keyid=4 00:19:49.193 03:31:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:19:49.193 03:31:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:49.193 03:31:14 -- common/autotest_common.sh@10 -- # set +x 00:19:49.451 03:31:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:49.451 03:31:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:49.451 03:31:14 -- nvmf/common.sh@717 -- # local ip 00:19:49.451 03:31:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:49.451 03:31:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:49.451 03:31:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:49.451 03:31:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:49.451 03:31:14 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:49.451 03:31:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:49.451 03:31:14 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:49.451 03:31:14 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:49.451 03:31:14 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:49.451 03:31:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:19:49.451 03:31:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:49.451 03:31:14 -- common/autotest_common.sh@10 -- # set +x 00:19:49.709 nvme0n1 00:19:49.709 03:31:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:49.709 03:31:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:49.709 03:31:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:49.709 03:31:14 -- common/autotest_common.sh@10 -- # set +x 00:19:49.709 03:31:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:49.709 03:31:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:49.709 03:31:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:49.709 03:31:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:49.709 03:31:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:49.709 03:31:14 -- common/autotest_common.sh@10 -- # set +x 00:19:49.709 03:31:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:49.709 03:31:14 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:19:49.709 03:31:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:49.709 03:31:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:19:49.709 03:31:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:49.709 03:31:14 -- host/auth.sh@44 -- # digest=sha256 00:19:49.709 03:31:14 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:19:49.709 03:31:14 -- host/auth.sh@44 -- # keyid=0 00:19:49.709 03:31:14 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:49.709 03:31:14 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:49.709 03:31:14 -- host/auth.sh@48 -- # echo ffdhe6144 00:19:49.709 03:31:14 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:49.709 03:31:14 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:19:49.709 03:31:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:49.709 03:31:14 -- host/auth.sh@68 -- # digest=sha256 00:19:49.709 03:31:14 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:19:49.709 03:31:14 -- host/auth.sh@68 -- # keyid=0 00:19:49.709 03:31:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:19:49.709 03:31:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:49.709 03:31:14 -- common/autotest_common.sh@10 -- # set +x 00:19:49.709 03:31:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:49.709 03:31:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:49.709 03:31:14 -- nvmf/common.sh@717 -- # local ip 00:19:49.709 03:31:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:49.709 03:31:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:49.709 03:31:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:49.709 03:31:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:49.709 03:31:14 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:49.709 03:31:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:49.709 03:31:14 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:49.709 03:31:14 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:49.709 03:31:14 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:49.709 03:31:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:19:49.709 03:31:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:49.709 03:31:14 -- common/autotest_common.sh@10 -- # set +x 00:19:50.275 nvme0n1 00:19:50.275 03:31:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:50.275 03:31:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:50.275 03:31:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:50.275 03:31:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:50.275 03:31:15 -- common/autotest_common.sh@10 -- # set +x 00:19:50.275 03:31:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:50.275 03:31:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:50.275 03:31:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:50.275 03:31:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:50.275 03:31:15 -- common/autotest_common.sh@10 -- # set +x 00:19:50.275 03:31:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:50.275 03:31:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:50.275 03:31:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:19:50.275 03:31:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:50.275 03:31:15 -- host/auth.sh@44 -- # digest=sha256 00:19:50.275 03:31:15 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:19:50.275 03:31:15 -- host/auth.sh@44 -- # keyid=1 00:19:50.275 03:31:15 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:50.275 03:31:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:50.275 03:31:15 -- host/auth.sh@48 -- # echo ffdhe6144 00:19:50.275 03:31:15 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:50.275 03:31:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:19:50.275 03:31:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:50.275 03:31:15 -- host/auth.sh@68 -- # digest=sha256 00:19:50.275 03:31:15 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:19:50.275 03:31:15 -- host/auth.sh@68 -- # keyid=1 00:19:50.275 03:31:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:19:50.275 03:31:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:50.275 03:31:15 -- common/autotest_common.sh@10 -- # set +x 00:19:50.275 03:31:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:50.275 03:31:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:50.275 03:31:15 -- nvmf/common.sh@717 -- # local ip 00:19:50.275 03:31:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:50.275 03:31:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:50.275 03:31:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:50.275 03:31:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:50.275 03:31:15 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:50.275 03:31:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:50.275 03:31:15 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:50.275 03:31:15 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:50.275 03:31:15 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:50.275 03:31:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:19:50.275 03:31:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:50.275 03:31:15 -- common/autotest_common.sh@10 -- # set +x 00:19:50.841 nvme0n1 00:19:50.841 03:31:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:50.841 03:31:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:50.841 03:31:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:50.841 03:31:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:50.841 03:31:15 -- common/autotest_common.sh@10 -- # set +x 00:19:50.841 03:31:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:50.841 03:31:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:50.841 03:31:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:50.841 03:31:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:50.841 03:31:15 -- common/autotest_common.sh@10 -- # set +x 00:19:50.841 03:31:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:50.841 03:31:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:50.841 03:31:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:19:50.841 03:31:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:50.841 03:31:15 -- host/auth.sh@44 -- # digest=sha256 00:19:50.841 03:31:15 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:19:50.841 03:31:15 -- host/auth.sh@44 -- # keyid=2 00:19:50.841 03:31:15 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:50.841 03:31:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:50.841 03:31:15 -- host/auth.sh@48 -- # echo ffdhe6144 00:19:50.841 03:31:15 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:50.841 03:31:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:19:50.841 03:31:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:50.841 03:31:15 -- host/auth.sh@68 -- # digest=sha256 00:19:50.841 03:31:15 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:19:50.841 03:31:15 -- host/auth.sh@68 -- # keyid=2 00:19:50.841 03:31:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:19:50.841 03:31:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:50.841 03:31:15 -- common/autotest_common.sh@10 -- # set +x 00:19:50.841 03:31:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:50.841 03:31:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:50.841 03:31:15 -- nvmf/common.sh@717 -- # local ip 00:19:50.841 03:31:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:50.841 03:31:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:50.841 03:31:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:50.841 03:31:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:50.841 03:31:15 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:50.841 03:31:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:50.841 03:31:15 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:50.841 03:31:15 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:50.841 03:31:15 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:50.841 03:31:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:19:50.841 03:31:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:50.841 03:31:15 -- common/autotest_common.sh@10 -- # set +x 00:19:51.408 nvme0n1 00:19:51.408 03:31:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:51.408 03:31:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:51.408 03:31:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:51.408 03:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:51.408 03:31:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:51.408 03:31:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:51.408 03:31:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:51.408 03:31:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:51.408 03:31:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:51.408 03:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:51.408 03:31:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:51.408 03:31:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:51.408 03:31:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:19:51.408 03:31:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:51.408 03:31:16 -- host/auth.sh@44 -- # digest=sha256 00:19:51.408 03:31:16 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:19:51.408 03:31:16 -- host/auth.sh@44 -- # keyid=3 00:19:51.408 03:31:16 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:51.408 03:31:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:51.408 03:31:16 -- host/auth.sh@48 -- # echo ffdhe6144 00:19:51.408 03:31:16 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:51.408 03:31:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:19:51.408 03:31:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:51.408 03:31:16 -- host/auth.sh@68 -- # digest=sha256 00:19:51.408 03:31:16 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:19:51.408 03:31:16 -- host/auth.sh@68 -- # keyid=3 00:19:51.408 03:31:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:19:51.408 03:31:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:51.408 03:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:51.408 03:31:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:51.408 03:31:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:51.408 03:31:16 -- nvmf/common.sh@717 -- # local ip 00:19:51.408 03:31:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:51.408 03:31:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:51.408 03:31:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:51.408 03:31:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:51.408 03:31:16 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:51.408 03:31:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:51.408 03:31:16 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:51.408 03:31:16 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:51.408 03:31:16 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:51.408 03:31:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:19:51.408 03:31:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:51.408 03:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:52.007 nvme0n1 00:19:52.007 03:31:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.007 03:31:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:52.007 03:31:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:52.007 03:31:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.007 03:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:52.007 03:31:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.007 03:31:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:52.007 03:31:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:52.007 03:31:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.007 03:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:52.007 03:31:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.007 03:31:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:52.007 03:31:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:19:52.007 03:31:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:52.007 03:31:16 -- host/auth.sh@44 -- # digest=sha256 00:19:52.007 03:31:16 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:19:52.007 03:31:16 -- host/auth.sh@44 -- # keyid=4 00:19:52.007 03:31:16 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:52.007 03:31:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:52.007 03:31:16 -- host/auth.sh@48 -- # echo ffdhe6144 00:19:52.007 03:31:16 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:52.007 03:31:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:19:52.007 03:31:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:52.007 03:31:16 -- host/auth.sh@68 -- # digest=sha256 00:19:52.007 03:31:16 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:19:52.007 03:31:16 -- host/auth.sh@68 -- # keyid=4 00:19:52.007 03:31:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:19:52.007 03:31:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.007 03:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:52.007 03:31:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.007 03:31:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:52.007 03:31:16 -- nvmf/common.sh@717 -- # local ip 00:19:52.007 03:31:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:52.007 03:31:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:52.007 03:31:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:52.007 03:31:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:52.007 03:31:16 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:52.007 03:31:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:52.007 03:31:16 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:52.007 03:31:16 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:52.007 03:31:16 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:52.007 03:31:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:19:52.007 03:31:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.007 03:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:52.573 nvme0n1 00:19:52.573 03:31:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.573 03:31:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:52.573 03:31:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.573 03:31:17 -- common/autotest_common.sh@10 -- # set +x 00:19:52.573 03:31:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:52.573 03:31:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.573 03:31:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:52.573 03:31:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:52.573 03:31:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.573 03:31:17 -- common/autotest_common.sh@10 -- # set +x 00:19:52.573 03:31:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.573 03:31:17 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:19:52.573 03:31:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:52.573 03:31:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:19:52.573 03:31:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:52.573 03:31:17 -- host/auth.sh@44 -- # digest=sha256 00:19:52.573 03:31:17 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:19:52.573 03:31:17 -- host/auth.sh@44 -- # keyid=0 00:19:52.573 03:31:17 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:52.573 03:31:17 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:52.573 03:31:17 -- host/auth.sh@48 -- # echo ffdhe8192 00:19:52.573 03:31:17 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:52.573 03:31:17 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:19:52.573 03:31:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:52.573 03:31:17 -- host/auth.sh@68 -- # digest=sha256 00:19:52.573 03:31:17 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:19:52.573 03:31:17 -- host/auth.sh@68 -- # keyid=0 00:19:52.573 03:31:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:19:52.573 03:31:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.573 03:31:17 -- common/autotest_common.sh@10 -- # set +x 00:19:52.573 03:31:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.573 03:31:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:52.573 03:31:17 -- nvmf/common.sh@717 -- # local ip 00:19:52.573 03:31:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:52.573 03:31:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:52.573 03:31:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:52.573 03:31:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:52.573 03:31:17 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:52.573 03:31:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:52.573 03:31:17 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:52.573 03:31:17 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:52.573 03:31:17 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:52.573 03:31:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:19:52.573 03:31:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.573 03:31:17 -- common/autotest_common.sh@10 -- # set +x 00:19:53.507 nvme0n1 00:19:53.507 03:31:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:53.508 03:31:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:53.508 03:31:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:53.508 03:31:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:53.508 03:31:18 -- common/autotest_common.sh@10 -- # set +x 00:19:53.508 03:31:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:53.508 03:31:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:53.508 03:31:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:53.508 03:31:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:53.508 03:31:18 -- common/autotest_common.sh@10 -- # set +x 00:19:53.508 03:31:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:53.508 03:31:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:53.508 03:31:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:19:53.508 03:31:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:53.508 03:31:18 -- host/auth.sh@44 -- # digest=sha256 00:19:53.508 03:31:18 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:19:53.508 03:31:18 -- host/auth.sh@44 -- # keyid=1 00:19:53.508 03:31:18 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:53.508 03:31:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:53.508 03:31:18 -- host/auth.sh@48 -- # echo ffdhe8192 00:19:53.508 03:31:18 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:53.508 03:31:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:19:53.508 03:31:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:53.508 03:31:18 -- host/auth.sh@68 -- # digest=sha256 00:19:53.508 03:31:18 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:19:53.508 03:31:18 -- host/auth.sh@68 -- # keyid=1 00:19:53.508 03:31:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:19:53.508 03:31:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:53.508 03:31:18 -- common/autotest_common.sh@10 -- # set +x 00:19:53.766 03:31:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:53.766 03:31:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:53.766 03:31:18 -- nvmf/common.sh@717 -- # local ip 00:19:53.766 03:31:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:53.766 03:31:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:53.766 03:31:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:53.766 03:31:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:53.766 03:31:18 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:53.766 03:31:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:53.766 03:31:18 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:53.766 03:31:18 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:53.766 03:31:18 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:53.766 03:31:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:19:53.766 03:31:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:53.766 03:31:18 -- common/autotest_common.sh@10 -- # set +x 00:19:54.701 nvme0n1 00:19:54.701 03:31:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:54.701 03:31:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:54.701 03:31:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:54.701 03:31:19 -- common/autotest_common.sh@10 -- # set +x 00:19:54.701 03:31:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:54.701 03:31:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:54.701 03:31:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:54.701 03:31:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:54.701 03:31:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:54.701 03:31:19 -- common/autotest_common.sh@10 -- # set +x 00:19:54.701 03:31:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:54.701 03:31:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:54.701 03:31:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:19:54.701 03:31:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:54.701 03:31:19 -- host/auth.sh@44 -- # digest=sha256 00:19:54.701 03:31:19 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:19:54.701 03:31:19 -- host/auth.sh@44 -- # keyid=2 00:19:54.701 03:31:19 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:54.701 03:31:19 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:54.701 03:31:19 -- host/auth.sh@48 -- # echo ffdhe8192 00:19:54.701 03:31:19 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:54.701 03:31:19 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:19:54.701 03:31:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:54.701 03:31:19 -- host/auth.sh@68 -- # digest=sha256 00:19:54.701 03:31:19 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:19:54.701 03:31:19 -- host/auth.sh@68 -- # keyid=2 00:19:54.701 03:31:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:19:54.701 03:31:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:54.701 03:31:19 -- common/autotest_common.sh@10 -- # set +x 00:19:54.701 03:31:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:54.701 03:31:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:54.701 03:31:19 -- nvmf/common.sh@717 -- # local ip 00:19:54.701 03:31:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:54.701 03:31:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:54.701 03:31:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:54.701 03:31:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:54.701 03:31:19 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:54.701 03:31:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:54.701 03:31:19 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:54.701 03:31:19 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:54.701 03:31:19 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:54.701 03:31:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:19:54.701 03:31:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:54.701 03:31:19 -- common/autotest_common.sh@10 -- # set +x 00:19:55.634 nvme0n1 00:19:55.634 03:31:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:55.634 03:31:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:55.634 03:31:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:55.634 03:31:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:55.634 03:31:20 -- common/autotest_common.sh@10 -- # set +x 00:19:55.634 03:31:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:55.634 03:31:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:55.634 03:31:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:55.634 03:31:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:55.634 03:31:20 -- common/autotest_common.sh@10 -- # set +x 00:19:55.634 03:31:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:55.634 03:31:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:55.634 03:31:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:19:55.634 03:31:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:55.634 03:31:20 -- host/auth.sh@44 -- # digest=sha256 00:19:55.634 03:31:20 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:19:55.634 03:31:20 -- host/auth.sh@44 -- # keyid=3 00:19:55.634 03:31:20 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:55.634 03:31:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:55.634 03:31:20 -- host/auth.sh@48 -- # echo ffdhe8192 00:19:55.634 03:31:20 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:55.634 03:31:20 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:19:55.634 03:31:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:55.634 03:31:20 -- host/auth.sh@68 -- # digest=sha256 00:19:55.634 03:31:20 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:19:55.634 03:31:20 -- host/auth.sh@68 -- # keyid=3 00:19:55.634 03:31:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:19:55.634 03:31:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:55.634 03:31:20 -- common/autotest_common.sh@10 -- # set +x 00:19:55.634 03:31:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:55.634 03:31:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:55.634 03:31:20 -- nvmf/common.sh@717 -- # local ip 00:19:55.634 03:31:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:55.634 03:31:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:55.634 03:31:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:55.634 03:31:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:55.634 03:31:20 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:55.635 03:31:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:55.635 03:31:20 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:55.635 03:31:20 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:55.635 03:31:20 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:55.635 03:31:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:19:55.635 03:31:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:55.635 03:31:20 -- common/autotest_common.sh@10 -- # set +x 00:19:57.006 nvme0n1 00:19:57.006 03:31:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.006 03:31:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:57.006 03:31:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.006 03:31:21 -- common/autotest_common.sh@10 -- # set +x 00:19:57.006 03:31:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:57.006 03:31:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.006 03:31:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:57.006 03:31:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:57.006 03:31:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.006 03:31:21 -- common/autotest_common.sh@10 -- # set +x 00:19:57.006 03:31:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.006 03:31:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:57.006 03:31:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:19:57.006 03:31:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:57.006 03:31:21 -- host/auth.sh@44 -- # digest=sha256 00:19:57.006 03:31:21 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:19:57.006 03:31:21 -- host/auth.sh@44 -- # keyid=4 00:19:57.006 03:31:21 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:57.006 03:31:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:19:57.006 03:31:21 -- host/auth.sh@48 -- # echo ffdhe8192 00:19:57.006 03:31:21 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:57.006 03:31:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:19:57.006 03:31:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:57.006 03:31:21 -- host/auth.sh@68 -- # digest=sha256 00:19:57.006 03:31:21 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:19:57.006 03:31:21 -- host/auth.sh@68 -- # keyid=4 00:19:57.006 03:31:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:19:57.006 03:31:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.006 03:31:21 -- common/autotest_common.sh@10 -- # set +x 00:19:57.006 03:31:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.006 03:31:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:57.006 03:31:21 -- nvmf/common.sh@717 -- # local ip 00:19:57.006 03:31:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:57.006 03:31:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:57.006 03:31:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:57.006 03:31:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:57.006 03:31:21 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:57.006 03:31:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:57.006 03:31:21 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:57.006 03:31:21 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:57.006 03:31:21 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:57.006 03:31:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:19:57.006 03:31:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.006 03:31:21 -- common/autotest_common.sh@10 -- # set +x 00:19:57.571 nvme0n1 00:19:57.571 03:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.571 03:31:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:57.571 03:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.571 03:31:22 -- common/autotest_common.sh@10 -- # set +x 00:19:57.571 03:31:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:57.571 03:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.571 03:31:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:57.571 03:31:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:57.571 03:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.571 03:31:22 -- common/autotest_common.sh@10 -- # set +x 00:19:57.829 03:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.829 03:31:22 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:19:57.829 03:31:22 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:19:57.829 03:31:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:57.829 03:31:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:19:57.829 03:31:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:57.829 03:31:22 -- host/auth.sh@44 -- # digest=sha384 00:19:57.829 03:31:22 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:57.829 03:31:22 -- host/auth.sh@44 -- # keyid=0 00:19:57.829 03:31:22 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:57.829 03:31:22 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:19:57.829 03:31:22 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:57.829 03:31:22 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:57.829 03:31:22 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:19:57.829 03:31:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:57.829 03:31:22 -- host/auth.sh@68 -- # digest=sha384 00:19:57.829 03:31:22 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:19:57.829 03:31:22 -- host/auth.sh@68 -- # keyid=0 00:19:57.829 03:31:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:19:57.829 03:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.829 03:31:22 -- common/autotest_common.sh@10 -- # set +x 00:19:57.829 03:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.829 03:31:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:57.829 03:31:22 -- nvmf/common.sh@717 -- # local ip 00:19:57.829 03:31:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:57.829 03:31:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:57.829 03:31:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:57.829 03:31:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:57.829 03:31:22 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:57.829 03:31:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:57.829 03:31:22 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:57.829 03:31:22 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:57.829 03:31:22 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:57.829 03:31:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:19:57.829 03:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.829 03:31:22 -- common/autotest_common.sh@10 -- # set +x 00:19:57.829 nvme0n1 00:19:57.829 03:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.829 03:31:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:57.829 03:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.829 03:31:22 -- common/autotest_common.sh@10 -- # set +x 00:19:57.829 03:31:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:57.829 03:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.829 03:31:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:57.829 03:31:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:57.829 03:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.829 03:31:22 -- common/autotest_common.sh@10 -- # set +x 00:19:57.829 03:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.829 03:31:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:57.829 03:31:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:19:57.829 03:31:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:57.829 03:31:22 -- host/auth.sh@44 -- # digest=sha384 00:19:57.829 03:31:22 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:57.829 03:31:22 -- host/auth.sh@44 -- # keyid=1 00:19:57.829 03:31:22 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:57.829 03:31:22 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:19:57.829 03:31:22 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:57.829 03:31:22 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:57.829 03:31:22 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:19:57.829 03:31:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:57.829 03:31:22 -- host/auth.sh@68 -- # digest=sha384 00:19:57.829 03:31:22 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:19:57.829 03:31:22 -- host/auth.sh@68 -- # keyid=1 00:19:57.829 03:31:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:19:57.829 03:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.829 03:31:22 -- common/autotest_common.sh@10 -- # set +x 00:19:57.829 03:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.829 03:31:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:57.829 03:31:22 -- nvmf/common.sh@717 -- # local ip 00:19:57.829 03:31:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:57.829 03:31:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:57.829 03:31:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:57.829 03:31:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:57.829 03:31:22 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:57.829 03:31:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:57.829 03:31:22 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:57.829 03:31:22 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:57.829 03:31:22 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:57.829 03:31:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:19:57.829 03:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.829 03:31:22 -- common/autotest_common.sh@10 -- # set +x 00:19:58.087 nvme0n1 00:19:58.087 03:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.087 03:31:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:58.087 03:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.087 03:31:22 -- common/autotest_common.sh@10 -- # set +x 00:19:58.087 03:31:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:58.087 03:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.087 03:31:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:58.087 03:31:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:58.088 03:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.088 03:31:22 -- common/autotest_common.sh@10 -- # set +x 00:19:58.088 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.088 03:31:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:58.088 03:31:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:19:58.088 03:31:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:58.088 03:31:23 -- host/auth.sh@44 -- # digest=sha384 00:19:58.088 03:31:23 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:58.088 03:31:23 -- host/auth.sh@44 -- # keyid=2 00:19:58.088 03:31:23 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:58.088 03:31:23 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:19:58.088 03:31:23 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:58.088 03:31:23 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:58.088 03:31:23 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:19:58.088 03:31:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:58.088 03:31:23 -- host/auth.sh@68 -- # digest=sha384 00:19:58.088 03:31:23 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:19:58.088 03:31:23 -- host/auth.sh@68 -- # keyid=2 00:19:58.088 03:31:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:19:58.088 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.088 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.088 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.088 03:31:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:58.088 03:31:23 -- nvmf/common.sh@717 -- # local ip 00:19:58.088 03:31:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:58.088 03:31:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:58.088 03:31:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:58.088 03:31:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:58.088 03:31:23 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:58.088 03:31:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:58.088 03:31:23 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:58.088 03:31:23 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:58.088 03:31:23 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:58.088 03:31:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:19:58.088 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.088 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.345 nvme0n1 00:19:58.345 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.345 03:31:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:58.345 03:31:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:58.345 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.345 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.345 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.345 03:31:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:58.345 03:31:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:58.345 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.345 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.345 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.345 03:31:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:58.345 03:31:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:19:58.345 03:31:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:58.345 03:31:23 -- host/auth.sh@44 -- # digest=sha384 00:19:58.345 03:31:23 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:58.345 03:31:23 -- host/auth.sh@44 -- # keyid=3 00:19:58.345 03:31:23 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:58.345 03:31:23 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:19:58.345 03:31:23 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:58.345 03:31:23 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:58.345 03:31:23 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:19:58.345 03:31:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:58.345 03:31:23 -- host/auth.sh@68 -- # digest=sha384 00:19:58.345 03:31:23 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:19:58.345 03:31:23 -- host/auth.sh@68 -- # keyid=3 00:19:58.345 03:31:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:19:58.345 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.345 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.345 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.345 03:31:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:58.345 03:31:23 -- nvmf/common.sh@717 -- # local ip 00:19:58.345 03:31:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:58.345 03:31:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:58.345 03:31:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:58.345 03:31:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:58.345 03:31:23 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:58.345 03:31:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:58.345 03:31:23 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:58.345 03:31:23 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:58.345 03:31:23 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:58.345 03:31:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:19:58.345 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.345 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.603 nvme0n1 00:19:58.603 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.603 03:31:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:58.603 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.603 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.603 03:31:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:58.603 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.603 03:31:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:58.603 03:31:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:58.603 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.603 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.603 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.603 03:31:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:58.603 03:31:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:19:58.603 03:31:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:58.603 03:31:23 -- host/auth.sh@44 -- # digest=sha384 00:19:58.603 03:31:23 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:19:58.603 03:31:23 -- host/auth.sh@44 -- # keyid=4 00:19:58.603 03:31:23 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:58.603 03:31:23 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:19:58.603 03:31:23 -- host/auth.sh@48 -- # echo ffdhe2048 00:19:58.603 03:31:23 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:58.603 03:31:23 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:19:58.603 03:31:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:58.603 03:31:23 -- host/auth.sh@68 -- # digest=sha384 00:19:58.603 03:31:23 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:19:58.603 03:31:23 -- host/auth.sh@68 -- # keyid=4 00:19:58.603 03:31:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:19:58.603 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.603 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.603 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.603 03:31:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:58.603 03:31:23 -- nvmf/common.sh@717 -- # local ip 00:19:58.603 03:31:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:58.603 03:31:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:58.603 03:31:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:58.603 03:31:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:58.603 03:31:23 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:58.603 03:31:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:58.603 03:31:23 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:58.603 03:31:23 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:58.603 03:31:23 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:58.603 03:31:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:19:58.603 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.603 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.860 nvme0n1 00:19:58.860 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.860 03:31:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:58.860 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.860 03:31:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:58.860 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.860 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.860 03:31:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:58.860 03:31:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:58.860 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.860 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.860 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.860 03:31:23 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:19:58.860 03:31:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:58.860 03:31:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:19:58.860 03:31:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:58.860 03:31:23 -- host/auth.sh@44 -- # digest=sha384 00:19:58.860 03:31:23 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:19:58.860 03:31:23 -- host/auth.sh@44 -- # keyid=0 00:19:58.860 03:31:23 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:58.860 03:31:23 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:19:58.860 03:31:23 -- host/auth.sh@48 -- # echo ffdhe3072 00:19:58.860 03:31:23 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:19:58.860 03:31:23 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:19:58.860 03:31:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:58.860 03:31:23 -- host/auth.sh@68 -- # digest=sha384 00:19:58.860 03:31:23 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:19:58.860 03:31:23 -- host/auth.sh@68 -- # keyid=0 00:19:58.860 03:31:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:19:58.860 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.860 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:58.860 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.860 03:31:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:58.860 03:31:23 -- nvmf/common.sh@717 -- # local ip 00:19:58.860 03:31:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:58.860 03:31:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:58.860 03:31:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:58.860 03:31:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:58.860 03:31:23 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:58.860 03:31:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:58.861 03:31:23 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:58.861 03:31:23 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:58.861 03:31:23 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:58.861 03:31:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:19:58.861 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.861 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:59.118 nvme0n1 00:19:59.118 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.118 03:31:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:59.118 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.118 03:31:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:59.118 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:59.118 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.118 03:31:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:59.118 03:31:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:59.118 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.118 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:59.118 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.118 03:31:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:59.118 03:31:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:19:59.118 03:31:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:59.118 03:31:23 -- host/auth.sh@44 -- # digest=sha384 00:19:59.118 03:31:23 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:19:59.118 03:31:23 -- host/auth.sh@44 -- # keyid=1 00:19:59.118 03:31:23 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:59.118 03:31:23 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:19:59.118 03:31:23 -- host/auth.sh@48 -- # echo ffdhe3072 00:19:59.118 03:31:23 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:19:59.118 03:31:23 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:19:59.118 03:31:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:59.118 03:31:23 -- host/auth.sh@68 -- # digest=sha384 00:19:59.118 03:31:23 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:19:59.118 03:31:23 -- host/auth.sh@68 -- # keyid=1 00:19:59.118 03:31:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:19:59.119 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.119 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:59.119 03:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.119 03:31:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:59.119 03:31:23 -- nvmf/common.sh@717 -- # local ip 00:19:59.119 03:31:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:59.119 03:31:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:59.119 03:31:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:59.119 03:31:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:59.119 03:31:23 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:59.119 03:31:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:59.119 03:31:23 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:59.119 03:31:23 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:59.119 03:31:23 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:59.119 03:31:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:19:59.119 03:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.119 03:31:23 -- common/autotest_common.sh@10 -- # set +x 00:19:59.376 nvme0n1 00:19:59.376 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.377 03:31:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:59.377 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.377 03:31:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:59.377 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.377 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.377 03:31:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:59.377 03:31:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:59.377 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.377 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.377 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.377 03:31:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:59.377 03:31:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:19:59.377 03:31:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:59.377 03:31:24 -- host/auth.sh@44 -- # digest=sha384 00:19:59.377 03:31:24 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:19:59.377 03:31:24 -- host/auth.sh@44 -- # keyid=2 00:19:59.377 03:31:24 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:59.377 03:31:24 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:19:59.377 03:31:24 -- host/auth.sh@48 -- # echo ffdhe3072 00:19:59.377 03:31:24 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:19:59.377 03:31:24 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:19:59.377 03:31:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:59.377 03:31:24 -- host/auth.sh@68 -- # digest=sha384 00:19:59.377 03:31:24 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:19:59.377 03:31:24 -- host/auth.sh@68 -- # keyid=2 00:19:59.377 03:31:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:19:59.377 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.377 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.377 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.377 03:31:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:59.377 03:31:24 -- nvmf/common.sh@717 -- # local ip 00:19:59.377 03:31:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:59.377 03:31:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:59.377 03:31:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:59.377 03:31:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:59.377 03:31:24 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:59.377 03:31:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:59.377 03:31:24 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:59.377 03:31:24 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:59.377 03:31:24 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:59.377 03:31:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:19:59.377 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.377 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.635 nvme0n1 00:19:59.635 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.635 03:31:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:59.635 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.635 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.635 03:31:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:59.635 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.635 03:31:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:59.635 03:31:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:59.635 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.635 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.635 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.635 03:31:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:59.635 03:31:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:19:59.635 03:31:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:59.635 03:31:24 -- host/auth.sh@44 -- # digest=sha384 00:19:59.635 03:31:24 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:19:59.635 03:31:24 -- host/auth.sh@44 -- # keyid=3 00:19:59.635 03:31:24 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:59.635 03:31:24 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:19:59.635 03:31:24 -- host/auth.sh@48 -- # echo ffdhe3072 00:19:59.635 03:31:24 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:19:59.635 03:31:24 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:19:59.635 03:31:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:59.635 03:31:24 -- host/auth.sh@68 -- # digest=sha384 00:19:59.635 03:31:24 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:19:59.635 03:31:24 -- host/auth.sh@68 -- # keyid=3 00:19:59.635 03:31:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:19:59.635 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.635 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.635 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.635 03:31:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:59.635 03:31:24 -- nvmf/common.sh@717 -- # local ip 00:19:59.635 03:31:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:59.635 03:31:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:59.635 03:31:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:59.635 03:31:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:59.635 03:31:24 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:59.635 03:31:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:59.635 03:31:24 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:59.635 03:31:24 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:59.635 03:31:24 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:59.635 03:31:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:19:59.635 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.635 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.892 nvme0n1 00:19:59.892 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.892 03:31:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:19:59.892 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.892 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.892 03:31:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:19:59.892 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.892 03:31:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:59.892 03:31:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:59.892 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.892 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.892 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.892 03:31:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:19:59.892 03:31:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:19:59.892 03:31:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:19:59.892 03:31:24 -- host/auth.sh@44 -- # digest=sha384 00:19:59.892 03:31:24 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:19:59.892 03:31:24 -- host/auth.sh@44 -- # keyid=4 00:19:59.892 03:31:24 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:59.892 03:31:24 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:19:59.892 03:31:24 -- host/auth.sh@48 -- # echo ffdhe3072 00:19:59.892 03:31:24 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:19:59.892 03:31:24 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:19:59.892 03:31:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:19:59.892 03:31:24 -- host/auth.sh@68 -- # digest=sha384 00:19:59.893 03:31:24 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:19:59.893 03:31:24 -- host/auth.sh@68 -- # keyid=4 00:19:59.893 03:31:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:19:59.893 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.893 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.893 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:59.893 03:31:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:19:59.893 03:31:24 -- nvmf/common.sh@717 -- # local ip 00:19:59.893 03:31:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:59.893 03:31:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:59.893 03:31:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:59.893 03:31:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:59.893 03:31:24 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:19:59.893 03:31:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:19:59.893 03:31:24 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:19:59.893 03:31:24 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:19:59.893 03:31:24 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:19:59.893 03:31:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:19:59.893 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:59.893 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:20:00.150 nvme0n1 00:20:00.151 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.151 03:31:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:00.151 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.151 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:20:00.151 03:31:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:00.151 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.151 03:31:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:00.151 03:31:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:00.151 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.151 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:20:00.151 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.151 03:31:24 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:00.151 03:31:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:00.151 03:31:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:20:00.151 03:31:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:00.151 03:31:24 -- host/auth.sh@44 -- # digest=sha384 00:20:00.151 03:31:24 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:00.151 03:31:24 -- host/auth.sh@44 -- # keyid=0 00:20:00.151 03:31:24 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:00.151 03:31:24 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:00.151 03:31:24 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:00.151 03:31:24 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:00.151 03:31:24 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:20:00.151 03:31:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:00.151 03:31:24 -- host/auth.sh@68 -- # digest=sha384 00:20:00.151 03:31:24 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:00.151 03:31:24 -- host/auth.sh@68 -- # keyid=0 00:20:00.151 03:31:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:20:00.151 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.151 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:20:00.151 03:31:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.151 03:31:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:00.151 03:31:24 -- nvmf/common.sh@717 -- # local ip 00:20:00.151 03:31:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:00.151 03:31:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:00.151 03:31:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:00.151 03:31:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:00.151 03:31:24 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:00.151 03:31:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:00.151 03:31:24 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:00.151 03:31:24 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:00.151 03:31:24 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:00.151 03:31:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:00.151 03:31:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.151 03:31:24 -- common/autotest_common.sh@10 -- # set +x 00:20:00.409 nvme0n1 00:20:00.409 03:31:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.409 03:31:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:00.409 03:31:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.409 03:31:25 -- common/autotest_common.sh@10 -- # set +x 00:20:00.409 03:31:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:00.409 03:31:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.409 03:31:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:00.409 03:31:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:00.409 03:31:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.409 03:31:25 -- common/autotest_common.sh@10 -- # set +x 00:20:00.409 03:31:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.409 03:31:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:00.409 03:31:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:20:00.409 03:31:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:00.409 03:31:25 -- host/auth.sh@44 -- # digest=sha384 00:20:00.409 03:31:25 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:00.409 03:31:25 -- host/auth.sh@44 -- # keyid=1 00:20:00.409 03:31:25 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:00.409 03:31:25 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:00.409 03:31:25 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:00.409 03:31:25 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:00.409 03:31:25 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:20:00.409 03:31:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:00.409 03:31:25 -- host/auth.sh@68 -- # digest=sha384 00:20:00.409 03:31:25 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:00.409 03:31:25 -- host/auth.sh@68 -- # keyid=1 00:20:00.409 03:31:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:20:00.409 03:31:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.409 03:31:25 -- common/autotest_common.sh@10 -- # set +x 00:20:00.409 03:31:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.409 03:31:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:00.409 03:31:25 -- nvmf/common.sh@717 -- # local ip 00:20:00.409 03:31:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:00.409 03:31:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:00.409 03:31:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:00.409 03:31:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:00.409 03:31:25 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:00.409 03:31:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:00.409 03:31:25 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:00.409 03:31:25 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:00.409 03:31:25 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:00.409 03:31:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:00.409 03:31:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.409 03:31:25 -- common/autotest_common.sh@10 -- # set +x 00:20:00.667 nvme0n1 00:20:00.667 03:31:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.667 03:31:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:00.667 03:31:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:00.667 03:31:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.667 03:31:25 -- common/autotest_common.sh@10 -- # set +x 00:20:00.667 03:31:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.667 03:31:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:00.667 03:31:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:00.667 03:31:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.667 03:31:25 -- common/autotest_common.sh@10 -- # set +x 00:20:00.925 03:31:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.925 03:31:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:00.925 03:31:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:20:00.925 03:31:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:00.925 03:31:25 -- host/auth.sh@44 -- # digest=sha384 00:20:00.925 03:31:25 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:00.925 03:31:25 -- host/auth.sh@44 -- # keyid=2 00:20:00.925 03:31:25 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:00.925 03:31:25 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:00.925 03:31:25 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:00.925 03:31:25 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:00.925 03:31:25 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:20:00.925 03:31:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:00.925 03:31:25 -- host/auth.sh@68 -- # digest=sha384 00:20:00.925 03:31:25 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:00.925 03:31:25 -- host/auth.sh@68 -- # keyid=2 00:20:00.925 03:31:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:20:00.925 03:31:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.925 03:31:25 -- common/autotest_common.sh@10 -- # set +x 00:20:00.925 03:31:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:00.925 03:31:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:00.925 03:31:25 -- nvmf/common.sh@717 -- # local ip 00:20:00.925 03:31:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:00.925 03:31:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:00.925 03:31:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:00.925 03:31:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:00.925 03:31:25 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:00.925 03:31:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:00.925 03:31:25 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:00.925 03:31:25 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:00.926 03:31:25 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:00.926 03:31:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:00.926 03:31:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:00.926 03:31:25 -- common/autotest_common.sh@10 -- # set +x 00:20:01.183 nvme0n1 00:20:01.183 03:31:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:01.183 03:31:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:01.183 03:31:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:01.183 03:31:25 -- common/autotest_common.sh@10 -- # set +x 00:20:01.183 03:31:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:01.183 03:31:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:01.183 03:31:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:01.183 03:31:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:01.183 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:01.183 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:01.183 03:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:01.183 03:31:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:01.183 03:31:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:20:01.183 03:31:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:01.183 03:31:26 -- host/auth.sh@44 -- # digest=sha384 00:20:01.183 03:31:26 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:01.183 03:31:26 -- host/auth.sh@44 -- # keyid=3 00:20:01.183 03:31:26 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:01.183 03:31:26 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:01.183 03:31:26 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:01.183 03:31:26 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:01.183 03:31:26 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:20:01.183 03:31:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:01.183 03:31:26 -- host/auth.sh@68 -- # digest=sha384 00:20:01.183 03:31:26 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:01.183 03:31:26 -- host/auth.sh@68 -- # keyid=3 00:20:01.183 03:31:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:20:01.183 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:01.183 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:01.183 03:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:01.183 03:31:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:01.183 03:31:26 -- nvmf/common.sh@717 -- # local ip 00:20:01.183 03:31:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:01.183 03:31:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:01.183 03:31:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:01.183 03:31:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:01.183 03:31:26 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:01.183 03:31:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:01.183 03:31:26 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:01.183 03:31:26 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:01.183 03:31:26 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:01.183 03:31:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:01.183 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:01.183 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:01.441 nvme0n1 00:20:01.441 03:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:01.441 03:31:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:01.441 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:01.441 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:01.441 03:31:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:01.441 03:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:01.441 03:31:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:01.441 03:31:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:01.441 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:01.441 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:01.441 03:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:01.441 03:31:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:01.441 03:31:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:20:01.442 03:31:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:01.442 03:31:26 -- host/auth.sh@44 -- # digest=sha384 00:20:01.442 03:31:26 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:01.442 03:31:26 -- host/auth.sh@44 -- # keyid=4 00:20:01.442 03:31:26 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:01.442 03:31:26 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:01.442 03:31:26 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:01.442 03:31:26 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:01.442 03:31:26 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:20:01.442 03:31:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:01.442 03:31:26 -- host/auth.sh@68 -- # digest=sha384 00:20:01.442 03:31:26 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:01.442 03:31:26 -- host/auth.sh@68 -- # keyid=4 00:20:01.442 03:31:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:20:01.442 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:01.442 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:01.442 03:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:01.442 03:31:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:01.442 03:31:26 -- nvmf/common.sh@717 -- # local ip 00:20:01.442 03:31:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:01.442 03:31:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:01.442 03:31:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:01.442 03:31:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:01.442 03:31:26 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:01.442 03:31:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:01.442 03:31:26 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:01.442 03:31:26 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:01.442 03:31:26 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:01.442 03:31:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:01.442 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:01.442 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:02.008 nvme0n1 00:20:02.008 03:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:02.008 03:31:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:02.008 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:02.008 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:02.008 03:31:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:02.008 03:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:02.008 03:31:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:02.008 03:31:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:02.008 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:02.008 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:02.008 03:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:02.008 03:31:26 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:02.008 03:31:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:02.008 03:31:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:20:02.008 03:31:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:02.008 03:31:26 -- host/auth.sh@44 -- # digest=sha384 00:20:02.008 03:31:26 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:02.008 03:31:26 -- host/auth.sh@44 -- # keyid=0 00:20:02.008 03:31:26 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:02.008 03:31:26 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:02.008 03:31:26 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:02.008 03:31:26 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:02.008 03:31:26 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:20:02.008 03:31:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:02.008 03:31:26 -- host/auth.sh@68 -- # digest=sha384 00:20:02.008 03:31:26 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:02.008 03:31:26 -- host/auth.sh@68 -- # keyid=0 00:20:02.008 03:31:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:20:02.008 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:02.008 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:02.008 03:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:02.008 03:31:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:02.008 03:31:26 -- nvmf/common.sh@717 -- # local ip 00:20:02.008 03:31:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:02.008 03:31:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:02.008 03:31:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:02.008 03:31:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:02.008 03:31:26 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:02.008 03:31:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:02.008 03:31:26 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:02.008 03:31:26 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:02.008 03:31:26 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:02.008 03:31:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:02.008 03:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:02.008 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:02.266 nvme0n1 00:20:02.266 03:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:02.524 03:31:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:02.524 03:31:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:02.524 03:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:02.524 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:20:02.524 03:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:02.524 03:31:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:02.524 03:31:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:02.524 03:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:02.524 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:20:02.524 03:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:02.524 03:31:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:02.524 03:31:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:20:02.524 03:31:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:02.524 03:31:27 -- host/auth.sh@44 -- # digest=sha384 00:20:02.524 03:31:27 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:02.524 03:31:27 -- host/auth.sh@44 -- # keyid=1 00:20:02.524 03:31:27 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:02.524 03:31:27 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:02.524 03:31:27 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:02.524 03:31:27 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:02.524 03:31:27 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:20:02.524 03:31:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:02.524 03:31:27 -- host/auth.sh@68 -- # digest=sha384 00:20:02.524 03:31:27 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:02.524 03:31:27 -- host/auth.sh@68 -- # keyid=1 00:20:02.524 03:31:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:20:02.524 03:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:02.524 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:20:02.524 03:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:02.524 03:31:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:02.524 03:31:27 -- nvmf/common.sh@717 -- # local ip 00:20:02.524 03:31:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:02.524 03:31:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:02.524 03:31:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:02.524 03:31:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:02.524 03:31:27 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:02.524 03:31:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:02.524 03:31:27 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:02.524 03:31:27 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:02.524 03:31:27 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:02.524 03:31:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:02.524 03:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:02.524 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:20:03.089 nvme0n1 00:20:03.089 03:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.089 03:31:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:03.089 03:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.089 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:20:03.089 03:31:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:03.089 03:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.089 03:31:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:03.089 03:31:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:03.089 03:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.089 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:20:03.089 03:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.089 03:31:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:03.089 03:31:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:20:03.089 03:31:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:03.089 03:31:27 -- host/auth.sh@44 -- # digest=sha384 00:20:03.089 03:31:27 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:03.089 03:31:27 -- host/auth.sh@44 -- # keyid=2 00:20:03.089 03:31:27 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:03.089 03:31:27 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:03.089 03:31:27 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:03.089 03:31:27 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:03.089 03:31:27 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:20:03.089 03:31:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:03.089 03:31:27 -- host/auth.sh@68 -- # digest=sha384 00:20:03.089 03:31:27 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:03.089 03:31:27 -- host/auth.sh@68 -- # keyid=2 00:20:03.089 03:31:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:20:03.089 03:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.089 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:20:03.089 03:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.089 03:31:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:03.089 03:31:27 -- nvmf/common.sh@717 -- # local ip 00:20:03.089 03:31:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:03.089 03:31:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:03.089 03:31:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:03.089 03:31:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:03.089 03:31:27 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:03.089 03:31:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:03.089 03:31:27 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:03.089 03:31:27 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:03.089 03:31:27 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:03.089 03:31:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:03.089 03:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.089 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:20:03.653 nvme0n1 00:20:03.653 03:31:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.653 03:31:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:03.653 03:31:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.653 03:31:28 -- common/autotest_common.sh@10 -- # set +x 00:20:03.653 03:31:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:03.653 03:31:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.653 03:31:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:03.653 03:31:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:03.653 03:31:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.653 03:31:28 -- common/autotest_common.sh@10 -- # set +x 00:20:03.653 03:31:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.653 03:31:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:03.653 03:31:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:20:03.653 03:31:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:03.653 03:31:28 -- host/auth.sh@44 -- # digest=sha384 00:20:03.653 03:31:28 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:03.653 03:31:28 -- host/auth.sh@44 -- # keyid=3 00:20:03.653 03:31:28 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:03.653 03:31:28 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:03.653 03:31:28 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:03.653 03:31:28 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:03.653 03:31:28 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:20:03.653 03:31:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:03.653 03:31:28 -- host/auth.sh@68 -- # digest=sha384 00:20:03.653 03:31:28 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:03.653 03:31:28 -- host/auth.sh@68 -- # keyid=3 00:20:03.653 03:31:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:20:03.653 03:31:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.653 03:31:28 -- common/autotest_common.sh@10 -- # set +x 00:20:03.653 03:31:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.653 03:31:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:03.653 03:31:28 -- nvmf/common.sh@717 -- # local ip 00:20:03.653 03:31:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:03.653 03:31:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:03.653 03:31:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:03.653 03:31:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:03.653 03:31:28 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:03.653 03:31:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:03.653 03:31:28 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:03.653 03:31:28 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:03.653 03:31:28 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:03.653 03:31:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:03.653 03:31:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.653 03:31:28 -- common/autotest_common.sh@10 -- # set +x 00:20:04.218 nvme0n1 00:20:04.218 03:31:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:04.218 03:31:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:04.218 03:31:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:04.218 03:31:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:04.218 03:31:29 -- common/autotest_common.sh@10 -- # set +x 00:20:04.218 03:31:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:04.218 03:31:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:04.218 03:31:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:04.218 03:31:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:04.218 03:31:29 -- common/autotest_common.sh@10 -- # set +x 00:20:04.218 03:31:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:04.218 03:31:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:04.218 03:31:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:20:04.218 03:31:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:04.218 03:31:29 -- host/auth.sh@44 -- # digest=sha384 00:20:04.218 03:31:29 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:04.218 03:31:29 -- host/auth.sh@44 -- # keyid=4 00:20:04.218 03:31:29 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:04.218 03:31:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:04.218 03:31:29 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:04.218 03:31:29 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:04.218 03:31:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:20:04.218 03:31:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:04.218 03:31:29 -- host/auth.sh@68 -- # digest=sha384 00:20:04.218 03:31:29 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:04.218 03:31:29 -- host/auth.sh@68 -- # keyid=4 00:20:04.218 03:31:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:20:04.218 03:31:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:04.218 03:31:29 -- common/autotest_common.sh@10 -- # set +x 00:20:04.218 03:31:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:04.218 03:31:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:04.218 03:31:29 -- nvmf/common.sh@717 -- # local ip 00:20:04.218 03:31:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:04.218 03:31:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:04.218 03:31:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:04.218 03:31:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:04.218 03:31:29 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:04.218 03:31:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:04.218 03:31:29 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:04.218 03:31:29 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:04.218 03:31:29 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:04.218 03:31:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:04.218 03:31:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:04.218 03:31:29 -- common/autotest_common.sh@10 -- # set +x 00:20:04.782 nvme0n1 00:20:04.782 03:31:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:04.782 03:31:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:04.782 03:31:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:04.782 03:31:29 -- common/autotest_common.sh@10 -- # set +x 00:20:04.782 03:31:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:04.782 03:31:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:04.783 03:31:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:04.783 03:31:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:04.783 03:31:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:04.783 03:31:29 -- common/autotest_common.sh@10 -- # set +x 00:20:04.783 03:31:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:04.783 03:31:29 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:04.783 03:31:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:04.783 03:31:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:20:04.783 03:31:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:04.783 03:31:29 -- host/auth.sh@44 -- # digest=sha384 00:20:04.783 03:31:29 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:04.783 03:31:29 -- host/auth.sh@44 -- # keyid=0 00:20:04.783 03:31:29 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:04.783 03:31:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:04.783 03:31:29 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:04.783 03:31:29 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:04.783 03:31:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:20:04.783 03:31:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:04.783 03:31:29 -- host/auth.sh@68 -- # digest=sha384 00:20:04.783 03:31:29 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:04.783 03:31:29 -- host/auth.sh@68 -- # keyid=0 00:20:04.783 03:31:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:20:04.783 03:31:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:04.783 03:31:29 -- common/autotest_common.sh@10 -- # set +x 00:20:05.040 03:31:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:05.040 03:31:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:05.040 03:31:29 -- nvmf/common.sh@717 -- # local ip 00:20:05.040 03:31:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:05.040 03:31:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:05.040 03:31:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:05.040 03:31:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:05.040 03:31:29 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:05.040 03:31:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:05.040 03:31:29 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:05.040 03:31:29 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:05.040 03:31:29 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:05.040 03:31:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:05.040 03:31:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:05.040 03:31:29 -- common/autotest_common.sh@10 -- # set +x 00:20:05.975 nvme0n1 00:20:05.975 03:31:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:05.975 03:31:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:05.975 03:31:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:05.975 03:31:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:05.975 03:31:30 -- common/autotest_common.sh@10 -- # set +x 00:20:05.975 03:31:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:05.975 03:31:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:05.975 03:31:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:05.975 03:31:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:05.975 03:31:30 -- common/autotest_common.sh@10 -- # set +x 00:20:05.975 03:31:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:05.975 03:31:30 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:05.975 03:31:30 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:20:05.975 03:31:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:05.975 03:31:30 -- host/auth.sh@44 -- # digest=sha384 00:20:05.975 03:31:30 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:05.975 03:31:30 -- host/auth.sh@44 -- # keyid=1 00:20:05.975 03:31:30 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:05.975 03:31:30 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:05.975 03:31:30 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:05.975 03:31:30 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:05.975 03:31:30 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:20:05.975 03:31:30 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:05.975 03:31:30 -- host/auth.sh@68 -- # digest=sha384 00:20:05.975 03:31:30 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:05.975 03:31:30 -- host/auth.sh@68 -- # keyid=1 00:20:05.975 03:31:30 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:20:05.975 03:31:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:05.975 03:31:30 -- common/autotest_common.sh@10 -- # set +x 00:20:05.975 03:31:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:05.975 03:31:30 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:05.975 03:31:30 -- nvmf/common.sh@717 -- # local ip 00:20:05.975 03:31:30 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:05.975 03:31:30 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:05.975 03:31:30 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:05.975 03:31:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:05.975 03:31:30 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:05.975 03:31:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:05.975 03:31:30 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:05.975 03:31:30 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:05.975 03:31:30 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:05.975 03:31:30 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:05.975 03:31:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:05.975 03:31:30 -- common/autotest_common.sh@10 -- # set +x 00:20:06.910 nvme0n1 00:20:06.910 03:31:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.910 03:31:31 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:06.910 03:31:31 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:06.910 03:31:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.910 03:31:31 -- common/autotest_common.sh@10 -- # set +x 00:20:06.910 03:31:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.910 03:31:31 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:06.911 03:31:31 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:06.911 03:31:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.911 03:31:31 -- common/autotest_common.sh@10 -- # set +x 00:20:06.911 03:31:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.911 03:31:31 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:06.911 03:31:31 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:20:06.911 03:31:31 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:06.911 03:31:31 -- host/auth.sh@44 -- # digest=sha384 00:20:06.911 03:31:31 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:06.911 03:31:31 -- host/auth.sh@44 -- # keyid=2 00:20:06.911 03:31:31 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:06.911 03:31:31 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:06.911 03:31:31 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:06.911 03:31:31 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:06.911 03:31:31 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:20:06.911 03:31:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:06.911 03:31:31 -- host/auth.sh@68 -- # digest=sha384 00:20:06.911 03:31:31 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:06.911 03:31:31 -- host/auth.sh@68 -- # keyid=2 00:20:06.911 03:31:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:20:06.911 03:31:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.911 03:31:31 -- common/autotest_common.sh@10 -- # set +x 00:20:06.911 03:31:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.911 03:31:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:06.911 03:31:31 -- nvmf/common.sh@717 -- # local ip 00:20:06.911 03:31:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:06.911 03:31:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:06.911 03:31:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:06.911 03:31:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:06.911 03:31:31 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:06.911 03:31:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:06.911 03:31:31 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:06.911 03:31:31 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:06.911 03:31:31 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:06.911 03:31:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:06.911 03:31:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.911 03:31:31 -- common/autotest_common.sh@10 -- # set +x 00:20:07.844 nvme0n1 00:20:07.844 03:31:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:07.844 03:31:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:07.844 03:31:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:07.844 03:31:32 -- common/autotest_common.sh@10 -- # set +x 00:20:07.844 03:31:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:07.844 03:31:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:08.138 03:31:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:08.138 03:31:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:08.138 03:31:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:08.138 03:31:32 -- common/autotest_common.sh@10 -- # set +x 00:20:08.138 03:31:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:08.138 03:31:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:08.138 03:31:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:20:08.138 03:31:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:08.138 03:31:32 -- host/auth.sh@44 -- # digest=sha384 00:20:08.138 03:31:32 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:08.138 03:31:32 -- host/auth.sh@44 -- # keyid=3 00:20:08.138 03:31:32 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:08.138 03:31:32 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:08.138 03:31:32 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:08.138 03:31:32 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:08.138 03:31:32 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:20:08.138 03:31:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:08.138 03:31:32 -- host/auth.sh@68 -- # digest=sha384 00:20:08.138 03:31:32 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:08.138 03:31:32 -- host/auth.sh@68 -- # keyid=3 00:20:08.138 03:31:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:20:08.138 03:31:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:08.138 03:31:32 -- common/autotest_common.sh@10 -- # set +x 00:20:08.138 03:31:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:08.138 03:31:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:08.138 03:31:32 -- nvmf/common.sh@717 -- # local ip 00:20:08.138 03:31:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:08.138 03:31:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:08.138 03:31:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:08.138 03:31:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:08.138 03:31:32 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:08.138 03:31:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:08.138 03:31:32 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:08.138 03:31:32 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:08.138 03:31:32 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:08.138 03:31:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:08.138 03:31:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:08.138 03:31:32 -- common/autotest_common.sh@10 -- # set +x 00:20:09.078 nvme0n1 00:20:09.078 03:31:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:09.078 03:31:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:09.078 03:31:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:09.078 03:31:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:09.078 03:31:33 -- common/autotest_common.sh@10 -- # set +x 00:20:09.078 03:31:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:09.078 03:31:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:09.078 03:31:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:09.078 03:31:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:09.078 03:31:33 -- common/autotest_common.sh@10 -- # set +x 00:20:09.078 03:31:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:09.078 03:31:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:09.078 03:31:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:20:09.078 03:31:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:09.078 03:31:33 -- host/auth.sh@44 -- # digest=sha384 00:20:09.078 03:31:33 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:09.078 03:31:33 -- host/auth.sh@44 -- # keyid=4 00:20:09.078 03:31:33 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:09.078 03:31:33 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:09.078 03:31:33 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:09.078 03:31:33 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:09.079 03:31:33 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:20:09.079 03:31:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:09.079 03:31:33 -- host/auth.sh@68 -- # digest=sha384 00:20:09.079 03:31:33 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:09.079 03:31:33 -- host/auth.sh@68 -- # keyid=4 00:20:09.079 03:31:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:20:09.079 03:31:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:09.079 03:31:33 -- common/autotest_common.sh@10 -- # set +x 00:20:09.079 03:31:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:09.079 03:31:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:09.079 03:31:33 -- nvmf/common.sh@717 -- # local ip 00:20:09.079 03:31:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:09.079 03:31:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:09.079 03:31:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:09.079 03:31:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:09.079 03:31:33 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:09.079 03:31:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:09.079 03:31:33 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:09.079 03:31:33 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:09.079 03:31:33 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:09.079 03:31:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:09.079 03:31:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:09.079 03:31:33 -- common/autotest_common.sh@10 -- # set +x 00:20:10.012 nvme0n1 00:20:10.012 03:31:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.012 03:31:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:10.012 03:31:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.012 03:31:34 -- common/autotest_common.sh@10 -- # set +x 00:20:10.012 03:31:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:10.012 03:31:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.012 03:31:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:10.012 03:31:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:10.012 03:31:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.012 03:31:34 -- common/autotest_common.sh@10 -- # set +x 00:20:10.012 03:31:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.012 03:31:34 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:20:10.012 03:31:34 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:10.012 03:31:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:10.012 03:31:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:20:10.012 03:31:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:10.012 03:31:34 -- host/auth.sh@44 -- # digest=sha512 00:20:10.012 03:31:34 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:10.012 03:31:34 -- host/auth.sh@44 -- # keyid=0 00:20:10.012 03:31:34 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:10.012 03:31:34 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:10.012 03:31:34 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:10.013 03:31:34 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:10.013 03:31:34 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:20:10.013 03:31:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:10.013 03:31:34 -- host/auth.sh@68 -- # digest=sha512 00:20:10.013 03:31:34 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:10.013 03:31:34 -- host/auth.sh@68 -- # keyid=0 00:20:10.013 03:31:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:20:10.013 03:31:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.013 03:31:34 -- common/autotest_common.sh@10 -- # set +x 00:20:10.013 03:31:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.013 03:31:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:10.013 03:31:34 -- nvmf/common.sh@717 -- # local ip 00:20:10.013 03:31:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:10.013 03:31:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:10.013 03:31:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:10.013 03:31:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:10.013 03:31:34 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:10.013 03:31:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:10.013 03:31:34 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:10.013 03:31:34 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:10.013 03:31:34 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:10.013 03:31:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:10.013 03:31:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.013 03:31:34 -- common/autotest_common.sh@10 -- # set +x 00:20:10.271 nvme0n1 00:20:10.271 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.271 03:31:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:10.271 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.271 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.271 03:31:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:10.271 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.271 03:31:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:10.271 03:31:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:10.271 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.271 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.271 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.271 03:31:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:10.271 03:31:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:20:10.271 03:31:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:10.271 03:31:35 -- host/auth.sh@44 -- # digest=sha512 00:20:10.271 03:31:35 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:10.271 03:31:35 -- host/auth.sh@44 -- # keyid=1 00:20:10.271 03:31:35 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:10.271 03:31:35 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:10.271 03:31:35 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:10.271 03:31:35 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:10.271 03:31:35 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:20:10.271 03:31:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:10.271 03:31:35 -- host/auth.sh@68 -- # digest=sha512 00:20:10.271 03:31:35 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:10.271 03:31:35 -- host/auth.sh@68 -- # keyid=1 00:20:10.271 03:31:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:20:10.271 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.271 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.271 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.271 03:31:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:10.271 03:31:35 -- nvmf/common.sh@717 -- # local ip 00:20:10.271 03:31:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:10.271 03:31:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:10.271 03:31:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:10.271 03:31:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:10.271 03:31:35 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:10.271 03:31:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:10.271 03:31:35 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:10.271 03:31:35 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:10.271 03:31:35 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:10.271 03:31:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:10.271 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.271 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.529 nvme0n1 00:20:10.530 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.530 03:31:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:10.530 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.530 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.530 03:31:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:10.530 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.530 03:31:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:10.530 03:31:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:10.530 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.530 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.530 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.530 03:31:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:10.530 03:31:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:20:10.530 03:31:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:10.530 03:31:35 -- host/auth.sh@44 -- # digest=sha512 00:20:10.530 03:31:35 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:10.530 03:31:35 -- host/auth.sh@44 -- # keyid=2 00:20:10.530 03:31:35 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:10.530 03:31:35 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:10.530 03:31:35 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:10.530 03:31:35 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:10.530 03:31:35 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:20:10.530 03:31:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:10.530 03:31:35 -- host/auth.sh@68 -- # digest=sha512 00:20:10.530 03:31:35 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:10.530 03:31:35 -- host/auth.sh@68 -- # keyid=2 00:20:10.530 03:31:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:20:10.530 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.530 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.530 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.530 03:31:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:10.530 03:31:35 -- nvmf/common.sh@717 -- # local ip 00:20:10.530 03:31:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:10.530 03:31:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:10.530 03:31:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:10.530 03:31:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:10.530 03:31:35 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:10.530 03:31:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:10.530 03:31:35 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:10.530 03:31:35 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:10.530 03:31:35 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:10.530 03:31:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:10.530 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.530 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.530 nvme0n1 00:20:10.530 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.530 03:31:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:10.530 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.530 03:31:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:10.530 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.530 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.788 03:31:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:10.788 03:31:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:10.788 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.788 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.788 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.788 03:31:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:10.788 03:31:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:20:10.788 03:31:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:10.788 03:31:35 -- host/auth.sh@44 -- # digest=sha512 00:20:10.788 03:31:35 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:10.788 03:31:35 -- host/auth.sh@44 -- # keyid=3 00:20:10.788 03:31:35 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:10.788 03:31:35 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:10.788 03:31:35 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:10.788 03:31:35 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:10.788 03:31:35 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:20:10.788 03:31:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:10.788 03:31:35 -- host/auth.sh@68 -- # digest=sha512 00:20:10.788 03:31:35 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:10.788 03:31:35 -- host/auth.sh@68 -- # keyid=3 00:20:10.788 03:31:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:20:10.788 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.788 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.788 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.788 03:31:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:10.788 03:31:35 -- nvmf/common.sh@717 -- # local ip 00:20:10.788 03:31:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:10.788 03:31:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:10.788 03:31:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:10.788 03:31:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:10.788 03:31:35 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:10.788 03:31:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:10.788 03:31:35 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:10.788 03:31:35 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:10.788 03:31:35 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:10.788 03:31:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:10.788 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.788 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.788 nvme0n1 00:20:10.788 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.788 03:31:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:10.788 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.788 03:31:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:10.788 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:10.788 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:10.788 03:31:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:10.788 03:31:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:10.788 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:10.788 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:11.047 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.047 03:31:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:11.047 03:31:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:20:11.047 03:31:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:11.047 03:31:35 -- host/auth.sh@44 -- # digest=sha512 00:20:11.047 03:31:35 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:11.047 03:31:35 -- host/auth.sh@44 -- # keyid=4 00:20:11.047 03:31:35 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:11.047 03:31:35 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:11.047 03:31:35 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:11.047 03:31:35 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:11.047 03:31:35 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:20:11.047 03:31:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:11.047 03:31:35 -- host/auth.sh@68 -- # digest=sha512 00:20:11.047 03:31:35 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:11.047 03:31:35 -- host/auth.sh@68 -- # keyid=4 00:20:11.047 03:31:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:20:11.047 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.047 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:11.047 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.047 03:31:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:11.047 03:31:35 -- nvmf/common.sh@717 -- # local ip 00:20:11.047 03:31:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:11.047 03:31:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:11.047 03:31:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:11.047 03:31:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:11.047 03:31:35 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:11.047 03:31:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:11.047 03:31:35 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:11.047 03:31:35 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:11.047 03:31:35 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:11.047 03:31:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:11.047 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.047 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:11.047 nvme0n1 00:20:11.047 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.047 03:31:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:11.047 03:31:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:11.047 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.047 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:11.047 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.047 03:31:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:11.047 03:31:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:11.047 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.047 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:11.047 03:31:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.047 03:31:35 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:11.047 03:31:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:11.047 03:31:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:20:11.047 03:31:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:11.047 03:31:35 -- host/auth.sh@44 -- # digest=sha512 00:20:11.047 03:31:35 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:11.047 03:31:35 -- host/auth.sh@44 -- # keyid=0 00:20:11.047 03:31:35 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:11.047 03:31:35 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:11.047 03:31:35 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:11.047 03:31:35 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:11.047 03:31:35 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:20:11.047 03:31:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:11.047 03:31:35 -- host/auth.sh@68 -- # digest=sha512 00:20:11.047 03:31:35 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:11.047 03:31:35 -- host/auth.sh@68 -- # keyid=0 00:20:11.047 03:31:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:20:11.047 03:31:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.047 03:31:35 -- common/autotest_common.sh@10 -- # set +x 00:20:11.047 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.047 03:31:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:11.047 03:31:36 -- nvmf/common.sh@717 -- # local ip 00:20:11.047 03:31:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:11.047 03:31:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:11.047 03:31:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:11.047 03:31:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:11.047 03:31:36 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:11.047 03:31:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:11.047 03:31:36 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:11.047 03:31:36 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:11.047 03:31:36 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:11.047 03:31:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:11.047 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.047 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.306 nvme0n1 00:20:11.306 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.306 03:31:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:11.306 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.306 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.306 03:31:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:11.306 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.306 03:31:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:11.306 03:31:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:11.306 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.306 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.306 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.306 03:31:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:11.306 03:31:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:20:11.306 03:31:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:11.306 03:31:36 -- host/auth.sh@44 -- # digest=sha512 00:20:11.306 03:31:36 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:11.306 03:31:36 -- host/auth.sh@44 -- # keyid=1 00:20:11.306 03:31:36 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:11.306 03:31:36 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:11.306 03:31:36 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:11.306 03:31:36 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:11.306 03:31:36 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:20:11.306 03:31:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:11.306 03:31:36 -- host/auth.sh@68 -- # digest=sha512 00:20:11.306 03:31:36 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:11.306 03:31:36 -- host/auth.sh@68 -- # keyid=1 00:20:11.306 03:31:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:20:11.306 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.306 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.306 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.306 03:31:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:11.306 03:31:36 -- nvmf/common.sh@717 -- # local ip 00:20:11.306 03:31:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:11.306 03:31:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:11.306 03:31:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:11.306 03:31:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:11.306 03:31:36 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:11.306 03:31:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:11.306 03:31:36 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:11.306 03:31:36 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:11.307 03:31:36 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:11.307 03:31:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:11.307 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.307 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.565 nvme0n1 00:20:11.565 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.565 03:31:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:11.565 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.565 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.565 03:31:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:11.565 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.565 03:31:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:11.565 03:31:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:11.565 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.565 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.565 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.565 03:31:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:11.565 03:31:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:20:11.565 03:31:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:11.565 03:31:36 -- host/auth.sh@44 -- # digest=sha512 00:20:11.565 03:31:36 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:11.565 03:31:36 -- host/auth.sh@44 -- # keyid=2 00:20:11.565 03:31:36 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:11.565 03:31:36 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:11.565 03:31:36 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:11.565 03:31:36 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:11.565 03:31:36 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:20:11.565 03:31:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:11.565 03:31:36 -- host/auth.sh@68 -- # digest=sha512 00:20:11.565 03:31:36 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:11.565 03:31:36 -- host/auth.sh@68 -- # keyid=2 00:20:11.565 03:31:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:20:11.565 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.565 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.565 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.565 03:31:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:11.565 03:31:36 -- nvmf/common.sh@717 -- # local ip 00:20:11.565 03:31:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:11.565 03:31:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:11.565 03:31:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:11.565 03:31:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:11.565 03:31:36 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:11.565 03:31:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:11.565 03:31:36 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:11.565 03:31:36 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:11.565 03:31:36 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:11.565 03:31:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:11.565 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.565 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.823 nvme0n1 00:20:11.823 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.823 03:31:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:11.823 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.823 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.823 03:31:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:11.823 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.823 03:31:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:11.823 03:31:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:11.823 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.823 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.823 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.823 03:31:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:11.823 03:31:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:20:11.823 03:31:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:11.823 03:31:36 -- host/auth.sh@44 -- # digest=sha512 00:20:11.823 03:31:36 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:11.824 03:31:36 -- host/auth.sh@44 -- # keyid=3 00:20:11.824 03:31:36 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:11.824 03:31:36 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:11.824 03:31:36 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:11.824 03:31:36 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:11.824 03:31:36 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:20:11.824 03:31:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:11.824 03:31:36 -- host/auth.sh@68 -- # digest=sha512 00:20:11.824 03:31:36 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:11.824 03:31:36 -- host/auth.sh@68 -- # keyid=3 00:20:11.824 03:31:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:20:11.824 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.824 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:11.824 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.824 03:31:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:11.824 03:31:36 -- nvmf/common.sh@717 -- # local ip 00:20:11.824 03:31:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:11.824 03:31:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:11.824 03:31:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:11.824 03:31:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:11.824 03:31:36 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:11.824 03:31:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:11.824 03:31:36 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:11.824 03:31:36 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:11.824 03:31:36 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:11.824 03:31:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:11.824 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.824 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:12.082 nvme0n1 00:20:12.082 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.082 03:31:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:12.082 03:31:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.082 03:31:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:12.082 03:31:36 -- common/autotest_common.sh@10 -- # set +x 00:20:12.082 03:31:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.082 03:31:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:12.082 03:31:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:12.082 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.082 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:12.082 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.082 03:31:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:12.082 03:31:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:20:12.082 03:31:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:12.082 03:31:37 -- host/auth.sh@44 -- # digest=sha512 00:20:12.082 03:31:37 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:12.082 03:31:37 -- host/auth.sh@44 -- # keyid=4 00:20:12.082 03:31:37 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:12.082 03:31:37 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:12.082 03:31:37 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:12.082 03:31:37 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:12.082 03:31:37 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:20:12.082 03:31:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:12.082 03:31:37 -- host/auth.sh@68 -- # digest=sha512 00:20:12.082 03:31:37 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:12.082 03:31:37 -- host/auth.sh@68 -- # keyid=4 00:20:12.082 03:31:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:20:12.082 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.082 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:12.082 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.082 03:31:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:12.082 03:31:37 -- nvmf/common.sh@717 -- # local ip 00:20:12.082 03:31:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:12.082 03:31:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:12.082 03:31:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:12.082 03:31:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:12.082 03:31:37 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:12.082 03:31:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:12.082 03:31:37 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:12.082 03:31:37 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:12.082 03:31:37 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:12.082 03:31:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:12.082 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.082 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:12.340 nvme0n1 00:20:12.340 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.340 03:31:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:12.340 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.340 03:31:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:12.340 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:12.340 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.340 03:31:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:12.340 03:31:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:12.340 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.340 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:12.340 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.340 03:31:37 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:12.340 03:31:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:12.340 03:31:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:20:12.340 03:31:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:12.340 03:31:37 -- host/auth.sh@44 -- # digest=sha512 00:20:12.340 03:31:37 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:12.340 03:31:37 -- host/auth.sh@44 -- # keyid=0 00:20:12.340 03:31:37 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:12.340 03:31:37 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:12.340 03:31:37 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:12.340 03:31:37 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:12.340 03:31:37 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:20:12.340 03:31:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:12.340 03:31:37 -- host/auth.sh@68 -- # digest=sha512 00:20:12.340 03:31:37 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:12.340 03:31:37 -- host/auth.sh@68 -- # keyid=0 00:20:12.340 03:31:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:20:12.340 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.340 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:12.340 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.340 03:31:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:12.340 03:31:37 -- nvmf/common.sh@717 -- # local ip 00:20:12.340 03:31:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:12.340 03:31:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:12.340 03:31:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:12.340 03:31:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:12.340 03:31:37 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:12.340 03:31:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:12.340 03:31:37 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:12.340 03:31:37 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:12.340 03:31:37 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:12.340 03:31:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:12.340 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.340 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:12.906 nvme0n1 00:20:12.906 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.906 03:31:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:12.906 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.906 03:31:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:12.906 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:12.906 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.906 03:31:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:12.906 03:31:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:12.906 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.906 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:12.906 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.906 03:31:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:12.906 03:31:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:20:12.906 03:31:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:12.906 03:31:37 -- host/auth.sh@44 -- # digest=sha512 00:20:12.906 03:31:37 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:12.906 03:31:37 -- host/auth.sh@44 -- # keyid=1 00:20:12.906 03:31:37 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:12.906 03:31:37 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:12.906 03:31:37 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:12.906 03:31:37 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:12.906 03:31:37 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:20:12.906 03:31:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:12.906 03:31:37 -- host/auth.sh@68 -- # digest=sha512 00:20:12.906 03:31:37 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:12.906 03:31:37 -- host/auth.sh@68 -- # keyid=1 00:20:12.906 03:31:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:20:12.906 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.906 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:12.906 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.906 03:31:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:12.906 03:31:37 -- nvmf/common.sh@717 -- # local ip 00:20:12.906 03:31:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:12.906 03:31:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:12.906 03:31:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:12.906 03:31:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:12.906 03:31:37 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:12.906 03:31:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:12.906 03:31:37 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:12.906 03:31:37 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:12.906 03:31:37 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:12.906 03:31:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:12.906 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.906 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:13.164 nvme0n1 00:20:13.164 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.164 03:31:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:13.164 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.164 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:13.164 03:31:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:13.164 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.164 03:31:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:13.164 03:31:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:13.164 03:31:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.164 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:20:13.164 03:31:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.164 03:31:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:13.164 03:31:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:20:13.164 03:31:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:13.164 03:31:38 -- host/auth.sh@44 -- # digest=sha512 00:20:13.164 03:31:38 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:13.164 03:31:38 -- host/auth.sh@44 -- # keyid=2 00:20:13.164 03:31:38 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:13.164 03:31:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:13.164 03:31:38 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:13.164 03:31:38 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:13.164 03:31:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:20:13.164 03:31:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:13.164 03:31:38 -- host/auth.sh@68 -- # digest=sha512 00:20:13.164 03:31:38 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:13.164 03:31:38 -- host/auth.sh@68 -- # keyid=2 00:20:13.164 03:31:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:20:13.164 03:31:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.164 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:20:13.164 03:31:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.164 03:31:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:13.165 03:31:38 -- nvmf/common.sh@717 -- # local ip 00:20:13.165 03:31:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:13.165 03:31:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:13.165 03:31:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:13.165 03:31:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:13.165 03:31:38 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:13.165 03:31:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:13.165 03:31:38 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:13.165 03:31:38 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:13.165 03:31:38 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:13.165 03:31:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:13.165 03:31:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.165 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:20:13.423 nvme0n1 00:20:13.423 03:31:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.423 03:31:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:13.423 03:31:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.423 03:31:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:13.423 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:20:13.423 03:31:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.423 03:31:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:13.423 03:31:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:13.423 03:31:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.423 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:20:13.423 03:31:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.423 03:31:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:13.423 03:31:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:20:13.423 03:31:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:13.423 03:31:38 -- host/auth.sh@44 -- # digest=sha512 00:20:13.423 03:31:38 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:13.423 03:31:38 -- host/auth.sh@44 -- # keyid=3 00:20:13.423 03:31:38 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:13.423 03:31:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:13.423 03:31:38 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:13.423 03:31:38 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:13.423 03:31:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:20:13.423 03:31:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:13.423 03:31:38 -- host/auth.sh@68 -- # digest=sha512 00:20:13.423 03:31:38 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:13.423 03:31:38 -- host/auth.sh@68 -- # keyid=3 00:20:13.423 03:31:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:20:13.423 03:31:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.423 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:20:13.423 03:31:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.423 03:31:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:13.423 03:31:38 -- nvmf/common.sh@717 -- # local ip 00:20:13.423 03:31:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:13.423 03:31:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:13.423 03:31:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:13.423 03:31:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:13.423 03:31:38 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:13.423 03:31:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:13.423 03:31:38 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:13.423 03:31:38 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:13.423 03:31:38 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:13.423 03:31:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:13.423 03:31:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.423 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:20:13.990 nvme0n1 00:20:13.990 03:31:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.990 03:31:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:13.990 03:31:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.990 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:20:13.990 03:31:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:13.990 03:31:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.990 03:31:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:13.990 03:31:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:13.990 03:31:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.990 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:20:13.990 03:31:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.990 03:31:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:13.990 03:31:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:20:13.990 03:31:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:13.990 03:31:38 -- host/auth.sh@44 -- # digest=sha512 00:20:13.990 03:31:38 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:13.990 03:31:38 -- host/auth.sh@44 -- # keyid=4 00:20:13.990 03:31:38 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:13.990 03:31:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:13.990 03:31:38 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:13.990 03:31:38 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:13.990 03:31:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:20:13.990 03:31:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:13.990 03:31:38 -- host/auth.sh@68 -- # digest=sha512 00:20:13.990 03:31:38 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:13.990 03:31:38 -- host/auth.sh@68 -- # keyid=4 00:20:13.990 03:31:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:20:13.990 03:31:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.990 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:20:13.990 03:31:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.990 03:31:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:13.990 03:31:38 -- nvmf/common.sh@717 -- # local ip 00:20:13.990 03:31:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:13.990 03:31:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:13.990 03:31:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:13.990 03:31:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:13.990 03:31:38 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:13.990 03:31:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:13.990 03:31:38 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:13.990 03:31:38 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:13.990 03:31:38 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:13.990 03:31:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:13.990 03:31:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.990 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:20:14.249 nvme0n1 00:20:14.249 03:31:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.249 03:31:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:14.249 03:31:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:14.249 03:31:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.249 03:31:39 -- common/autotest_common.sh@10 -- # set +x 00:20:14.249 03:31:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.249 03:31:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:14.249 03:31:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:14.249 03:31:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.249 03:31:39 -- common/autotest_common.sh@10 -- # set +x 00:20:14.249 03:31:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.249 03:31:39 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:14.249 03:31:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:14.249 03:31:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:20:14.249 03:31:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:14.249 03:31:39 -- host/auth.sh@44 -- # digest=sha512 00:20:14.249 03:31:39 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:14.249 03:31:39 -- host/auth.sh@44 -- # keyid=0 00:20:14.249 03:31:39 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:14.249 03:31:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:14.249 03:31:39 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:14.249 03:31:39 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:14.249 03:31:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:20:14.249 03:31:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:14.249 03:31:39 -- host/auth.sh@68 -- # digest=sha512 00:20:14.249 03:31:39 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:14.249 03:31:39 -- host/auth.sh@68 -- # keyid=0 00:20:14.249 03:31:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:20:14.249 03:31:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.249 03:31:39 -- common/autotest_common.sh@10 -- # set +x 00:20:14.249 03:31:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.249 03:31:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:14.249 03:31:39 -- nvmf/common.sh@717 -- # local ip 00:20:14.249 03:31:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:14.249 03:31:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:14.249 03:31:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:14.249 03:31:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:14.249 03:31:39 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:14.249 03:31:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:14.249 03:31:39 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:14.249 03:31:39 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:14.249 03:31:39 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:14.249 03:31:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:14.249 03:31:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.249 03:31:39 -- common/autotest_common.sh@10 -- # set +x 00:20:14.815 nvme0n1 00:20:14.815 03:31:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.815 03:31:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:14.815 03:31:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.815 03:31:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:14.815 03:31:39 -- common/autotest_common.sh@10 -- # set +x 00:20:14.815 03:31:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.815 03:31:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:14.815 03:31:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:14.815 03:31:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.815 03:31:39 -- common/autotest_common.sh@10 -- # set +x 00:20:14.815 03:31:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.815 03:31:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:14.815 03:31:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:20:14.815 03:31:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:14.815 03:31:39 -- host/auth.sh@44 -- # digest=sha512 00:20:14.815 03:31:39 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:14.815 03:31:39 -- host/auth.sh@44 -- # keyid=1 00:20:14.815 03:31:39 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:14.815 03:31:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:14.815 03:31:39 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:14.815 03:31:39 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:14.815 03:31:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:20:14.815 03:31:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:14.815 03:31:39 -- host/auth.sh@68 -- # digest=sha512 00:20:14.815 03:31:39 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:14.815 03:31:39 -- host/auth.sh@68 -- # keyid=1 00:20:14.815 03:31:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:20:14.815 03:31:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.815 03:31:39 -- common/autotest_common.sh@10 -- # set +x 00:20:14.815 03:31:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.815 03:31:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:14.815 03:31:39 -- nvmf/common.sh@717 -- # local ip 00:20:14.815 03:31:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:14.815 03:31:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:14.815 03:31:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:14.815 03:31:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:14.815 03:31:39 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:14.815 03:31:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:14.815 03:31:39 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:14.815 03:31:39 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:14.815 03:31:39 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:14.815 03:31:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:14.815 03:31:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.815 03:31:39 -- common/autotest_common.sh@10 -- # set +x 00:20:15.381 nvme0n1 00:20:15.381 03:31:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.381 03:31:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:15.381 03:31:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:15.381 03:31:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.381 03:31:40 -- common/autotest_common.sh@10 -- # set +x 00:20:15.381 03:31:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.381 03:31:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:15.381 03:31:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:15.381 03:31:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.381 03:31:40 -- common/autotest_common.sh@10 -- # set +x 00:20:15.381 03:31:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.381 03:31:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:15.381 03:31:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:20:15.381 03:31:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:15.381 03:31:40 -- host/auth.sh@44 -- # digest=sha512 00:20:15.381 03:31:40 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:15.381 03:31:40 -- host/auth.sh@44 -- # keyid=2 00:20:15.381 03:31:40 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:15.381 03:31:40 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:15.381 03:31:40 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:15.381 03:31:40 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:15.381 03:31:40 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:20:15.381 03:31:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:15.381 03:31:40 -- host/auth.sh@68 -- # digest=sha512 00:20:15.381 03:31:40 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:15.381 03:31:40 -- host/auth.sh@68 -- # keyid=2 00:20:15.381 03:31:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:20:15.381 03:31:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.381 03:31:40 -- common/autotest_common.sh@10 -- # set +x 00:20:15.381 03:31:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.381 03:31:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:15.381 03:31:40 -- nvmf/common.sh@717 -- # local ip 00:20:15.381 03:31:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:15.381 03:31:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:15.381 03:31:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:15.381 03:31:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:15.381 03:31:40 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:15.381 03:31:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:15.381 03:31:40 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:15.381 03:31:40 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:15.381 03:31:40 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:15.381 03:31:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:15.381 03:31:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.381 03:31:40 -- common/autotest_common.sh@10 -- # set +x 00:20:15.947 nvme0n1 00:20:15.947 03:31:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.947 03:31:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:15.947 03:31:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:15.947 03:31:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.947 03:31:40 -- common/autotest_common.sh@10 -- # set +x 00:20:15.947 03:31:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.947 03:31:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:15.947 03:31:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:15.947 03:31:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.947 03:31:40 -- common/autotest_common.sh@10 -- # set +x 00:20:15.947 03:31:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.947 03:31:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:15.947 03:31:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:20:15.947 03:31:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:15.947 03:31:40 -- host/auth.sh@44 -- # digest=sha512 00:20:15.947 03:31:40 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:15.947 03:31:40 -- host/auth.sh@44 -- # keyid=3 00:20:15.947 03:31:40 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:15.947 03:31:40 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:15.947 03:31:40 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:15.947 03:31:40 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:15.947 03:31:40 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:20:15.947 03:31:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:15.947 03:31:40 -- host/auth.sh@68 -- # digest=sha512 00:20:15.947 03:31:40 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:15.947 03:31:40 -- host/auth.sh@68 -- # keyid=3 00:20:15.947 03:31:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:20:15.948 03:31:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.948 03:31:40 -- common/autotest_common.sh@10 -- # set +x 00:20:15.948 03:31:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.948 03:31:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:15.948 03:31:40 -- nvmf/common.sh@717 -- # local ip 00:20:15.948 03:31:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:15.948 03:31:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:15.948 03:31:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:15.948 03:31:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:15.948 03:31:40 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:15.948 03:31:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:15.948 03:31:40 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:15.948 03:31:40 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:15.948 03:31:40 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:15.948 03:31:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:15.948 03:31:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.948 03:31:40 -- common/autotest_common.sh@10 -- # set +x 00:20:16.513 nvme0n1 00:20:16.513 03:31:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.513 03:31:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:16.513 03:31:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.513 03:31:41 -- common/autotest_common.sh@10 -- # set +x 00:20:16.513 03:31:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:16.513 03:31:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.771 03:31:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:16.771 03:31:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:16.771 03:31:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.771 03:31:41 -- common/autotest_common.sh@10 -- # set +x 00:20:16.771 03:31:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.771 03:31:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:16.771 03:31:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:20:16.771 03:31:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:16.771 03:31:41 -- host/auth.sh@44 -- # digest=sha512 00:20:16.771 03:31:41 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:16.771 03:31:41 -- host/auth.sh@44 -- # keyid=4 00:20:16.771 03:31:41 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:16.771 03:31:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:16.771 03:31:41 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:16.771 03:31:41 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:16.771 03:31:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:20:16.771 03:31:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:16.771 03:31:41 -- host/auth.sh@68 -- # digest=sha512 00:20:16.771 03:31:41 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:16.771 03:31:41 -- host/auth.sh@68 -- # keyid=4 00:20:16.771 03:31:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:20:16.771 03:31:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.771 03:31:41 -- common/autotest_common.sh@10 -- # set +x 00:20:16.771 03:31:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.771 03:31:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:16.771 03:31:41 -- nvmf/common.sh@717 -- # local ip 00:20:16.771 03:31:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:16.771 03:31:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:16.771 03:31:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:16.771 03:31:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:16.771 03:31:41 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:16.771 03:31:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:16.771 03:31:41 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:16.771 03:31:41 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:16.771 03:31:41 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:16.771 03:31:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:16.771 03:31:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.771 03:31:41 -- common/autotest_common.sh@10 -- # set +x 00:20:17.370 nvme0n1 00:20:17.370 03:31:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.370 03:31:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:17.370 03:31:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.370 03:31:42 -- common/autotest_common.sh@10 -- # set +x 00:20:17.370 03:31:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:17.370 03:31:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.370 03:31:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:17.370 03:31:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:17.370 03:31:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.370 03:31:42 -- common/autotest_common.sh@10 -- # set +x 00:20:17.370 03:31:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.370 03:31:42 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:17.370 03:31:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:17.370 03:31:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:20:17.370 03:31:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:17.370 03:31:42 -- host/auth.sh@44 -- # digest=sha512 00:20:17.370 03:31:42 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:17.370 03:31:42 -- host/auth.sh@44 -- # keyid=0 00:20:17.370 03:31:42 -- host/auth.sh@45 -- # key=DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:17.370 03:31:42 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:17.370 03:31:42 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:17.370 03:31:42 -- host/auth.sh@49 -- # echo DHHC-1:00:MDdkZTA3ZTNiYjk3ODdkZmQxZGUxMDk3N2I2ZGJlMmNMMY54: 00:20:17.370 03:31:42 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:20:17.370 03:31:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:17.370 03:31:42 -- host/auth.sh@68 -- # digest=sha512 00:20:17.370 03:31:42 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:17.370 03:31:42 -- host/auth.sh@68 -- # keyid=0 00:20:17.370 03:31:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:20:17.370 03:31:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.370 03:31:42 -- common/autotest_common.sh@10 -- # set +x 00:20:17.370 03:31:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.370 03:31:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:17.370 03:31:42 -- nvmf/common.sh@717 -- # local ip 00:20:17.370 03:31:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:17.370 03:31:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:17.370 03:31:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:17.370 03:31:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:17.370 03:31:42 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:17.370 03:31:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:17.370 03:31:42 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:17.370 03:31:42 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:17.370 03:31:42 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:17.370 03:31:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:17.370 03:31:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.370 03:31:42 -- common/autotest_common.sh@10 -- # set +x 00:20:18.306 nvme0n1 00:20:18.306 03:31:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.306 03:31:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:18.306 03:31:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.306 03:31:43 -- common/autotest_common.sh@10 -- # set +x 00:20:18.306 03:31:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:18.306 03:31:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.306 03:31:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:18.306 03:31:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:18.306 03:31:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.306 03:31:43 -- common/autotest_common.sh@10 -- # set +x 00:20:18.306 03:31:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.306 03:31:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:18.306 03:31:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:20:18.306 03:31:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:18.306 03:31:43 -- host/auth.sh@44 -- # digest=sha512 00:20:18.306 03:31:43 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:18.306 03:31:43 -- host/auth.sh@44 -- # keyid=1 00:20:18.306 03:31:43 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:18.306 03:31:43 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:18.306 03:31:43 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:18.306 03:31:43 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:18.306 03:31:43 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:20:18.306 03:31:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:18.306 03:31:43 -- host/auth.sh@68 -- # digest=sha512 00:20:18.306 03:31:43 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:18.306 03:31:43 -- host/auth.sh@68 -- # keyid=1 00:20:18.306 03:31:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:20:18.306 03:31:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.306 03:31:43 -- common/autotest_common.sh@10 -- # set +x 00:20:18.306 03:31:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.306 03:31:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:18.306 03:31:43 -- nvmf/common.sh@717 -- # local ip 00:20:18.306 03:31:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:18.306 03:31:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:18.306 03:31:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:18.306 03:31:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:18.306 03:31:43 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:18.306 03:31:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:18.306 03:31:43 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:18.306 03:31:43 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:18.306 03:31:43 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:18.306 03:31:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:18.306 03:31:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.306 03:31:43 -- common/autotest_common.sh@10 -- # set +x 00:20:19.239 nvme0n1 00:20:19.239 03:31:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:19.239 03:31:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:19.239 03:31:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:19.239 03:31:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:19.239 03:31:44 -- common/autotest_common.sh@10 -- # set +x 00:20:19.239 03:31:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:19.239 03:31:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:19.239 03:31:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:19.239 03:31:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:19.239 03:31:44 -- common/autotest_common.sh@10 -- # set +x 00:20:19.239 03:31:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:19.239 03:31:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:19.239 03:31:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:20:19.239 03:31:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:19.239 03:31:44 -- host/auth.sh@44 -- # digest=sha512 00:20:19.239 03:31:44 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:19.239 03:31:44 -- host/auth.sh@44 -- # keyid=2 00:20:19.239 03:31:44 -- host/auth.sh@45 -- # key=DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:19.239 03:31:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:19.239 03:31:44 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:19.239 03:31:44 -- host/auth.sh@49 -- # echo DHHC-1:01:NGUzYWNiNmIwZDk1YzBmNjUyN2NmZTI2Njk5YzU2ODEHZ4OC: 00:20:19.239 03:31:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:20:19.239 03:31:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:19.239 03:31:44 -- host/auth.sh@68 -- # digest=sha512 00:20:19.239 03:31:44 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:19.239 03:31:44 -- host/auth.sh@68 -- # keyid=2 00:20:19.239 03:31:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:20:19.239 03:31:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:19.239 03:31:44 -- common/autotest_common.sh@10 -- # set +x 00:20:19.239 03:31:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:19.239 03:31:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:19.239 03:31:44 -- nvmf/common.sh@717 -- # local ip 00:20:19.239 03:31:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:19.239 03:31:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:19.239 03:31:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:19.239 03:31:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:19.239 03:31:44 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:19.239 03:31:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:19.239 03:31:44 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:19.239 03:31:44 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:19.239 03:31:44 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:19.239 03:31:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:19.239 03:31:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:19.239 03:31:44 -- common/autotest_common.sh@10 -- # set +x 00:20:20.174 nvme0n1 00:20:20.174 03:31:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.174 03:31:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:20.174 03:31:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.174 03:31:45 -- common/autotest_common.sh@10 -- # set +x 00:20:20.174 03:31:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:20.174 03:31:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.174 03:31:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:20.174 03:31:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:20.174 03:31:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.174 03:31:45 -- common/autotest_common.sh@10 -- # set +x 00:20:20.432 03:31:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.432 03:31:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:20.432 03:31:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:20:20.432 03:31:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:20.432 03:31:45 -- host/auth.sh@44 -- # digest=sha512 00:20:20.432 03:31:45 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:20.432 03:31:45 -- host/auth.sh@44 -- # keyid=3 00:20:20.432 03:31:45 -- host/auth.sh@45 -- # key=DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:20.432 03:31:45 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:20.432 03:31:45 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:20.432 03:31:45 -- host/auth.sh@49 -- # echo DHHC-1:02:Mjg1MTg2YzcwMzgzYzI0MTFhMTZiYjM5MmI1Mzc0NGZlNTc0OTBkODc4YzM2ZTM3TzoXhg==: 00:20:20.432 03:31:45 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:20:20.432 03:31:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:20.432 03:31:45 -- host/auth.sh@68 -- # digest=sha512 00:20:20.432 03:31:45 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:20.432 03:31:45 -- host/auth.sh@68 -- # keyid=3 00:20:20.432 03:31:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:20:20.432 03:31:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.432 03:31:45 -- common/autotest_common.sh@10 -- # set +x 00:20:20.432 03:31:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.432 03:31:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:20.432 03:31:45 -- nvmf/common.sh@717 -- # local ip 00:20:20.432 03:31:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:20.432 03:31:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:20.432 03:31:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:20.432 03:31:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:20.432 03:31:45 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:20.432 03:31:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:20.432 03:31:45 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:20.432 03:31:45 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:20.432 03:31:45 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:20.432 03:31:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:20.432 03:31:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.432 03:31:45 -- common/autotest_common.sh@10 -- # set +x 00:20:21.378 nvme0n1 00:20:21.378 03:31:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.378 03:31:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:21.378 03:31:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:21.378 03:31:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.378 03:31:46 -- common/autotest_common.sh@10 -- # set +x 00:20:21.378 03:31:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.378 03:31:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:21.378 03:31:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:21.378 03:31:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.378 03:31:46 -- common/autotest_common.sh@10 -- # set +x 00:20:21.378 03:31:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.378 03:31:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:21.378 03:31:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:20:21.378 03:31:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:21.378 03:31:46 -- host/auth.sh@44 -- # digest=sha512 00:20:21.378 03:31:46 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:21.378 03:31:46 -- host/auth.sh@44 -- # keyid=4 00:20:21.378 03:31:46 -- host/auth.sh@45 -- # key=DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:21.378 03:31:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:21.378 03:31:46 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:21.378 03:31:46 -- host/auth.sh@49 -- # echo DHHC-1:03:ZTExNjg5MWNkMDkxYzhkOTY1NDU3MTdkZjYxMzBjYWVkMzU2ZjljMDMxM2M3YWMyM2U5MDdjMjYyNGRkNGEwYVqSq8M=: 00:20:21.378 03:31:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:20:21.378 03:31:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:21.378 03:31:46 -- host/auth.sh@68 -- # digest=sha512 00:20:21.378 03:31:46 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:21.378 03:31:46 -- host/auth.sh@68 -- # keyid=4 00:20:21.378 03:31:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:20:21.378 03:31:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.378 03:31:46 -- common/autotest_common.sh@10 -- # set +x 00:20:21.378 03:31:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.378 03:31:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:21.378 03:31:46 -- nvmf/common.sh@717 -- # local ip 00:20:21.378 03:31:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:21.378 03:31:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:21.378 03:31:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:21.378 03:31:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:21.378 03:31:46 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:21.378 03:31:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:21.378 03:31:46 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:21.378 03:31:46 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:21.378 03:31:46 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:21.378 03:31:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:21.378 03:31:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.378 03:31:46 -- common/autotest_common.sh@10 -- # set +x 00:20:22.311 nvme0n1 00:20:22.311 03:31:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.311 03:31:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:22.311 03:31:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.311 03:31:47 -- common/autotest_common.sh@10 -- # set +x 00:20:22.311 03:31:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:22.311 03:31:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.311 03:31:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:22.311 03:31:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:22.311 03:31:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.311 03:31:47 -- common/autotest_common.sh@10 -- # set +x 00:20:22.311 03:31:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.311 03:31:47 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:20:22.311 03:31:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:22.311 03:31:47 -- host/auth.sh@44 -- # digest=sha256 00:20:22.311 03:31:47 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:22.311 03:31:47 -- host/auth.sh@44 -- # keyid=1 00:20:22.311 03:31:47 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:22.311 03:31:47 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:22.311 03:31:47 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:22.311 03:31:47 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWRlODY2YTdhZDZlMTMyNDg1YWZjY2FkZDRkOGVkZTMzMDBiZjJiZWMxY2IwZjYygZrolg==: 00:20:22.311 03:31:47 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:20:22.311 03:31:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.311 03:31:47 -- common/autotest_common.sh@10 -- # set +x 00:20:22.311 03:31:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.311 03:31:47 -- host/auth.sh@119 -- # get_main_ns_ip 00:20:22.311 03:31:47 -- nvmf/common.sh@717 -- # local ip 00:20:22.311 03:31:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:22.311 03:31:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:22.311 03:31:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:22.311 03:31:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:22.311 03:31:47 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:22.311 03:31:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:22.311 03:31:47 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:22.311 03:31:47 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:22.311 03:31:47 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:22.311 03:31:47 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:20:22.311 03:31:47 -- common/autotest_common.sh@638 -- # local es=0 00:20:22.311 03:31:47 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:20:22.311 03:31:47 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:20:22.311 03:31:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:22.311 03:31:47 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:20:22.311 03:31:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:22.311 03:31:47 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:20:22.311 03:31:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.311 03:31:47 -- common/autotest_common.sh@10 -- # set +x 00:20:22.569 request: 00:20:22.569 { 00:20:22.570 "name": "nvme0", 00:20:22.570 "trtype": "tcp", 00:20:22.570 "traddr": "10.0.0.1", 00:20:22.570 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:20:22.570 "adrfam": "ipv4", 00:20:22.570 "trsvcid": "4420", 00:20:22.570 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:20:22.570 "method": "bdev_nvme_attach_controller", 00:20:22.570 "req_id": 1 00:20:22.570 } 00:20:22.570 Got JSON-RPC error response 00:20:22.570 response: 00:20:22.570 { 00:20:22.570 "code": -32602, 00:20:22.570 "message": "Invalid parameters" 00:20:22.570 } 00:20:22.570 03:31:47 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:20:22.570 03:31:47 -- common/autotest_common.sh@641 -- # es=1 00:20:22.570 03:31:47 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:20:22.570 03:31:47 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:20:22.570 03:31:47 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:20:22.570 03:31:47 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:20:22.570 03:31:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.570 03:31:47 -- common/autotest_common.sh@10 -- # set +x 00:20:22.570 03:31:47 -- host/auth.sh@121 -- # jq length 00:20:22.570 03:31:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.570 03:31:47 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:20:22.570 03:31:47 -- host/auth.sh@124 -- # get_main_ns_ip 00:20:22.570 03:31:47 -- nvmf/common.sh@717 -- # local ip 00:20:22.570 03:31:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:22.570 03:31:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:22.570 03:31:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:22.570 03:31:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:22.570 03:31:47 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:20:22.570 03:31:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:20:22.570 03:31:47 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:20:22.570 03:31:47 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:20:22.570 03:31:47 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:20:22.570 03:31:47 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:22.570 03:31:47 -- common/autotest_common.sh@638 -- # local es=0 00:20:22.570 03:31:47 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:22.570 03:31:47 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:20:22.570 03:31:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:22.570 03:31:47 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:20:22.570 03:31:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:22.570 03:31:47 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -f ipv4 -a 10.0.0.1 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:22.570 03:31:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.570 03:31:47 -- common/autotest_common.sh@10 -- # set +x 00:20:22.570 request: 00:20:22.570 { 00:20:22.570 "name": "nvme0", 00:20:22.570 "trtype": "tcp", 00:20:22.570 "traddr": "10.0.0.1", 00:20:22.570 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:20:22.570 "adrfam": "ipv4", 00:20:22.570 "trsvcid": "4420", 00:20:22.570 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:20:22.570 "dhchap_key": "key2", 00:20:22.570 "method": "bdev_nvme_attach_controller", 00:20:22.570 "req_id": 1 00:20:22.570 } 00:20:22.570 Got JSON-RPC error response 00:20:22.570 response: 00:20:22.570 { 00:20:22.570 "code": -32602, 00:20:22.570 "message": "Invalid parameters" 00:20:22.570 } 00:20:22.570 03:31:47 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:20:22.570 03:31:47 -- common/autotest_common.sh@641 -- # es=1 00:20:22.570 03:31:47 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:20:22.570 03:31:47 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:20:22.570 03:31:47 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:20:22.570 03:31:47 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:20:22.570 03:31:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.570 03:31:47 -- host/auth.sh@127 -- # jq length 00:20:22.570 03:31:47 -- common/autotest_common.sh@10 -- # set +x 00:20:22.570 03:31:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.570 03:31:47 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:20:22.570 03:31:47 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:20:22.570 03:31:47 -- host/auth.sh@130 -- # cleanup 00:20:22.570 03:31:47 -- host/auth.sh@24 -- # nvmftestfini 00:20:22.570 03:31:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:22.570 03:31:47 -- nvmf/common.sh@117 -- # sync 00:20:22.570 03:31:47 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:20:22.570 03:31:47 -- nvmf/common.sh@120 -- # set +e 00:20:22.570 03:31:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:22.570 03:31:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:20:22.570 rmmod nvme_tcp 00:20:22.570 rmmod nvme_fabrics 00:20:22.828 03:31:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:22.828 03:31:47 -- nvmf/common.sh@124 -- # set -e 00:20:22.828 03:31:47 -- nvmf/common.sh@125 -- # return 0 00:20:22.828 03:31:47 -- nvmf/common.sh@478 -- # '[' -n 1511860 ']' 00:20:22.828 03:31:47 -- nvmf/common.sh@479 -- # killprocess 1511860 00:20:22.828 03:31:47 -- common/autotest_common.sh@936 -- # '[' -z 1511860 ']' 00:20:22.828 03:31:47 -- common/autotest_common.sh@940 -- # kill -0 1511860 00:20:22.828 03:31:47 -- common/autotest_common.sh@941 -- # uname 00:20:22.828 03:31:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:22.828 03:31:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1511860 00:20:22.828 03:31:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:22.828 03:31:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:22.829 03:31:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1511860' 00:20:22.829 killing process with pid 1511860 00:20:22.829 03:31:47 -- common/autotest_common.sh@955 -- # kill 1511860 00:20:22.829 03:31:47 -- common/autotest_common.sh@960 -- # wait 1511860 00:20:23.088 03:31:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:23.088 03:31:47 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:20:23.088 03:31:47 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:20:23.088 03:31:47 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:23.088 03:31:47 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:20:23.088 03:31:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:23.088 03:31:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:23.088 03:31:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:25.026 03:31:49 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:20:25.026 03:31:49 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:20:25.026 03:31:49 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:20:25.026 03:31:49 -- host/auth.sh@27 -- # clean_kernel_target 00:20:25.026 03:31:49 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:20:25.026 03:31:49 -- nvmf/common.sh@675 -- # echo 0 00:20:25.026 03:31:49 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:20:25.026 03:31:49 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:20:25.026 03:31:49 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:20:25.026 03:31:49 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:20:25.026 03:31:49 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:20:25.026 03:31:49 -- nvmf/common.sh@684 -- # modprobe -r nvmet_tcp nvmet 00:20:25.026 03:31:49 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:20:26.407 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:20:26.407 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:20:26.407 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:20:26.407 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:20:26.407 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:20:26.407 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:20:26.407 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:20:26.407 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:20:26.407 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:20:26.407 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:20:26.407 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:20:26.407 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:20:26.407 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:20:26.407 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:20:26.407 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:20:26.407 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:20:27.342 0000:0b:00.0 (8086 0a54): nvme -> vfio-pci 00:20:27.620 03:31:52 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.7OM /tmp/spdk.key-null.Nyx /tmp/spdk.key-sha256.cNd /tmp/spdk.key-sha384.iwP /tmp/spdk.key-sha512.n4j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvme-auth.log 00:20:27.620 03:31:52 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:20:28.994 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:20:28.994 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:20:28.994 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:20:28.994 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:20:28.994 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:20:28.994 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:20:28.994 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:20:28.994 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:20:28.994 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:20:28.994 0000:0b:00.0 (8086 0a54): Already using the vfio-pci driver 00:20:28.994 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:20:28.994 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:20:28.994 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:20:28.994 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:20:28.994 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:20:28.994 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:20:28.994 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:20:28.994 00:20:28.994 real 0m49.668s 00:20:28.994 user 0m46.978s 00:20:28.994 sys 0m5.836s 00:20:28.994 03:31:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:28.994 03:31:53 -- common/autotest_common.sh@10 -- # set +x 00:20:28.994 ************************************ 00:20:28.994 END TEST nvmf_auth 00:20:28.994 ************************************ 00:20:28.994 03:31:53 -- nvmf/nvmf.sh@104 -- # [[ tcp == \t\c\p ]] 00:20:28.994 03:31:53 -- nvmf/nvmf.sh@105 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:20:28.994 03:31:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:28.994 03:31:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:28.994 03:31:53 -- common/autotest_common.sh@10 -- # set +x 00:20:28.994 ************************************ 00:20:28.994 START TEST nvmf_digest 00:20:28.994 ************************************ 00:20:28.994 03:31:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:20:29.253 * Looking for test storage... 00:20:29.253 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:20:29.253 03:31:53 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:29.253 03:31:53 -- nvmf/common.sh@7 -- # uname -s 00:20:29.253 03:31:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:29.253 03:31:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:29.253 03:31:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:29.253 03:31:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:29.253 03:31:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:29.253 03:31:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:29.253 03:31:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:29.253 03:31:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:29.253 03:31:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:29.253 03:31:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:29.253 03:31:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:20:29.253 03:31:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:20:29.253 03:31:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:29.253 03:31:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:29.253 03:31:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:29.253 03:31:53 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:29.253 03:31:53 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:29.253 03:31:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:29.253 03:31:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:29.253 03:31:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:29.253 03:31:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.253 03:31:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.253 03:31:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.253 03:31:53 -- paths/export.sh@5 -- # export PATH 00:20:29.253 03:31:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.253 03:31:53 -- nvmf/common.sh@47 -- # : 0 00:20:29.253 03:31:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:29.253 03:31:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:29.253 03:31:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:29.253 03:31:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:29.253 03:31:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:29.253 03:31:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:29.253 03:31:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:29.253 03:31:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:29.253 03:31:54 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:20:29.253 03:31:54 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:20:29.253 03:31:54 -- host/digest.sh@16 -- # runtime=2 00:20:29.253 03:31:54 -- host/digest.sh@136 -- # [[ tcp != \t\c\p ]] 00:20:29.253 03:31:54 -- host/digest.sh@138 -- # nvmftestinit 00:20:29.253 03:31:54 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:20:29.253 03:31:54 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:29.253 03:31:54 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:29.253 03:31:54 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:29.253 03:31:54 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:29.253 03:31:54 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:29.253 03:31:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:29.253 03:31:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:29.253 03:31:54 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:29.253 03:31:54 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:29.253 03:31:54 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:29.253 03:31:54 -- common/autotest_common.sh@10 -- # set +x 00:20:31.154 03:31:56 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:31.154 03:31:56 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:31.154 03:31:56 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:31.154 03:31:56 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:31.154 03:31:56 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:31.154 03:31:56 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:31.154 03:31:56 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:31.154 03:31:56 -- nvmf/common.sh@295 -- # net_devs=() 00:20:31.154 03:31:56 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:31.154 03:31:56 -- nvmf/common.sh@296 -- # e810=() 00:20:31.154 03:31:56 -- nvmf/common.sh@296 -- # local -ga e810 00:20:31.154 03:31:56 -- nvmf/common.sh@297 -- # x722=() 00:20:31.154 03:31:56 -- nvmf/common.sh@297 -- # local -ga x722 00:20:31.154 03:31:56 -- nvmf/common.sh@298 -- # mlx=() 00:20:31.154 03:31:56 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:31.154 03:31:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:31.154 03:31:56 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:31.154 03:31:56 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:20:31.154 03:31:56 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:31.154 03:31:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:31.154 03:31:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:20:31.154 Found 0000:09:00.0 (0x8086 - 0x159b) 00:20:31.154 03:31:56 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:31.154 03:31:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:20:31.154 Found 0000:09:00.1 (0x8086 - 0x159b) 00:20:31.154 03:31:56 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:31.154 03:31:56 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:31.154 03:31:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:31.154 03:31:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:31.154 03:31:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:31.154 03:31:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:20:31.154 Found net devices under 0000:09:00.0: cvl_0_0 00:20:31.154 03:31:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:31.154 03:31:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:31.154 03:31:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:31.154 03:31:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:31.154 03:31:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:31.154 03:31:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:20:31.154 Found net devices under 0000:09:00.1: cvl_0_1 00:20:31.154 03:31:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:31.154 03:31:56 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:31.154 03:31:56 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:31.154 03:31:56 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:20:31.154 03:31:56 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:20:31.154 03:31:56 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:31.154 03:31:56 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:31.154 03:31:56 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:31.154 03:31:56 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:20:31.154 03:31:56 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:31.154 03:31:56 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:31.154 03:31:56 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:20:31.154 03:31:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:31.154 03:31:56 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:31.154 03:31:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:20:31.154 03:31:56 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:20:31.154 03:31:56 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:20:31.154 03:31:56 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:31.154 03:31:56 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:31.154 03:31:56 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:31.154 03:31:56 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:20:31.154 03:31:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:31.413 03:31:56 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:31.413 03:31:56 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:31.413 03:31:56 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:20:31.413 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:31.413 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.196 ms 00:20:31.413 00:20:31.413 --- 10.0.0.2 ping statistics --- 00:20:31.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:31.413 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:20:31.413 03:31:56 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:31.413 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:31.413 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:20:31.413 00:20:31.413 --- 10.0.0.1 ping statistics --- 00:20:31.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:31.413 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:20:31.413 03:31:56 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:31.413 03:31:56 -- nvmf/common.sh@411 -- # return 0 00:20:31.413 03:31:56 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:31.413 03:31:56 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:31.413 03:31:56 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:20:31.413 03:31:56 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:20:31.413 03:31:56 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:31.413 03:31:56 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:20:31.413 03:31:56 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:20:31.413 03:31:56 -- host/digest.sh@140 -- # trap cleanup SIGINT SIGTERM EXIT 00:20:31.413 03:31:56 -- host/digest.sh@141 -- # [[ 0 -eq 1 ]] 00:20:31.413 03:31:56 -- host/digest.sh@145 -- # run_test nvmf_digest_clean run_digest 00:20:31.413 03:31:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:20:31.413 03:31:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:31.413 03:31:56 -- common/autotest_common.sh@10 -- # set +x 00:20:31.413 ************************************ 00:20:31.413 START TEST nvmf_digest_clean 00:20:31.413 ************************************ 00:20:31.413 03:31:56 -- common/autotest_common.sh@1111 -- # run_digest 00:20:31.413 03:31:56 -- host/digest.sh@120 -- # local dsa_initiator 00:20:31.413 03:31:56 -- host/digest.sh@121 -- # [[ '' == \d\s\a\_\i\n\i\t\i\a\t\o\r ]] 00:20:31.413 03:31:56 -- host/digest.sh@121 -- # dsa_initiator=false 00:20:31.413 03:31:56 -- host/digest.sh@123 -- # tgt_params=("--wait-for-rpc") 00:20:31.413 03:31:56 -- host/digest.sh@124 -- # nvmfappstart --wait-for-rpc 00:20:31.413 03:31:56 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:31.413 03:31:56 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:31.413 03:31:56 -- common/autotest_common.sh@10 -- # set +x 00:20:31.413 03:31:56 -- nvmf/common.sh@470 -- # nvmfpid=1521308 00:20:31.413 03:31:56 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:20:31.413 03:31:56 -- nvmf/common.sh@471 -- # waitforlisten 1521308 00:20:31.413 03:31:56 -- common/autotest_common.sh@817 -- # '[' -z 1521308 ']' 00:20:31.413 03:31:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:31.413 03:31:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:31.413 03:31:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:31.413 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:31.413 03:31:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:31.413 03:31:56 -- common/autotest_common.sh@10 -- # set +x 00:20:31.413 [2024-04-27 03:31:56.339378] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:20:31.413 [2024-04-27 03:31:56.339460] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:31.413 EAL: No free 2048 kB hugepages reported on node 1 00:20:31.671 [2024-04-27 03:31:56.405890] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:31.671 [2024-04-27 03:31:56.511860] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:31.671 [2024-04-27 03:31:56.511918] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:31.671 [2024-04-27 03:31:56.511947] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:31.671 [2024-04-27 03:31:56.511958] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:31.671 [2024-04-27 03:31:56.511968] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:31.671 [2024-04-27 03:31:56.512001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:31.671 03:31:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:31.671 03:31:56 -- common/autotest_common.sh@850 -- # return 0 00:20:31.671 03:31:56 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:31.671 03:31:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:31.672 03:31:56 -- common/autotest_common.sh@10 -- # set +x 00:20:31.672 03:31:56 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:31.672 03:31:56 -- host/digest.sh@125 -- # [[ '' == \d\s\a\_\t\a\r\g\e\t ]] 00:20:31.672 03:31:56 -- host/digest.sh@126 -- # common_target_config 00:20:31.672 03:31:56 -- host/digest.sh@43 -- # rpc_cmd 00:20:31.672 03:31:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.672 03:31:56 -- common/autotest_common.sh@10 -- # set +x 00:20:31.930 null0 00:20:31.930 [2024-04-27 03:31:56.673955] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:31.930 [2024-04-27 03:31:56.698176] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:31.930 03:31:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.930 03:31:56 -- host/digest.sh@128 -- # run_bperf randread 4096 128 false 00:20:31.930 03:31:56 -- host/digest.sh@77 -- # local rw bs qd scan_dsa 00:20:31.930 03:31:56 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:20:31.930 03:31:56 -- host/digest.sh@80 -- # rw=randread 00:20:31.930 03:31:56 -- host/digest.sh@80 -- # bs=4096 00:20:31.930 03:31:56 -- host/digest.sh@80 -- # qd=128 00:20:31.930 03:31:56 -- host/digest.sh@80 -- # scan_dsa=false 00:20:31.930 03:31:56 -- host/digest.sh@83 -- # bperfpid=1521333 00:20:31.930 03:31:56 -- host/digest.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:20:31.930 03:31:56 -- host/digest.sh@84 -- # waitforlisten 1521333 /var/tmp/bperf.sock 00:20:31.930 03:31:56 -- common/autotest_common.sh@817 -- # '[' -z 1521333 ']' 00:20:31.930 03:31:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:20:31.930 03:31:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:31.930 03:31:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:20:31.930 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:20:31.930 03:31:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:31.930 03:31:56 -- common/autotest_common.sh@10 -- # set +x 00:20:31.930 [2024-04-27 03:31:56.744044] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:20:31.930 [2024-04-27 03:31:56.744120] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1521333 ] 00:20:31.930 EAL: No free 2048 kB hugepages reported on node 1 00:20:31.930 [2024-04-27 03:31:56.808140] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:32.188 [2024-04-27 03:31:56.928140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:32.188 03:31:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:32.188 03:31:56 -- common/autotest_common.sh@850 -- # return 0 00:20:32.188 03:31:56 -- host/digest.sh@86 -- # false 00:20:32.188 03:31:56 -- host/digest.sh@87 -- # bperf_rpc framework_start_init 00:20:32.188 03:31:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:20:32.446 03:31:57 -- host/digest.sh@89 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:32.446 03:31:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:32.704 nvme0n1 00:20:32.704 03:31:57 -- host/digest.sh@92 -- # bperf_py perform_tests 00:20:32.704 03:31:57 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:20:32.962 Running I/O for 2 seconds... 00:20:34.863 00:20:34.863 Latency(us) 00:20:34.863 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:34.863 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:20:34.863 nvme0n1 : 2.00 18237.72 71.24 0.00 0.00 7009.69 3519.53 15437.37 00:20:34.863 =================================================================================================================== 00:20:34.863 Total : 18237.72 71.24 0.00 0.00 7009.69 3519.53 15437.37 00:20:34.863 0 00:20:34.863 03:31:59 -- host/digest.sh@93 -- # read -r acc_module acc_executed 00:20:34.863 03:31:59 -- host/digest.sh@93 -- # get_accel_stats 00:20:34.863 03:31:59 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:20:34.863 03:31:59 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:20:34.863 | select(.opcode=="crc32c") 00:20:34.863 | "\(.module_name) \(.executed)"' 00:20:34.863 03:31:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:20:35.120 03:31:59 -- host/digest.sh@94 -- # false 00:20:35.120 03:31:59 -- host/digest.sh@94 -- # exp_module=software 00:20:35.120 03:31:59 -- host/digest.sh@95 -- # (( acc_executed > 0 )) 00:20:35.120 03:31:59 -- host/digest.sh@96 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:20:35.120 03:31:59 -- host/digest.sh@98 -- # killprocess 1521333 00:20:35.120 03:31:59 -- common/autotest_common.sh@936 -- # '[' -z 1521333 ']' 00:20:35.120 03:31:59 -- common/autotest_common.sh@940 -- # kill -0 1521333 00:20:35.120 03:31:59 -- common/autotest_common.sh@941 -- # uname 00:20:35.120 03:31:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:35.120 03:31:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1521333 00:20:35.120 03:31:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:35.120 03:31:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:35.120 03:31:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1521333' 00:20:35.120 killing process with pid 1521333 00:20:35.120 03:31:59 -- common/autotest_common.sh@955 -- # kill 1521333 00:20:35.120 Received shutdown signal, test time was about 2.000000 seconds 00:20:35.120 00:20:35.120 Latency(us) 00:20:35.120 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:35.120 =================================================================================================================== 00:20:35.120 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:35.120 03:31:59 -- common/autotest_common.sh@960 -- # wait 1521333 00:20:35.378 03:32:00 -- host/digest.sh@129 -- # run_bperf randread 131072 16 false 00:20:35.378 03:32:00 -- host/digest.sh@77 -- # local rw bs qd scan_dsa 00:20:35.378 03:32:00 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:20:35.378 03:32:00 -- host/digest.sh@80 -- # rw=randread 00:20:35.378 03:32:00 -- host/digest.sh@80 -- # bs=131072 00:20:35.378 03:32:00 -- host/digest.sh@80 -- # qd=16 00:20:35.378 03:32:00 -- host/digest.sh@80 -- # scan_dsa=false 00:20:35.378 03:32:00 -- host/digest.sh@83 -- # bperfpid=1521804 00:20:35.378 03:32:00 -- host/digest.sh@84 -- # waitforlisten 1521804 /var/tmp/bperf.sock 00:20:35.378 03:32:00 -- host/digest.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:20:35.378 03:32:00 -- common/autotest_common.sh@817 -- # '[' -z 1521804 ']' 00:20:35.378 03:32:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:20:35.378 03:32:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:35.378 03:32:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:20:35.378 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:20:35.378 03:32:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:35.378 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:20:35.378 [2024-04-27 03:32:00.299418] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:20:35.378 [2024-04-27 03:32:00.299508] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1521804 ] 00:20:35.378 I/O size of 131072 is greater than zero copy threshold (65536). 00:20:35.378 Zero copy mechanism will not be used. 00:20:35.378 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.636 [2024-04-27 03:32:00.363083] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:35.636 [2024-04-27 03:32:00.471965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:35.636 03:32:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:35.636 03:32:00 -- common/autotest_common.sh@850 -- # return 0 00:20:35.636 03:32:00 -- host/digest.sh@86 -- # false 00:20:35.636 03:32:00 -- host/digest.sh@87 -- # bperf_rpc framework_start_init 00:20:35.636 03:32:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:20:35.895 03:32:00 -- host/digest.sh@89 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:35.895 03:32:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:36.459 nvme0n1 00:20:36.459 03:32:01 -- host/digest.sh@92 -- # bperf_py perform_tests 00:20:36.459 03:32:01 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:20:36.459 I/O size of 131072 is greater than zero copy threshold (65536). 00:20:36.459 Zero copy mechanism will not be used. 00:20:36.459 Running I/O for 2 seconds... 00:20:38.987 00:20:38.987 Latency(us) 00:20:38.987 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:38.987 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:20:38.987 nvme0n1 : 2.00 3697.83 462.23 0.00 0.00 4322.06 819.20 7136.14 00:20:38.987 =================================================================================================================== 00:20:38.987 Total : 3697.83 462.23 0.00 0.00 4322.06 819.20 7136.14 00:20:38.987 0 00:20:38.987 03:32:03 -- host/digest.sh@93 -- # read -r acc_module acc_executed 00:20:38.987 03:32:03 -- host/digest.sh@93 -- # get_accel_stats 00:20:38.987 03:32:03 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:20:38.987 03:32:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:20:38.987 03:32:03 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:20:38.987 | select(.opcode=="crc32c") 00:20:38.987 | "\(.module_name) \(.executed)"' 00:20:38.987 03:32:03 -- host/digest.sh@94 -- # false 00:20:38.987 03:32:03 -- host/digest.sh@94 -- # exp_module=software 00:20:38.987 03:32:03 -- host/digest.sh@95 -- # (( acc_executed > 0 )) 00:20:38.987 03:32:03 -- host/digest.sh@96 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:20:38.987 03:32:03 -- host/digest.sh@98 -- # killprocess 1521804 00:20:38.987 03:32:03 -- common/autotest_common.sh@936 -- # '[' -z 1521804 ']' 00:20:38.987 03:32:03 -- common/autotest_common.sh@940 -- # kill -0 1521804 00:20:38.987 03:32:03 -- common/autotest_common.sh@941 -- # uname 00:20:38.987 03:32:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:38.987 03:32:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1521804 00:20:38.987 03:32:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:38.987 03:32:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:38.987 03:32:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1521804' 00:20:38.987 killing process with pid 1521804 00:20:38.987 03:32:03 -- common/autotest_common.sh@955 -- # kill 1521804 00:20:38.987 Received shutdown signal, test time was about 2.000000 seconds 00:20:38.987 00:20:38.987 Latency(us) 00:20:38.987 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:38.987 =================================================================================================================== 00:20:38.987 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:38.987 03:32:03 -- common/autotest_common.sh@960 -- # wait 1521804 00:20:38.987 03:32:03 -- host/digest.sh@130 -- # run_bperf randwrite 4096 128 false 00:20:38.987 03:32:03 -- host/digest.sh@77 -- # local rw bs qd scan_dsa 00:20:38.987 03:32:03 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:20:38.987 03:32:03 -- host/digest.sh@80 -- # rw=randwrite 00:20:38.987 03:32:03 -- host/digest.sh@80 -- # bs=4096 00:20:38.987 03:32:03 -- host/digest.sh@80 -- # qd=128 00:20:38.987 03:32:03 -- host/digest.sh@80 -- # scan_dsa=false 00:20:38.987 03:32:03 -- host/digest.sh@83 -- # bperfpid=1522267 00:20:38.987 03:32:03 -- host/digest.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:20:38.988 03:32:03 -- host/digest.sh@84 -- # waitforlisten 1522267 /var/tmp/bperf.sock 00:20:38.988 03:32:03 -- common/autotest_common.sh@817 -- # '[' -z 1522267 ']' 00:20:38.988 03:32:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:20:38.988 03:32:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:38.988 03:32:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:20:38.988 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:20:38.988 03:32:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:38.988 03:32:03 -- common/autotest_common.sh@10 -- # set +x 00:20:38.988 [2024-04-27 03:32:03.926631] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:20:38.988 [2024-04-27 03:32:03.926703] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1522267 ] 00:20:38.988 EAL: No free 2048 kB hugepages reported on node 1 00:20:39.246 [2024-04-27 03:32:03.984432] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:39.246 [2024-04-27 03:32:04.088501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:39.246 03:32:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:39.246 03:32:04 -- common/autotest_common.sh@850 -- # return 0 00:20:39.246 03:32:04 -- host/digest.sh@86 -- # false 00:20:39.246 03:32:04 -- host/digest.sh@87 -- # bperf_rpc framework_start_init 00:20:39.246 03:32:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:20:39.504 03:32:04 -- host/digest.sh@89 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:39.504 03:32:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:40.070 nvme0n1 00:20:40.070 03:32:05 -- host/digest.sh@92 -- # bperf_py perform_tests 00:20:40.070 03:32:05 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:20:40.327 Running I/O for 2 seconds... 00:20:42.228 00:20:42.228 Latency(us) 00:20:42.228 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:42.228 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:20:42.228 nvme0n1 : 2.01 20693.08 80.83 0.00 0.00 6178.94 3106.89 16408.27 00:20:42.228 =================================================================================================================== 00:20:42.228 Total : 20693.08 80.83 0.00 0.00 6178.94 3106.89 16408.27 00:20:42.228 0 00:20:42.228 03:32:07 -- host/digest.sh@93 -- # read -r acc_module acc_executed 00:20:42.228 03:32:07 -- host/digest.sh@93 -- # get_accel_stats 00:20:42.228 03:32:07 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:20:42.228 03:32:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:20:42.228 03:32:07 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:20:42.228 | select(.opcode=="crc32c") 00:20:42.228 | "\(.module_name) \(.executed)"' 00:20:42.486 03:32:07 -- host/digest.sh@94 -- # false 00:20:42.486 03:32:07 -- host/digest.sh@94 -- # exp_module=software 00:20:42.486 03:32:07 -- host/digest.sh@95 -- # (( acc_executed > 0 )) 00:20:42.486 03:32:07 -- host/digest.sh@96 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:20:42.486 03:32:07 -- host/digest.sh@98 -- # killprocess 1522267 00:20:42.486 03:32:07 -- common/autotest_common.sh@936 -- # '[' -z 1522267 ']' 00:20:42.486 03:32:07 -- common/autotest_common.sh@940 -- # kill -0 1522267 00:20:42.486 03:32:07 -- common/autotest_common.sh@941 -- # uname 00:20:42.486 03:32:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:42.486 03:32:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1522267 00:20:42.486 03:32:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:42.486 03:32:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:42.486 03:32:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1522267' 00:20:42.486 killing process with pid 1522267 00:20:42.486 03:32:07 -- common/autotest_common.sh@955 -- # kill 1522267 00:20:42.486 Received shutdown signal, test time was about 2.000000 seconds 00:20:42.486 00:20:42.486 Latency(us) 00:20:42.486 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:42.486 =================================================================================================================== 00:20:42.486 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:42.486 03:32:07 -- common/autotest_common.sh@960 -- # wait 1522267 00:20:42.744 03:32:07 -- host/digest.sh@131 -- # run_bperf randwrite 131072 16 false 00:20:42.744 03:32:07 -- host/digest.sh@77 -- # local rw bs qd scan_dsa 00:20:42.744 03:32:07 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:20:42.744 03:32:07 -- host/digest.sh@80 -- # rw=randwrite 00:20:42.744 03:32:07 -- host/digest.sh@80 -- # bs=131072 00:20:42.744 03:32:07 -- host/digest.sh@80 -- # qd=16 00:20:42.745 03:32:07 -- host/digest.sh@80 -- # scan_dsa=false 00:20:42.745 03:32:07 -- host/digest.sh@83 -- # bperfpid=1522677 00:20:42.745 03:32:07 -- host/digest.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:20:42.745 03:32:07 -- host/digest.sh@84 -- # waitforlisten 1522677 /var/tmp/bperf.sock 00:20:42.745 03:32:07 -- common/autotest_common.sh@817 -- # '[' -z 1522677 ']' 00:20:42.745 03:32:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:20:42.745 03:32:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:42.745 03:32:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:20:42.745 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:20:42.745 03:32:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:42.745 03:32:07 -- common/autotest_common.sh@10 -- # set +x 00:20:42.745 [2024-04-27 03:32:07.718821] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:20:42.745 [2024-04-27 03:32:07.718893] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1522677 ] 00:20:42.745 I/O size of 131072 is greater than zero copy threshold (65536). 00:20:42.745 Zero copy mechanism will not be used. 00:20:43.003 EAL: No free 2048 kB hugepages reported on node 1 00:20:43.003 [2024-04-27 03:32:07.779133] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:43.003 [2024-04-27 03:32:07.893337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:43.003 03:32:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:43.003 03:32:07 -- common/autotest_common.sh@850 -- # return 0 00:20:43.003 03:32:07 -- host/digest.sh@86 -- # false 00:20:43.003 03:32:07 -- host/digest.sh@87 -- # bperf_rpc framework_start_init 00:20:43.003 03:32:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:20:43.568 03:32:08 -- host/digest.sh@89 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:43.568 03:32:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:43.858 nvme0n1 00:20:43.858 03:32:08 -- host/digest.sh@92 -- # bperf_py perform_tests 00:20:43.858 03:32:08 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:20:43.858 I/O size of 131072 is greater than zero copy threshold (65536). 00:20:43.858 Zero copy mechanism will not be used. 00:20:43.858 Running I/O for 2 seconds... 00:20:46.394 00:20:46.394 Latency(us) 00:20:46.394 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:46.394 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:20:46.394 nvme0n1 : 2.00 4777.69 597.21 0.00 0.00 3340.82 2415.12 11747.93 00:20:46.394 =================================================================================================================== 00:20:46.394 Total : 4777.69 597.21 0.00 0.00 3340.82 2415.12 11747.93 00:20:46.394 0 00:20:46.394 03:32:10 -- host/digest.sh@93 -- # read -r acc_module acc_executed 00:20:46.394 03:32:10 -- host/digest.sh@93 -- # get_accel_stats 00:20:46.394 03:32:10 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:20:46.394 03:32:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:20:46.394 03:32:10 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:20:46.394 | select(.opcode=="crc32c") 00:20:46.394 | "\(.module_name) \(.executed)"' 00:20:46.395 03:32:11 -- host/digest.sh@94 -- # false 00:20:46.395 03:32:11 -- host/digest.sh@94 -- # exp_module=software 00:20:46.395 03:32:11 -- host/digest.sh@95 -- # (( acc_executed > 0 )) 00:20:46.395 03:32:11 -- host/digest.sh@96 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:20:46.395 03:32:11 -- host/digest.sh@98 -- # killprocess 1522677 00:20:46.395 03:32:11 -- common/autotest_common.sh@936 -- # '[' -z 1522677 ']' 00:20:46.395 03:32:11 -- common/autotest_common.sh@940 -- # kill -0 1522677 00:20:46.395 03:32:11 -- common/autotest_common.sh@941 -- # uname 00:20:46.395 03:32:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:46.395 03:32:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1522677 00:20:46.395 03:32:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:46.395 03:32:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:46.395 03:32:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1522677' 00:20:46.395 killing process with pid 1522677 00:20:46.395 03:32:11 -- common/autotest_common.sh@955 -- # kill 1522677 00:20:46.395 Received shutdown signal, test time was about 2.000000 seconds 00:20:46.395 00:20:46.395 Latency(us) 00:20:46.395 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:46.395 =================================================================================================================== 00:20:46.395 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:46.395 03:32:11 -- common/autotest_common.sh@960 -- # wait 1522677 00:20:46.395 03:32:11 -- host/digest.sh@132 -- # killprocess 1521308 00:20:46.395 03:32:11 -- common/autotest_common.sh@936 -- # '[' -z 1521308 ']' 00:20:46.395 03:32:11 -- common/autotest_common.sh@940 -- # kill -0 1521308 00:20:46.395 03:32:11 -- common/autotest_common.sh@941 -- # uname 00:20:46.395 03:32:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:46.395 03:32:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1521308 00:20:46.395 03:32:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:46.395 03:32:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:46.395 03:32:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1521308' 00:20:46.395 killing process with pid 1521308 00:20:46.395 03:32:11 -- common/autotest_common.sh@955 -- # kill 1521308 00:20:46.395 03:32:11 -- common/autotest_common.sh@960 -- # wait 1521308 00:20:46.653 00:20:46.653 real 0m15.332s 00:20:46.653 user 0m29.889s 00:20:46.653 sys 0m4.238s 00:20:46.653 03:32:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:46.653 03:32:11 -- common/autotest_common.sh@10 -- # set +x 00:20:46.653 ************************************ 00:20:46.653 END TEST nvmf_digest_clean 00:20:46.653 ************************************ 00:20:46.911 03:32:11 -- host/digest.sh@147 -- # run_test nvmf_digest_error run_digest_error 00:20:46.911 03:32:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:20:46.911 03:32:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:46.911 03:32:11 -- common/autotest_common.sh@10 -- # set +x 00:20:46.911 ************************************ 00:20:46.911 START TEST nvmf_digest_error 00:20:46.911 ************************************ 00:20:46.911 03:32:11 -- common/autotest_common.sh@1111 -- # run_digest_error 00:20:46.911 03:32:11 -- host/digest.sh@102 -- # nvmfappstart --wait-for-rpc 00:20:46.911 03:32:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:46.911 03:32:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:46.911 03:32:11 -- common/autotest_common.sh@10 -- # set +x 00:20:46.911 03:32:11 -- nvmf/common.sh@470 -- # nvmfpid=1523238 00:20:46.911 03:32:11 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:20:46.911 03:32:11 -- nvmf/common.sh@471 -- # waitforlisten 1523238 00:20:46.911 03:32:11 -- common/autotest_common.sh@817 -- # '[' -z 1523238 ']' 00:20:46.911 03:32:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:46.911 03:32:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:46.911 03:32:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:46.911 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:46.911 03:32:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:46.911 03:32:11 -- common/autotest_common.sh@10 -- # set +x 00:20:46.911 [2024-04-27 03:32:11.786522] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:20:46.911 [2024-04-27 03:32:11.786614] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:46.911 EAL: No free 2048 kB hugepages reported on node 1 00:20:46.911 [2024-04-27 03:32:11.854295] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:47.169 [2024-04-27 03:32:11.969156] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:47.169 [2024-04-27 03:32:11.969213] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:47.169 [2024-04-27 03:32:11.969228] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:47.169 [2024-04-27 03:32:11.969241] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:47.169 [2024-04-27 03:32:11.969274] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:47.169 [2024-04-27 03:32:11.969310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:48.105 03:32:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:48.105 03:32:12 -- common/autotest_common.sh@850 -- # return 0 00:20:48.105 03:32:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:48.105 03:32:12 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:48.105 03:32:12 -- common/autotest_common.sh@10 -- # set +x 00:20:48.105 03:32:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:48.105 03:32:12 -- host/digest.sh@104 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:20:48.105 03:32:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:48.105 03:32:12 -- common/autotest_common.sh@10 -- # set +x 00:20:48.105 [2024-04-27 03:32:12.747748] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:20:48.105 03:32:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:48.105 03:32:12 -- host/digest.sh@105 -- # common_target_config 00:20:48.105 03:32:12 -- host/digest.sh@43 -- # rpc_cmd 00:20:48.105 03:32:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:48.105 03:32:12 -- common/autotest_common.sh@10 -- # set +x 00:20:48.105 null0 00:20:48.105 [2024-04-27 03:32:12.865014] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:48.105 [2024-04-27 03:32:12.889270] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:48.105 03:32:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:48.105 03:32:12 -- host/digest.sh@108 -- # run_bperf_err randread 4096 128 00:20:48.105 03:32:12 -- host/digest.sh@54 -- # local rw bs qd 00:20:48.105 03:32:12 -- host/digest.sh@56 -- # rw=randread 00:20:48.105 03:32:12 -- host/digest.sh@56 -- # bs=4096 00:20:48.105 03:32:12 -- host/digest.sh@56 -- # qd=128 00:20:48.105 03:32:12 -- host/digest.sh@58 -- # bperfpid=1523387 00:20:48.105 03:32:12 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:20:48.105 03:32:12 -- host/digest.sh@60 -- # waitforlisten 1523387 /var/tmp/bperf.sock 00:20:48.105 03:32:12 -- common/autotest_common.sh@817 -- # '[' -z 1523387 ']' 00:20:48.105 03:32:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:20:48.105 03:32:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:48.105 03:32:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:20:48.105 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:20:48.105 03:32:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:48.105 03:32:12 -- common/autotest_common.sh@10 -- # set +x 00:20:48.105 [2024-04-27 03:32:12.933873] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:20:48.105 [2024-04-27 03:32:12.933949] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1523387 ] 00:20:48.105 EAL: No free 2048 kB hugepages reported on node 1 00:20:48.105 [2024-04-27 03:32:12.993641] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:48.363 [2024-04-27 03:32:13.100626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:48.363 03:32:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:48.363 03:32:13 -- common/autotest_common.sh@850 -- # return 0 00:20:48.363 03:32:13 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:20:48.363 03:32:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:20:48.621 03:32:13 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:20:48.621 03:32:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:48.621 03:32:13 -- common/autotest_common.sh@10 -- # set +x 00:20:48.621 03:32:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:48.621 03:32:13 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:48.621 03:32:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:48.879 nvme0n1 00:20:48.879 03:32:13 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:20:48.879 03:32:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:48.879 03:32:13 -- common/autotest_common.sh@10 -- # set +x 00:20:48.879 03:32:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:48.879 03:32:13 -- host/digest.sh@69 -- # bperf_py perform_tests 00:20:48.879 03:32:13 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:20:49.137 Running I/O for 2 seconds... 00:20:49.137 [2024-04-27 03:32:13.958696] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:13.958748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:21366 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:13.958769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.137 [2024-04-27 03:32:13.975468] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:13.975503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:17363 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:13.975522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.137 [2024-04-27 03:32:13.991642] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:13.991679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4070 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:13.991703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.137 [2024-04-27 03:32:14.007322] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:14.007354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:11356 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:14.007375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.137 [2024-04-27 03:32:14.019794] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:14.019830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:9629 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:14.019850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.137 [2024-04-27 03:32:14.037242] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:14.037310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:2806 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:14.037329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.137 [2024-04-27 03:32:14.053419] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:14.053455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:7570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:14.053478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.137 [2024-04-27 03:32:14.066718] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:14.066754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:13475 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:14.066773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.137 [2024-04-27 03:32:14.081389] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:14.081420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17165 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:14.081437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.137 [2024-04-27 03:32:14.093688] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:14.093723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:25101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:14.093742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.137 [2024-04-27 03:32:14.108390] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.137 [2024-04-27 03:32:14.108418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:17180 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.137 [2024-04-27 03:32:14.108449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.122800] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.122835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:11903 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.122853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.136388] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.136434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:3834 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.136451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.149928] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.149963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:8650 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.149991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.165762] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.165797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:6541 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.165816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.179682] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.179717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:11580 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.179736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.193765] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.193799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:3016 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.193819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.208843] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.208877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2956 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.208897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.221831] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.221867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:11298 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.221886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.237699] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.237733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:6095 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.237752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.254884] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.254920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:4360 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.254939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.267574] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.267621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:7010 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.267640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.282013] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.282054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:9799 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.282074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.297200] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.297235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:6879 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.297265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.310759] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.310794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:5504 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.310812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.325003] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.325037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:7691 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.325056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.338756] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.338789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:4503 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.338808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.351853] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.351888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:5829 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.351907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.396 [2024-04-27 03:32:14.367962] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.396 [2024-04-27 03:32:14.367999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:22818 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.396 [2024-04-27 03:32:14.368018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.655 [2024-04-27 03:32:14.379776] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.655 [2024-04-27 03:32:14.379810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6903 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.655 [2024-04-27 03:32:14.379828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.655 [2024-04-27 03:32:14.394929] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.655 [2024-04-27 03:32:14.394964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:9181 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.655 [2024-04-27 03:32:14.394982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.655 [2024-04-27 03:32:14.408995] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.655 [2024-04-27 03:32:14.409029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:20871 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.655 [2024-04-27 03:32:14.409048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.655 [2024-04-27 03:32:14.424318] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.655 [2024-04-27 03:32:14.424346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22292 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.655 [2024-04-27 03:32:14.424377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.655 [2024-04-27 03:32:14.439983] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.655 [2024-04-27 03:32:14.440017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:3654 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.655 [2024-04-27 03:32:14.440041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.655 [2024-04-27 03:32:14.452476] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.655 [2024-04-27 03:32:14.452504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:17685 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.655 [2024-04-27 03:32:14.452534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.655 [2024-04-27 03:32:14.468555] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.655 [2024-04-27 03:32:14.468585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:8414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.655 [2024-04-27 03:32:14.468618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.655 [2024-04-27 03:32:14.484642] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.656 [2024-04-27 03:32:14.484676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6053 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.656 [2024-04-27 03:32:14.484694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.656 [2024-04-27 03:32:14.496815] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.656 [2024-04-27 03:32:14.496850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:8903 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.656 [2024-04-27 03:32:14.496869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.656 [2024-04-27 03:32:14.513258] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.656 [2024-04-27 03:32:14.513305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:363 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.656 [2024-04-27 03:32:14.513323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.656 [2024-04-27 03:32:14.528295] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.656 [2024-04-27 03:32:14.528327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:10289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.656 [2024-04-27 03:32:14.528365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.656 [2024-04-27 03:32:14.541148] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.656 [2024-04-27 03:32:14.541188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:19038 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.656 [2024-04-27 03:32:14.541207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.656 [2024-04-27 03:32:14.559842] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.656 [2024-04-27 03:32:14.559876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10233 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.656 [2024-04-27 03:32:14.559895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.656 [2024-04-27 03:32:14.571624] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.656 [2024-04-27 03:32:14.571658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:826 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.656 [2024-04-27 03:32:14.571676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.656 [2024-04-27 03:32:14.588172] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.656 [2024-04-27 03:32:14.588206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:13975 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.656 [2024-04-27 03:32:14.588225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.656 [2024-04-27 03:32:14.606344] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.656 [2024-04-27 03:32:14.606372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:18414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.656 [2024-04-27 03:32:14.606402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.656 [2024-04-27 03:32:14.622429] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.656 [2024-04-27 03:32:14.622460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:23564 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.656 [2024-04-27 03:32:14.622477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.637924] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.637958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:14604 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.637977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.649829] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.649863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:20696 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.649882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.664380] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.664413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4155 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.664444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.679238] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.679284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:20961 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.679317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.695098] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.695131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:5024 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.695150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.707189] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.707223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.707242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.723932] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.723965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:19543 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.723984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.741838] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.741872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:2820 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.741891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.753306] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.753334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:14302 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.753365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.768610] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.768638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:18551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.768668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.785325] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.785355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:134 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.785386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.801980] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.802010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:9656 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.802028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.817135] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.817180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:19683 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.817196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.830180] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.830210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6614 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.830240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.843880] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.843916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:11836 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.843933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.855495] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.855540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25323 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.855557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.868201] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.868244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:14843 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.868268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:49.915 [2024-04-27 03:32:14.880976] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:49.915 [2024-04-27 03:32:14.881004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:15117 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:49.915 [2024-04-27 03:32:14.881034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:14.893815] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:14.893843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:16924 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:14.893873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:14.906654] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:14.906689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:4156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:14.906721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:14.919376] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:14.919405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:14.919437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:14.931923] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:14.931952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:12116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:14.931982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:14.944830] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:14.944858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:8697 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:14.944889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:14.958904] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:14.958934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:15867 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:14.958951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:14.971663] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:14.971693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:19071 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:14.971709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:14.986301] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:14.986331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:8083 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:14.986363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:14.998586] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:14.998616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:19160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:14.998638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:15.010284] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:15.010313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:15.010345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:15.024496] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:15.024525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:10099 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:15.024557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:15.035477] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:15.035506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:7265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:15.035539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:15.051965] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:15.051997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:15085 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:15.052018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:15.063230] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:15.063273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:2417 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:15.063294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:15.076481] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:15.076511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:15239 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:15.076543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.175 [2024-04-27 03:32:15.089386] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.175 [2024-04-27 03:32:15.089419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:16390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.175 [2024-04-27 03:32:15.089436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.176 [2024-04-27 03:32:15.103547] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.176 [2024-04-27 03:32:15.103582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2968 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.176 [2024-04-27 03:32:15.103601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.176 [2024-04-27 03:32:15.115325] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.176 [2024-04-27 03:32:15.115355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:7992 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.176 [2024-04-27 03:32:15.115387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.176 [2024-04-27 03:32:15.131204] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.176 [2024-04-27 03:32:15.131234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:14584 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.176 [2024-04-27 03:32:15.131282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.176 [2024-04-27 03:32:15.146311] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.176 [2024-04-27 03:32:15.146343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8313 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.176 [2024-04-27 03:32:15.146360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.159261] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.159292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:7024 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.159309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.171801] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.171846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:2442 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.171862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.184542] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.184573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:18991 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.184590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.197810] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.197840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:24931 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.197858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.211644] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.211674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:9271 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.211691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.223173] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.223201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:8231 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.223233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.239026] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.239056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:8137 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.239072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.254501] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.254538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:19993 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.254573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.269407] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.269438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:1248 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.269454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.281168] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.281201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:11649 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.281221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.292721] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.292750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:12946 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.292766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.307958] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.307991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:932 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.308011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.322061] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.434 [2024-04-27 03:32:15.322092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9103 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.434 [2024-04-27 03:32:15.322110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.434 [2024-04-27 03:32:15.333132] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.435 [2024-04-27 03:32:15.333160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21685 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.435 [2024-04-27 03:32:15.333191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.435 [2024-04-27 03:32:15.348291] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.435 [2024-04-27 03:32:15.348322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:2437 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.435 [2024-04-27 03:32:15.348339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.435 [2024-04-27 03:32:15.363797] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.435 [2024-04-27 03:32:15.363828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:15036 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.435 [2024-04-27 03:32:15.363845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.435 [2024-04-27 03:32:15.375694] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.435 [2024-04-27 03:32:15.375724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:10136 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.435 [2024-04-27 03:32:15.375755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.435 [2024-04-27 03:32:15.391030] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.435 [2024-04-27 03:32:15.391059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:21394 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.435 [2024-04-27 03:32:15.391090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.435 [2024-04-27 03:32:15.405689] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.435 [2024-04-27 03:32:15.405720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:5070 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.435 [2024-04-27 03:32:15.405753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.417535] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.417584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:14791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.417600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.432717] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.432746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:22399 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.432781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.448255] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.448289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:4249 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.448310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.459842] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.459870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23239 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.459902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.476171] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.476199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:22238 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.476230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.487662] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.487697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9974 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.487728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.502000] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.502029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:249 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.502060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.516755] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.516784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:15357 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.516814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.528847] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.528880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:3528 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.528898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.540544] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.540574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:13537 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.540590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.553787] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.553815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:5778 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.553845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.567269] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.567299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25387 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.567331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.581720] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.581749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:11771 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.581780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.593470] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.593502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:3412 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.593519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.607475] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.607512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19954 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.607533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.619890] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.619924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:12348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.619944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.634169] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.634207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:21665 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.634230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.648017] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.648055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:24467 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.648078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.694 [2024-04-27 03:32:15.661626] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.694 [2024-04-27 03:32:15.661659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:24667 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.694 [2024-04-27 03:32:15.661678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.675626] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.675662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:8523 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.675681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.689070] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.689104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5776 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.689122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.704441] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.704471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:14351 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.704488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.718134] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.718168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:8634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.718193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.732102] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.732135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10406 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.732154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.743665] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.743699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:9808 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.743718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.760033] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.760067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:3694 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.760085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.778356] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.778387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1712 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.778404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.795217] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.795257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:9926 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.795278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.807673] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.807708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:9751 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.807727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.823659] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.823693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.823712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.835453] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.835480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:22156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.835511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.852815] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.852855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.852875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.871523] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.871571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:19919 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.871590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.887935] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.887969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23376 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.887988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.905234] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.905276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:6477 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.905308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:50.953 [2024-04-27 03:32:15.920271] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:50.953 [2024-04-27 03:32:15.920317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:55 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:50.953 [2024-04-27 03:32:15.920334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:51.212 [2024-04-27 03:32:15.932584] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:51.212 [2024-04-27 03:32:15.932618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2318 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:51.212 [2024-04-27 03:32:15.932637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:51.212 [2024-04-27 03:32:15.949389] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x17ada60) 00:20:51.212 [2024-04-27 03:32:15.949417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:4874 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:51.212 [2024-04-27 03:32:15.949448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:51.212 00:20:51.212 Latency(us) 00:20:51.212 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:51.212 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:20:51.212 nvme0n1 : 2.01 17928.87 70.03 0.00 0.00 7130.03 3592.34 23495.87 00:20:51.212 =================================================================================================================== 00:20:51.212 Total : 17928.87 70.03 0.00 0.00 7130.03 3592.34 23495.87 00:20:51.212 0 00:20:51.212 03:32:15 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:20:51.212 03:32:15 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:20:51.212 03:32:15 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:20:51.212 | .driver_specific 00:20:51.212 | .nvme_error 00:20:51.212 | .status_code 00:20:51.212 | .command_transient_transport_error' 00:20:51.212 03:32:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:20:51.471 03:32:16 -- host/digest.sh@71 -- # (( 141 > 0 )) 00:20:51.471 03:32:16 -- host/digest.sh@73 -- # killprocess 1523387 00:20:51.471 03:32:16 -- common/autotest_common.sh@936 -- # '[' -z 1523387 ']' 00:20:51.471 03:32:16 -- common/autotest_common.sh@940 -- # kill -0 1523387 00:20:51.471 03:32:16 -- common/autotest_common.sh@941 -- # uname 00:20:51.471 03:32:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:51.471 03:32:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1523387 00:20:51.471 03:32:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:51.471 03:32:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:51.471 03:32:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1523387' 00:20:51.471 killing process with pid 1523387 00:20:51.471 03:32:16 -- common/autotest_common.sh@955 -- # kill 1523387 00:20:51.471 Received shutdown signal, test time was about 2.000000 seconds 00:20:51.471 00:20:51.471 Latency(us) 00:20:51.471 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:51.471 =================================================================================================================== 00:20:51.471 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:51.471 03:32:16 -- common/autotest_common.sh@960 -- # wait 1523387 00:20:51.729 03:32:16 -- host/digest.sh@109 -- # run_bperf_err randread 131072 16 00:20:51.729 03:32:16 -- host/digest.sh@54 -- # local rw bs qd 00:20:51.729 03:32:16 -- host/digest.sh@56 -- # rw=randread 00:20:51.729 03:32:16 -- host/digest.sh@56 -- # bs=131072 00:20:51.729 03:32:16 -- host/digest.sh@56 -- # qd=16 00:20:51.729 03:32:16 -- host/digest.sh@58 -- # bperfpid=1523795 00:20:51.729 03:32:16 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:20:51.729 03:32:16 -- host/digest.sh@60 -- # waitforlisten 1523795 /var/tmp/bperf.sock 00:20:51.729 03:32:16 -- common/autotest_common.sh@817 -- # '[' -z 1523795 ']' 00:20:51.729 03:32:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:20:51.729 03:32:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:51.730 03:32:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:20:51.730 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:20:51.730 03:32:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:51.730 03:32:16 -- common/autotest_common.sh@10 -- # set +x 00:20:51.730 [2024-04-27 03:32:16.545994] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:20:51.730 [2024-04-27 03:32:16.546069] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1523795 ] 00:20:51.730 I/O size of 131072 is greater than zero copy threshold (65536). 00:20:51.730 Zero copy mechanism will not be used. 00:20:51.730 EAL: No free 2048 kB hugepages reported on node 1 00:20:51.730 [2024-04-27 03:32:16.607936] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:51.987 [2024-04-27 03:32:16.715395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:51.987 03:32:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:51.987 03:32:16 -- common/autotest_common.sh@850 -- # return 0 00:20:51.987 03:32:16 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:20:51.987 03:32:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:20:52.244 03:32:17 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:20:52.244 03:32:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:52.244 03:32:17 -- common/autotest_common.sh@10 -- # set +x 00:20:52.244 03:32:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:52.244 03:32:17 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:52.244 03:32:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:52.501 nvme0n1 00:20:52.759 03:32:17 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:20:52.759 03:32:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:52.759 03:32:17 -- common/autotest_common.sh@10 -- # set +x 00:20:52.759 03:32:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:52.759 03:32:17 -- host/digest.sh@69 -- # bperf_py perform_tests 00:20:52.759 03:32:17 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:20:52.759 I/O size of 131072 is greater than zero copy threshold (65536). 00:20:52.759 Zero copy mechanism will not be used. 00:20:52.759 Running I/O for 2 seconds... 00:20:52.759 [2024-04-27 03:32:17.608923] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.608979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.609001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.616294] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.616326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.616342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.623476] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.623505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.623522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.630706] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.630739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.630758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.637812] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.637845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.637864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.645240] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.645295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.645313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.652405] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.652436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.652461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.659595] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.659637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.659652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.666850] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.666882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.666899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.674024] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.674057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.674075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.681171] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.681203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.681221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.688299] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.688331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.688346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.695479] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.695507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.695523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.702587] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.702633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.702650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.709705] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.709737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.709755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.716847] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.716880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.716899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.723975] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.724007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.724025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:52.759 [2024-04-27 03:32:17.731128] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:52.759 [2024-04-27 03:32:17.731160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:52.759 [2024-04-27 03:32:17.731178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.738623] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.738656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.738674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.745860] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.745893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.745911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.752895] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.752928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.752945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.759967] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.759999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.760017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.767041] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.767073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.767090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.774154] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.774186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.774211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.781211] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.781243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.781272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.788459] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.788488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.788504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.795548] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.795594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.795612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.802647] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.802679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.802697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.809714] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.809746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.809764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.816734] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.816767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.816785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.823832] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.823863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.823882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.830955] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.830986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.831004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.838411] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.838447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.838464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.018 [2024-04-27 03:32:17.845510] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.018 [2024-04-27 03:32:17.845554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.018 [2024-04-27 03:32:17.845573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.852542] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.852588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.852607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.859697] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.859729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.859747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.866849] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.866881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.866899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.874147] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.874179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.874196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.881176] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.881208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.881226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.888261] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.888293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.888326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.895202] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.895234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.895259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.902313] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.902340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.902355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.909386] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.909414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.909429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.916557] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.916599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.916618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.923687] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.923719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.923737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.930760] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.930792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.930810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.937890] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.937922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.937939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.945116] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.945149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.945167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.952191] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.952223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.952241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.959403] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.959431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.959536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.966596] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.966628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.966646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.974108] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.974142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.974161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.983283] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.983313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.983329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.019 [2024-04-27 03:32:17.992017] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.019 [2024-04-27 03:32:17.992051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.019 [2024-04-27 03:32:17.992070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:17.999717] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:17.999762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:17.999778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.006278] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.006307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.006322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.012770] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.012802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.012819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.019827] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.019859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.019877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.026799] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.026832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.026850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.033972] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.034003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.034021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.041128] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.041161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.041179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.048393] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.048423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.048439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.055506] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.055535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.055551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.062647] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.062678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.062697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.069639] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.069671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.069689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.076676] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.076708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.076726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.083775] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.083806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.083830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.090869] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.090900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.090918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.097921] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.097953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.097970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.105114] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.105145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.105163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.112494] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.112540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.112556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.278 [2024-04-27 03:32:18.119789] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.278 [2024-04-27 03:32:18.119821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.278 [2024-04-27 03:32:18.119838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.126981] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.127014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.127031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.134320] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.134348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.134363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.141379] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.141407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.141423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.148395] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.148444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.148461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.155576] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.155619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.155635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.162714] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.162745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.162763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.169764] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.169796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.169813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.176759] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.176791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.176808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.183894] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.183925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.183943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.190977] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.191009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.191027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.198273] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.198320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.198337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.205339] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.205367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.205383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.212334] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.212377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.212392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.219330] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.219358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.219374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.226335] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.226362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.226378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.233297] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.233324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.233340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.240328] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.240356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.240372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.279 [2024-04-27 03:32:18.247476] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.279 [2024-04-27 03:32:18.247505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.279 [2024-04-27 03:32:18.247521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.538 [2024-04-27 03:32:18.254828] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.538 [2024-04-27 03:32:18.254859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.538 [2024-04-27 03:32:18.254877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.538 [2024-04-27 03:32:18.262205] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.538 [2024-04-27 03:32:18.262237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.538 [2024-04-27 03:32:18.262267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.538 [2024-04-27 03:32:18.269338] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.538 [2024-04-27 03:32:18.269380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.538 [2024-04-27 03:32:18.269401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.538 [2024-04-27 03:32:18.276517] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.538 [2024-04-27 03:32:18.276546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.538 [2024-04-27 03:32:18.276579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.538 [2024-04-27 03:32:18.283630] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.538 [2024-04-27 03:32:18.283661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.538 [2024-04-27 03:32:18.283679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.538 [2024-04-27 03:32:18.290597] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.538 [2024-04-27 03:32:18.290644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.538 [2024-04-27 03:32:18.290662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.538 [2024-04-27 03:32:18.297783] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.538 [2024-04-27 03:32:18.297814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.538 [2024-04-27 03:32:18.297833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.538 [2024-04-27 03:32:18.304781] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.538 [2024-04-27 03:32:18.304812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.538 [2024-04-27 03:32:18.304829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.538 [2024-04-27 03:32:18.311792] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.538 [2024-04-27 03:32:18.311824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.538 [2024-04-27 03:32:18.311842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.318973] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.319006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.319024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.325966] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.325997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.326014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.333063] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.333094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.333112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.340083] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.340116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.340134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.347109] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.347141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.347159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.354204] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.354236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.354268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.361272] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.361315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.361330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.368340] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.368368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.368384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.375349] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.375378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.375395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.382629] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.382660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.382678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.389738] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.389770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.389793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.396822] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.396853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.396871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.403954] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.403985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.404003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.411037] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.411069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.411087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.418043] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.418075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.418092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.424949] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.424982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.424999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.431943] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.431976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.431994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.438987] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.439019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.439037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.445890] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.445919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.445934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.452676] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.452724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.452739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.459262] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.459304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.459320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.465707] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.465734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.465749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.539 [2024-04-27 03:32:18.472173] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.539 [2024-04-27 03:32:18.472215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.539 [2024-04-27 03:32:18.472230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.540 [2024-04-27 03:32:18.479010] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.540 [2024-04-27 03:32:18.479042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.540 [2024-04-27 03:32:18.479060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.540 [2024-04-27 03:32:18.486085] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.540 [2024-04-27 03:32:18.486116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.540 [2024-04-27 03:32:18.486134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.540 [2024-04-27 03:32:18.493256] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.540 [2024-04-27 03:32:18.493301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.540 [2024-04-27 03:32:18.493317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.540 [2024-04-27 03:32:18.500401] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.540 [2024-04-27 03:32:18.500429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.540 [2024-04-27 03:32:18.500444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.540 [2024-04-27 03:32:18.507538] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.540 [2024-04-27 03:32:18.507580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.540 [2024-04-27 03:32:18.507596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.798 [2024-04-27 03:32:18.514772] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.798 [2024-04-27 03:32:18.514804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.798 [2024-04-27 03:32:18.514822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.798 [2024-04-27 03:32:18.522272] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.522305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.522337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.529396] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.529424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.529440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.536477] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.536507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.536524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.543796] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.543828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.543846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.550982] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.551013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.551031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.558148] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.558180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.558197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.565259] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.565302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.565318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.572494] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.572527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.572544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.579586] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.579618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.579635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.586658] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.586700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.586718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.593694] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.593726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.593744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.600752] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.600783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.600801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.607789] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.607821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.607838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.614816] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.614847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.614865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.621875] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.621906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.621923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.629115] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.629146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.629164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.636374] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.636402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.636418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.643428] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.643456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.643471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.650585] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.650631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.650649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.657749] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.657780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.657798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.664783] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.664815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.664832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.671815] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.671847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.671865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.678855] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.678887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.678905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.685905] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.685936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.685954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.692952] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.692984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.693008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.700083] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.700115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.700133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.707231] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.799 [2024-04-27 03:32:18.707275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.799 [2024-04-27 03:32:18.707307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.799 [2024-04-27 03:32:18.714468] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.800 [2024-04-27 03:32:18.714496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.800 [2024-04-27 03:32:18.714513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.800 [2024-04-27 03:32:18.721746] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.800 [2024-04-27 03:32:18.721777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.800 [2024-04-27 03:32:18.721795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.800 [2024-04-27 03:32:18.728960] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.800 [2024-04-27 03:32:18.728991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.800 [2024-04-27 03:32:18.729009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.800 [2024-04-27 03:32:18.736114] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.800 [2024-04-27 03:32:18.736145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.800 [2024-04-27 03:32:18.736162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.800 [2024-04-27 03:32:18.743233] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.800 [2024-04-27 03:32:18.743291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.800 [2024-04-27 03:32:18.743317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:53.800 [2024-04-27 03:32:18.750484] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.800 [2024-04-27 03:32:18.750513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.800 [2024-04-27 03:32:18.750529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:53.800 [2024-04-27 03:32:18.757547] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.800 [2024-04-27 03:32:18.757602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.800 [2024-04-27 03:32:18.757622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:53.800 [2024-04-27 03:32:18.764564] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.800 [2024-04-27 03:32:18.764591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.800 [2024-04-27 03:32:18.764632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:53.800 [2024-04-27 03:32:18.771607] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:53.800 [2024-04-27 03:32:18.771639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:53.800 [2024-04-27 03:32:18.771657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.057 [2024-04-27 03:32:18.778948] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.057 [2024-04-27 03:32:18.778980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.057 [2024-04-27 03:32:18.778998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.057 [2024-04-27 03:32:18.786077] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.057 [2024-04-27 03:32:18.786108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.057 [2024-04-27 03:32:18.786126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.057 [2024-04-27 03:32:18.793170] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.057 [2024-04-27 03:32:18.793201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.057 [2024-04-27 03:32:18.793218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.057 [2024-04-27 03:32:18.800517] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.057 [2024-04-27 03:32:18.800557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.057 [2024-04-27 03:32:18.800573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.057 [2024-04-27 03:32:18.807694] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.057 [2024-04-27 03:32:18.807725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.057 [2024-04-27 03:32:18.807743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.057 [2024-04-27 03:32:18.814915] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.057 [2024-04-27 03:32:18.814947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.057 [2024-04-27 03:32:18.814964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.057 [2024-04-27 03:32:18.822190] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.057 [2024-04-27 03:32:18.822222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.057 [2024-04-27 03:32:18.822240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.829525] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.829554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.829585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.836649] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.836691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.836710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.843735] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.843767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.843784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.850761] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.850793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.850811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.857738] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.857769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.857787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.864793] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.864824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.864842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.871801] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.871832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.871850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.878978] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.879015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.879034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.885978] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.886009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.886027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.893111] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.893141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.893159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.900112] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.900143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.900161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.907281] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.907326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.907342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.914261] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.914305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.914321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.921237] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.921292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.921309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.928233] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.928276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.928294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.935167] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.935198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.935215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.942307] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.942335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.942350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.950602] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.950636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.950656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.959762] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.959796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.959815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.969143] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.969177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.969195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.978622] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.978671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.978690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.987814] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.987848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.987866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:18.997117] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:18.997151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:18.997170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:19.006416] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:19.006446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:19.006462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:19.015748] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:19.015783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:19.015808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.058 [2024-04-27 03:32:19.025132] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.058 [2024-04-27 03:32:19.025167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.058 [2024-04-27 03:32:19.025185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.316 [2024-04-27 03:32:19.034677] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.316 [2024-04-27 03:32:19.034712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.034730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.043039] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.043073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.043092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.052595] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.052623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.052652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.061777] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.061812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.061830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.069473] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.069517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.069533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.077352] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.077382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.077413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.084590] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.084622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.084640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.091720] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.091758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.091778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.098980] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.099012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.099031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.106145] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.106177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.106195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.113223] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.113271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.113304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.120352] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.120379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.120409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.127721] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.127753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.127771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.134913] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.134945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.134962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.142137] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.142169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.142187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.149232] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.149274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.149307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.156422] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.156450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.156465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.163633] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.163665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.163683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.170621] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.170653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.170671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.177690] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.177721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.177738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.184974] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.185006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.185024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.192181] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.192213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.192231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.199360] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.199399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.199429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.206506] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.206533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.206549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.213738] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.213774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.213793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.220824] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.220855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.220873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.228097] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.228128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.317 [2024-04-27 03:32:19.228146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.317 [2024-04-27 03:32:19.235261] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.317 [2024-04-27 03:32:19.235304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.318 [2024-04-27 03:32:19.235319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.318 [2024-04-27 03:32:19.242423] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.318 [2024-04-27 03:32:19.242452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.318 [2024-04-27 03:32:19.242468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.318 [2024-04-27 03:32:19.249705] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.318 [2024-04-27 03:32:19.249738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.318 [2024-04-27 03:32:19.249756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.318 [2024-04-27 03:32:19.256950] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.318 [2024-04-27 03:32:19.256982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.318 [2024-04-27 03:32:19.257000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.318 [2024-04-27 03:32:19.264121] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.318 [2024-04-27 03:32:19.264153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.318 [2024-04-27 03:32:19.264171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.318 [2024-04-27 03:32:19.271189] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.318 [2024-04-27 03:32:19.271220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.318 [2024-04-27 03:32:19.271238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.318 [2024-04-27 03:32:19.278185] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.318 [2024-04-27 03:32:19.278216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.318 [2024-04-27 03:32:19.278234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.318 [2024-04-27 03:32:19.285214] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.318 [2024-04-27 03:32:19.285254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.318 [2024-04-27 03:32:19.285288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.318 [2024-04-27 03:32:19.292832] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.318 [2024-04-27 03:32:19.292864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.318 [2024-04-27 03:32:19.292882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.576 [2024-04-27 03:32:19.300173] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.576 [2024-04-27 03:32:19.300204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.576 [2024-04-27 03:32:19.300222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.576 [2024-04-27 03:32:19.307356] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.576 [2024-04-27 03:32:19.307384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.576 [2024-04-27 03:32:19.307414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.576 [2024-04-27 03:32:19.314556] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.576 [2024-04-27 03:32:19.314597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.576 [2024-04-27 03:32:19.314612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.576 [2024-04-27 03:32:19.321419] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.576 [2024-04-27 03:32:19.321446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.576 [2024-04-27 03:32:19.321476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.576 [2024-04-27 03:32:19.328601] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.576 [2024-04-27 03:32:19.328633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.576 [2024-04-27 03:32:19.328651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.576 [2024-04-27 03:32:19.335737] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.576 [2024-04-27 03:32:19.335769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.576 [2024-04-27 03:32:19.335793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.576 [2024-04-27 03:32:19.342935] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.576 [2024-04-27 03:32:19.342967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.576 [2024-04-27 03:32:19.342985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.576 [2024-04-27 03:32:19.350004] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.576 [2024-04-27 03:32:19.350037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.576 [2024-04-27 03:32:19.350056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.576 [2024-04-27 03:32:19.357101] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.576 [2024-04-27 03:32:19.357133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.576 [2024-04-27 03:32:19.357151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.576 [2024-04-27 03:32:19.364321] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.576 [2024-04-27 03:32:19.364362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.576 [2024-04-27 03:32:19.364378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.371606] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.371638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.371655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.378660] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.378692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.378710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.385951] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.385982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.386000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.393100] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.393130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.393149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.400349] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.400381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.400413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.407718] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.407749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.407767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.414892] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.414924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.414942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.421984] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.422015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.422033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.429065] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.429097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.429114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.436095] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.436126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.436144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.443240] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.443294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.443309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.450370] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.450397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.450413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.457572] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.457604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.457622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.464773] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.464804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.464822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.471953] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.471985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.472003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.479005] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.479037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.479055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.486108] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.486140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.486158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.493138] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.493169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.493188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.500211] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.500243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.500270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.507444] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.507470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.507501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.514503] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.514530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.514544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.521618] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.521649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.521673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.528775] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.528815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.528838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.535990] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.536025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.577 [2024-04-27 03:32:19.536044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.577 [2024-04-27 03:32:19.543411] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.577 [2024-04-27 03:32:19.543442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.578 [2024-04-27 03:32:19.543459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.578 [2024-04-27 03:32:19.550642] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.578 [2024-04-27 03:32:19.550676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.578 [2024-04-27 03:32:19.550694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.835 [2024-04-27 03:32:19.558194] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.835 [2024-04-27 03:32:19.558229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.835 [2024-04-27 03:32:19.558256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.835 [2024-04-27 03:32:19.565322] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.835 [2024-04-27 03:32:19.565351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.835 [2024-04-27 03:32:19.565382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.835 [2024-04-27 03:32:19.572410] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.835 [2024-04-27 03:32:19.572439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.835 [2024-04-27 03:32:19.572471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.835 [2024-04-27 03:32:19.579686] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.835 [2024-04-27 03:32:19.579719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.835 [2024-04-27 03:32:19.579737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.835 [2024-04-27 03:32:19.586725] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.835 [2024-04-27 03:32:19.586765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.835 [2024-04-27 03:32:19.586784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:54.835 [2024-04-27 03:32:19.593864] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.835 [2024-04-27 03:32:19.593896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.835 [2024-04-27 03:32:19.593914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:54.835 [2024-04-27 03:32:19.600864] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.835 [2024-04-27 03:32:19.600896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.835 [2024-04-27 03:32:19.600914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:54.835 [2024-04-27 03:32:19.607839] nvme_tcp.c:1447:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x14587e0) 00:20:54.835 [2024-04-27 03:32:19.607871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:20:54.835 [2024-04-27 03:32:19.607888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:54.835 00:20:54.835 Latency(us) 00:20:54.835 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:54.835 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:20:54.835 nvme0n1 : 2.00 4288.47 536.06 0.00 0.00 3725.85 1547.38 9757.58 00:20:54.835 =================================================================================================================== 00:20:54.835 Total : 4288.47 536.06 0.00 0.00 3725.85 1547.38 9757.58 00:20:54.835 0 00:20:54.835 03:32:19 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:20:54.836 03:32:19 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:20:54.836 03:32:19 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:20:54.836 | .driver_specific 00:20:54.836 | .nvme_error 00:20:54.836 | .status_code 00:20:54.836 | .command_transient_transport_error' 00:20:54.836 03:32:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:20:55.095 03:32:19 -- host/digest.sh@71 -- # (( 277 > 0 )) 00:20:55.095 03:32:19 -- host/digest.sh@73 -- # killprocess 1523795 00:20:55.095 03:32:19 -- common/autotest_common.sh@936 -- # '[' -z 1523795 ']' 00:20:55.095 03:32:19 -- common/autotest_common.sh@940 -- # kill -0 1523795 00:20:55.095 03:32:19 -- common/autotest_common.sh@941 -- # uname 00:20:55.095 03:32:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:55.095 03:32:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1523795 00:20:55.095 03:32:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:55.095 03:32:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:55.095 03:32:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1523795' 00:20:55.095 killing process with pid 1523795 00:20:55.095 03:32:19 -- common/autotest_common.sh@955 -- # kill 1523795 00:20:55.095 Received shutdown signal, test time was about 2.000000 seconds 00:20:55.095 00:20:55.095 Latency(us) 00:20:55.095 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:55.095 =================================================================================================================== 00:20:55.095 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:55.095 03:32:19 -- common/autotest_common.sh@960 -- # wait 1523795 00:20:55.353 03:32:20 -- host/digest.sh@114 -- # run_bperf_err randwrite 4096 128 00:20:55.353 03:32:20 -- host/digest.sh@54 -- # local rw bs qd 00:20:55.353 03:32:20 -- host/digest.sh@56 -- # rw=randwrite 00:20:55.353 03:32:20 -- host/digest.sh@56 -- # bs=4096 00:20:55.353 03:32:20 -- host/digest.sh@56 -- # qd=128 00:20:55.353 03:32:20 -- host/digest.sh@58 -- # bperfpid=1524210 00:20:55.353 03:32:20 -- host/digest.sh@60 -- # waitforlisten 1524210 /var/tmp/bperf.sock 00:20:55.353 03:32:20 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:20:55.353 03:32:20 -- common/autotest_common.sh@817 -- # '[' -z 1524210 ']' 00:20:55.353 03:32:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:20:55.353 03:32:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:55.353 03:32:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:20:55.353 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:20:55.353 03:32:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:55.353 03:32:20 -- common/autotest_common.sh@10 -- # set +x 00:20:55.353 [2024-04-27 03:32:20.213871] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:20:55.353 [2024-04-27 03:32:20.213945] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1524210 ] 00:20:55.353 EAL: No free 2048 kB hugepages reported on node 1 00:20:55.353 [2024-04-27 03:32:20.272345] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:55.612 [2024-04-27 03:32:20.378556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:55.612 03:32:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:55.612 03:32:20 -- common/autotest_common.sh@850 -- # return 0 00:20:55.612 03:32:20 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:20:55.612 03:32:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:20:55.870 03:32:20 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:20:55.870 03:32:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:55.870 03:32:20 -- common/autotest_common.sh@10 -- # set +x 00:20:55.870 03:32:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:55.870 03:32:20 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:55.870 03:32:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:56.436 nvme0n1 00:20:56.436 03:32:21 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:20:56.436 03:32:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:56.436 03:32:21 -- common/autotest_common.sh@10 -- # set +x 00:20:56.436 03:32:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:56.436 03:32:21 -- host/digest.sh@69 -- # bperf_py perform_tests 00:20:56.436 03:32:21 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:20:56.436 Running I/O for 2 seconds... 00:20:56.436 [2024-04-27 03:32:21.309589] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ddc00 00:20:56.436 [2024-04-27 03:32:21.311460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24689 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.436 [2024-04-27 03:32:21.311516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:20:56.436 [2024-04-27 03:32:21.323013] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fe720 00:20:56.436 [2024-04-27 03:32:21.324520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:5088 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.436 [2024-04-27 03:32:21.324550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:20:56.436 [2024-04-27 03:32:21.337589] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ee5c8 00:20:56.436 [2024-04-27 03:32:21.339062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:2870 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.436 [2024-04-27 03:32:21.339095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:20:56.436 [2024-04-27 03:32:21.352327] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190edd58 00:20:56.436 [2024-04-27 03:32:21.353784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:5471 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.436 [2024-04-27 03:32:21.353817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:20:56.436 [2024-04-27 03:32:21.366928] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ed4e8 00:20:56.436 [2024-04-27 03:32:21.368402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.436 [2024-04-27 03:32:21.368446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:20:56.436 [2024-04-27 03:32:21.382931] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f0ff8 00:20:56.436 [2024-04-27 03:32:21.384394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:19542 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.436 [2024-04-27 03:32:21.384422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:20:56.436 [2024-04-27 03:32:21.398910] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ecc78 00:20:56.436 [2024-04-27 03:32:21.401029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:20954 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.436 [2024-04-27 03:32:21.401061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.413975] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ec408 00:20:56.696 [2024-04-27 03:32:21.416224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:2036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.416265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.427090] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ebb98 00:20:56.696 [2024-04-27 03:32:21.428479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:7203 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.428507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.443072] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f2948 00:20:56.696 [2024-04-27 03:32:21.445125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:7638 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.445157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.456106] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f31b8 00:20:56.696 [2024-04-27 03:32:21.457504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:14243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.457546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.469213] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f3a28 00:20:56.696 [2024-04-27 03:32:21.470512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:23611 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.470539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0030 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.486563] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ea248 00:20:56.696 [2024-04-27 03:32:21.488559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:22534 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.488601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.498000] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e3d08 00:20:56.696 [2024-04-27 03:32:21.499278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:9004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.499319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.512456] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f4b08 00:20:56.696 [2024-04-27 03:32:21.513711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:15107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.513743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.529726] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e4578 00:20:56.696 [2024-04-27 03:32:21.531690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:12469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.531721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.544201] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f96f8 00:20:56.696 [2024-04-27 03:32:21.546140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:1541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.546172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.557042] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e4de8 00:20:56.696 [2024-04-27 03:32:21.558264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:17423 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.558309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.570224] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e5658 00:20:56.696 [2024-04-27 03:32:21.571479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:9953 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.571513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.584713] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f6458 00:20:56.696 [2024-04-27 03:32:21.585901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:10196 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.585935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.602035] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e7818 00:20:56.696 [2024-04-27 03:32:21.603936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:19328 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.603969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.613440] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e6738 00:20:56.696 [2024-04-27 03:32:21.614582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:1835 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.614622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.629158] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f7538 00:20:56.696 [2024-04-27 03:32:21.630319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:12435 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.630364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.645061] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e6738 00:20:56.696 [2024-04-27 03:32:21.646894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:14842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.646926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.656523] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e7818 00:20:56.696 [2024-04-27 03:32:21.657641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:18243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.657672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:001f p:0 m:0 dnr:0 00:20:56.696 [2024-04-27 03:32:21.671042] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e8088 00:20:56.696 [2024-04-27 03:32:21.672195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:11287 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.696 [2024-04-27 03:32:21.672227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:001d p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.685491] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e88f8 00:20:56.956 [2024-04-27 03:32:21.686554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:12766 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.686599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:001b p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.701227] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f5378 00:20:56.956 [2024-04-27 03:32:21.702312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:12151 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.702340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.714272] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f4b08 00:20:56.956 [2024-04-27 03:32:21.715316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:24459 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.715342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.731458] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e99d8 00:20:56.956 [2024-04-27 03:32:21.733188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:22878 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.733219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.742903] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e3498 00:20:56.956 [2024-04-27 03:32:21.743888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:20215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.743918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.758589] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fb048 00:20:56.956 [2024-04-27 03:32:21.759563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2701 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.759604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.771582] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fb8b8 00:20:56.956 [2024-04-27 03:32:21.772529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10247 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.772570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.787444] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e23b8 00:20:56.956 [2024-04-27 03:32:21.788451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:2680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.788492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.800347] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190df988 00:20:56.956 [2024-04-27 03:32:21.801310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24709 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.801335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0010 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.817418] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fd640 00:20:56.956 [2024-04-27 03:32:21.819075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:9583 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.819106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.828980] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f2d80 00:20:56.956 [2024-04-27 03:32:21.829908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:11219 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.829939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.846333] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ea248 00:20:56.956 [2024-04-27 03:32:21.848010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:1489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.848044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.858002] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fe720 00:20:56.956 [2024-04-27 03:32:21.858878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:16795 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.858909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:000a p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.875241] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ee5c8 00:20:56.956 [2024-04-27 03:32:21.877062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:22589 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.877093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.887127] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f1430 00:20:56.956 [2024-04-27 03:32:21.887981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:10109 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.888012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0007 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.904434] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ebb98 00:20:56.956 [2024-04-27 03:32:21.905986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:3777 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.906018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:20:56.956 [2024-04-27 03:32:21.915963] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ef6a8 00:20:56.956 [2024-04-27 03:32:21.916767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:5569 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:56.956 [2024-04-27 03:32:21.916798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:21.933306] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190de8a8 00:20:57.215 [2024-04-27 03:32:21.934813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:7945 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:21.934845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:21.950150] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190de8a8 00:20:57.215 [2024-04-27 03:32:21.952292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:6916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:21.952329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:21.964525] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ed4e8 00:20:57.215 [2024-04-27 03:32:21.966767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:24465 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:21.966798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:21.975996] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f1430 00:20:57.215 [2024-04-27 03:32:21.977477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:3819 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:21.977509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:21.991854] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fef90 00:20:57.215 [2024-04-27 03:32:21.993424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:12244 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:21.993467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.007826] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ee5c8 00:20:57.215 [2024-04-27 03:32:22.009936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:25555 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.009967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.020755] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190eee38 00:20:57.215 [2024-04-27 03:32:22.022156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:16251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.022186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.033700] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fdeb0 00:20:57.215 [2024-04-27 03:32:22.035060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:13183 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.035090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0037 p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.050853] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190df118 00:20:57.215 [2024-04-27 03:32:22.052927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:2192 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.052959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.062312] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e9168 00:20:57.215 [2024-04-27 03:32:22.063623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:8906 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.063654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0034 p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.079418] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fcdd0 00:20:57.215 [2024-04-27 03:32:22.081539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:22697 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.081567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.092371] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fc560 00:20:57.215 [2024-04-27 03:32:22.093692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:17492 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.093723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.106781] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e0a68 00:20:57.215 [2024-04-27 03:32:22.108063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:17695 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.108094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.122834] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fbcf0 00:20:57.215 [2024-04-27 03:32:22.124852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:5684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.124883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.134394] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f57b0 00:20:57.215 [2024-04-27 03:32:22.135685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:11829 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.135716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.149118] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f6020 00:20:57.215 [2024-04-27 03:32:22.150414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:23212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.215 [2024-04-27 03:32:22.150455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:002b p:0 m:0 dnr:0 00:20:57.215 [2024-04-27 03:32:22.164999] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e6738 00:20:57.216 [2024-04-27 03:32:22.166228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:10576 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.216 [2024-04-27 03:32:22.166272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:20:57.216 [2024-04-27 03:32:22.178176] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e5ec8 00:20:57.216 [2024-04-27 03:32:22.179401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:2000 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.216 [2024-04-27 03:32:22.179442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.192874] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f7100 00:20:57.474 [2024-04-27 03:32:22.194080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21030 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.194111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.207449] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f7970 00:20:57.474 [2024-04-27 03:32:22.208641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:23103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.208672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.222347] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f81e0 00:20:57.474 [2024-04-27 03:32:22.223524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:16104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.223567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.236826] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f8a50 00:20:57.474 [2024-04-27 03:32:22.237939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:1740 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.237969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.251255] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e3d08 00:20:57.474 [2024-04-27 03:32:22.252375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:11128 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.252401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0020 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.268558] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f7970 00:20:57.474 [2024-04-27 03:32:22.270402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:5938 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.270444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.281457] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e3498 00:20:57.474 [2024-04-27 03:32:22.282574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:14230 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.282617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.294618] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e2c28 00:20:57.474 [2024-04-27 03:32:22.295688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:6596 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.295718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:001c p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.310257] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fa3a0 00:20:57.474 [2024-04-27 03:32:22.311329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:4115 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.311371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.324879] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e23b8 00:20:57.474 [2024-04-27 03:32:22.325917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:12315 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.325953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.341039] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fac10 00:20:57.474 [2024-04-27 03:32:22.342843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:11005 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.342874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.352508] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f57b0 00:20:57.474 [2024-04-27 03:32:22.353534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:6342 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.353579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0017 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.367047] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e7818 00:20:57.474 [2024-04-27 03:32:22.368057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:22225 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.368088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.384443] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f4f40 00:20:57.474 [2024-04-27 03:32:22.386164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:23550 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.474 [2024-04-27 03:32:22.386195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:20:57.474 [2024-04-27 03:32:22.398880] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f46d0 00:20:57.475 [2024-04-27 03:32:22.400547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:6318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.475 [2024-04-27 03:32:22.400590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:20:57.475 [2024-04-27 03:32:22.413296] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e01f8 00:20:57.475 [2024-04-27 03:32:22.414938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:6993 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.475 [2024-04-27 03:32:22.414969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:20:57.475 [2024-04-27 03:32:22.426149] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f3e60 00:20:57.475 [2024-04-27 03:32:22.427096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:8573 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.475 [2024-04-27 03:32:22.427127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:20:57.475 [2024-04-27 03:32:22.440627] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e9168 00:20:57.475 [2024-04-27 03:32:22.441556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:11347 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.475 [2024-04-27 03:32:22.441599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.453939] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e99d8 00:20:57.735 [2024-04-27 03:32:22.454912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:1578 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.454944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.468458] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f2d80 00:20:57.735 [2024-04-27 03:32:22.469392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:20049 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.469433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.485935] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f2d80 00:20:57.735 [2024-04-27 03:32:22.487540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:4814 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.487584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.500374] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ddc00 00:20:57.735 [2024-04-27 03:32:22.501962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:25341 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.501992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.514753] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f2510 00:20:57.735 [2024-04-27 03:32:22.516378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:10467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.516404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.526202] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ee5c8 00:20:57.735 [2024-04-27 03:32:22.527051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:17954 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.527081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.543429] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190eb328 00:20:57.735 [2024-04-27 03:32:22.544990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:6255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.545021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.557947] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ebb98 00:20:57.735 [2024-04-27 03:32:22.559486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:3155 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.559529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.570801] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ec408 00:20:57.735 [2024-04-27 03:32:22.571591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:23609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.571622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.583874] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190de8a8 00:20:57.735 [2024-04-27 03:32:22.584698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:3221 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.584729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0003 p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.601276] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190de8a8 00:20:57.735 [2024-04-27 03:32:22.602797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:7417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.602827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.618537] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ec408 00:20:57.735 [2024-04-27 03:32:22.620761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:11545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.620791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.633065] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f0bc0 00:20:57.735 [2024-04-27 03:32:22.635242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20353 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.635298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.647485] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f1430 00:20:57.735 [2024-04-27 03:32:22.649640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:4837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.649671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.658959] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ee5c8 00:20:57.735 [2024-04-27 03:32:22.660413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:10742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.660454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.674823] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fe720 00:20:57.735 [2024-04-27 03:32:22.676252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:17542 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.676298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.689380] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190eee38 00:20:57.735 [2024-04-27 03:32:22.690765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:20473 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.690796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:20:57.735 [2024-04-27 03:32:22.705241] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ea248 00:20:57.735 [2024-04-27 03:32:22.707414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:10177 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.735 [2024-04-27 03:32:22.707459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.716970] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190df118 00:20:57.994 [2024-04-27 03:32:22.718351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:5598 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.994 [2024-04-27 03:32:22.718392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0036 p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.734299] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fd640 00:20:57.994 [2024-04-27 03:32:22.736406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:15935 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.994 [2024-04-27 03:32:22.736433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.748639] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fcdd0 00:20:57.994 [2024-04-27 03:32:22.750657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:8917 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.994 [2024-04-27 03:32:22.750689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.760117] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f46d0 00:20:57.994 [2024-04-27 03:32:22.761436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:4420 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.994 [2024-04-27 03:32:22.761477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0031 p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.777341] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e0a68 00:20:57.994 [2024-04-27 03:32:22.779370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:13852 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.994 [2024-04-27 03:32:22.779397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.788885] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e7818 00:20:57.994 [2024-04-27 03:32:22.790172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:2138 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.994 [2024-04-27 03:32:22.790202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.803293] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e6fa8 00:20:57.994 [2024-04-27 03:32:22.804541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:22325 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.994 [2024-04-27 03:32:22.804567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.820475] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f6020 00:20:57.994 [2024-04-27 03:32:22.822448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:15103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.994 [2024-04-27 03:32:22.822490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.831910] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fa3a0 00:20:57.994 [2024-04-27 03:32:22.833148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:9482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.994 [2024-04-27 03:32:22.833179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0029 p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.847711] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e2c28 00:20:57.994 [2024-04-27 03:32:22.848923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:5468 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.994 [2024-04-27 03:32:22.848955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:20:57.994 [2024-04-27 03:32:22.863594] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f7100 00:20:57.994 [2024-04-27 03:32:22.865524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:21546 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.995 [2024-04-27 03:32:22.865552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:20:57.995 [2024-04-27 03:32:22.875201] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f92c0 00:20:57.995 [2024-04-27 03:32:22.876410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:8173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.995 [2024-04-27 03:32:22.876453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:57.995 [2024-04-27 03:32:22.892591] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e3d08 00:20:57.995 [2024-04-27 03:32:22.894480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:16368 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.995 [2024-04-27 03:32:22.894522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:20:57.995 [2024-04-27 03:32:22.904179] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e4578 00:20:57.995 [2024-04-27 03:32:22.905328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:13881 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.995 [2024-04-27 03:32:22.905369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:57.995 [2024-04-27 03:32:22.920095] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f8a50 00:20:57.995 [2024-04-27 03:32:22.921229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:24247 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.995 [2024-04-27 03:32:22.921272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:20:57.995 [2024-04-27 03:32:22.935892] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e4de8 00:20:57.995 [2024-04-27 03:32:22.937725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:11388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.995 [2024-04-27 03:32:22.937755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:20:57.995 [2024-04-27 03:32:22.947326] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e3498 00:20:57.995 [2024-04-27 03:32:22.948432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3335 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.995 [2024-04-27 03:32:22.948481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:001e p:0 m:0 dnr:0 00:20:57.995 [2024-04-27 03:32:22.964699] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f9b30 00:20:57.995 [2024-04-27 03:32:22.966515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:5209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:57.995 [2024-04-27 03:32:22.966557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:22.979478] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fa3a0 00:20:58.255 [2024-04-27 03:32:22.981310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:22476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:22.981353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:22.991073] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f6020 00:20:58.255 [2024-04-27 03:32:22.992119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:1162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:22.992150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0019 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.008825] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e6fa8 00:20:58.255 [2024-04-27 03:32:23.010544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:15739 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.010596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.020369] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e12d8 00:20:58.255 [2024-04-27 03:32:23.021389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:8081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.021431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.037654] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fbcf0 00:20:58.255 [2024-04-27 03:32:23.039369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:25165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.039395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.049170] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f46d0 00:20:58.255 [2024-04-27 03:32:23.050136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:4453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.050167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0013 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.064881] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e88f8 00:20:58.255 [2024-04-27 03:32:23.065829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:5988 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.065860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.080584] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fcdd0 00:20:58.255 [2024-04-27 03:32:23.082224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:14373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.082263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.093484] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fd640 00:20:58.255 [2024-04-27 03:32:23.094439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:2312 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.094481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.109447] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190e99d8 00:20:58.255 [2024-04-27 03:32:23.111078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:13256 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.111109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.121038] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ddc00 00:20:58.255 [2024-04-27 03:32:23.121954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:20428 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.121984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.138429] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190eee38 00:20:58.255 [2024-04-27 03:32:23.140062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:24780 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.140093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.149940] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f1ca0 00:20:58.255 [2024-04-27 03:32:23.150798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:24769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.150830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.164376] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f1430 00:20:58.255 [2024-04-27 03:32:23.165209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21988 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.165239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0007 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.181339] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ebb98 00:20:58.255 [2024-04-27 03:32:23.182842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:2219 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.182873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.194192] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ec408 00:20:58.255 [2024-04-27 03:32:23.194979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:22700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.195010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.209914] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ecc78 00:20:58.255 [2024-04-27 03:32:23.211438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:1578 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.211484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:20:58.255 [2024-04-27 03:32:23.227232] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ecc78 00:20:58.255 [2024-04-27 03:32:23.229489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:13652 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.255 [2024-04-27 03:32:23.229530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:20:58.518 [2024-04-27 03:32:23.238925] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190f0bc0 00:20:58.518 [2024-04-27 03:32:23.240415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:14060 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.518 [2024-04-27 03:32:23.240457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:20:58.518 [2024-04-27 03:32:23.256167] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190fe2e8 00:20:58.518 [2024-04-27 03:32:23.258364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:11607 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.518 [2024-04-27 03:32:23.258392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:20:58.518 [2024-04-27 03:32:23.267693] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190eb328 00:20:58.518 [2024-04-27 03:32:23.269132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:22498 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.518 [2024-04-27 03:32:23.269163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:20:58.518 [2024-04-27 03:32:23.284965] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190ee5c8 00:20:58.518 [2024-04-27 03:32:23.287157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7462 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.518 [2024-04-27 03:32:23.287188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:20:58.518 [2024-04-27 03:32:23.299698] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18648f0) with pdu=0x2000190eee38 00:20:58.518 [2024-04-27 03:32:23.301847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:16489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:58.518 [2024-04-27 03:32:23.301878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:20:58.518 00:20:58.518 Latency(us) 00:20:58.518 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:58.518 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:20:58.518 nvme0n1 : 2.01 17580.72 68.67 0.00 0.00 7271.96 2900.57 17670.45 00:20:58.518 =================================================================================================================== 00:20:58.518 Total : 17580.72 68.67 0.00 0.00 7271.96 2900.57 17670.45 00:20:58.518 0 00:20:58.518 03:32:23 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:20:58.518 03:32:23 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:20:58.518 03:32:23 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:20:58.518 | .driver_specific 00:20:58.518 | .nvme_error 00:20:58.518 | .status_code 00:20:58.518 | .command_transient_transport_error' 00:20:58.518 03:32:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:20:58.790 03:32:23 -- host/digest.sh@71 -- # (( 138 > 0 )) 00:20:58.790 03:32:23 -- host/digest.sh@73 -- # killprocess 1524210 00:20:58.790 03:32:23 -- common/autotest_common.sh@936 -- # '[' -z 1524210 ']' 00:20:58.790 03:32:23 -- common/autotest_common.sh@940 -- # kill -0 1524210 00:20:58.790 03:32:23 -- common/autotest_common.sh@941 -- # uname 00:20:58.790 03:32:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:58.790 03:32:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1524210 00:20:58.790 03:32:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:58.790 03:32:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:58.790 03:32:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1524210' 00:20:58.790 killing process with pid 1524210 00:20:58.791 03:32:23 -- common/autotest_common.sh@955 -- # kill 1524210 00:20:58.791 Received shutdown signal, test time was about 2.000000 seconds 00:20:58.791 00:20:58.791 Latency(us) 00:20:58.791 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:58.791 =================================================================================================================== 00:20:58.791 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:58.791 03:32:23 -- common/autotest_common.sh@960 -- # wait 1524210 00:20:59.048 03:32:23 -- host/digest.sh@115 -- # run_bperf_err randwrite 131072 16 00:20:59.048 03:32:23 -- host/digest.sh@54 -- # local rw bs qd 00:20:59.048 03:32:23 -- host/digest.sh@56 -- # rw=randwrite 00:20:59.048 03:32:23 -- host/digest.sh@56 -- # bs=131072 00:20:59.048 03:32:23 -- host/digest.sh@56 -- # qd=16 00:20:59.048 03:32:23 -- host/digest.sh@58 -- # bperfpid=1524623 00:20:59.048 03:32:23 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:20:59.048 03:32:23 -- host/digest.sh@60 -- # waitforlisten 1524623 /var/tmp/bperf.sock 00:20:59.048 03:32:23 -- common/autotest_common.sh@817 -- # '[' -z 1524623 ']' 00:20:59.048 03:32:23 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:20:59.048 03:32:23 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:59.048 03:32:23 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:20:59.048 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:20:59.048 03:32:23 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:59.048 03:32:23 -- common/autotest_common.sh@10 -- # set +x 00:20:59.048 [2024-04-27 03:32:23.908709] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:20:59.048 [2024-04-27 03:32:23.908782] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1524623 ] 00:20:59.048 I/O size of 131072 is greater than zero copy threshold (65536). 00:20:59.048 Zero copy mechanism will not be used. 00:20:59.048 EAL: No free 2048 kB hugepages reported on node 1 00:20:59.049 [2024-04-27 03:32:23.966383] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:59.307 [2024-04-27 03:32:24.071760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:59.307 03:32:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:59.307 03:32:24 -- common/autotest_common.sh@850 -- # return 0 00:20:59.307 03:32:24 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:20:59.307 03:32:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:20:59.566 03:32:24 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:20:59.566 03:32:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:59.566 03:32:24 -- common/autotest_common.sh@10 -- # set +x 00:20:59.566 03:32:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:59.566 03:32:24 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:20:59.566 03:32:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:21:00.137 nvme0n1 00:21:00.137 03:32:24 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:21:00.137 03:32:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:00.137 03:32:24 -- common/autotest_common.sh@10 -- # set +x 00:21:00.137 03:32:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:00.137 03:32:24 -- host/digest.sh@69 -- # bperf_py perform_tests 00:21:00.137 03:32:24 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:21:00.137 I/O size of 131072 is greater than zero copy threshold (65536). 00:21:00.137 Zero copy mechanism will not be used. 00:21:00.137 Running I/O for 2 seconds... 00:21:00.137 [2024-04-27 03:32:25.038629] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.137 [2024-04-27 03:32:25.039008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.137 [2024-04-27 03:32:25.039063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.137 [2024-04-27 03:32:25.047101] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.137 [2024-04-27 03:32:25.047443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.137 [2024-04-27 03:32:25.047488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.137 [2024-04-27 03:32:25.055825] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.137 [2024-04-27 03:32:25.056188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.137 [2024-04-27 03:32:25.056234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.137 [2024-04-27 03:32:25.065445] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.137 [2024-04-27 03:32:25.065795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.137 [2024-04-27 03:32:25.065839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.137 [2024-04-27 03:32:25.073813] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.137 [2024-04-27 03:32:25.074166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.137 [2024-04-27 03:32:25.074198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.137 [2024-04-27 03:32:25.082972] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.137 [2024-04-27 03:32:25.083333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.137 [2024-04-27 03:32:25.083363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.137 [2024-04-27 03:32:25.092129] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.137 [2024-04-27 03:32:25.092495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.137 [2024-04-27 03:32:25.092526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.137 [2024-04-27 03:32:25.101141] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.137 [2024-04-27 03:32:25.101503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.137 [2024-04-27 03:32:25.101535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.137 [2024-04-27 03:32:25.111034] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.137 [2024-04-27 03:32:25.111412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.137 [2024-04-27 03:32:25.111459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.120451] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.120818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.120849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.129262] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.129621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.129651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.139312] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.139697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.139727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.149595] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.149949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.149978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.160120] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.160478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.160509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.169927] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.170055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.170085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.180182] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.180536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.180585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.190133] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.190469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.190513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.200149] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.200484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.200529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.210283] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.210616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.210658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.220390] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.220749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.220778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.230460] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.230822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.230852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.240239] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.240630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.240658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.249931] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.250307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.250352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.259513] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.259866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.259896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.269575] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.269920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.269949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.279662] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.280017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.280048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.289564] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.289725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.289755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.299529] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.299973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.300015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.308064] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.308507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.308558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.317464] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.317897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.317941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.327034] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.327590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.327632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.336595] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.336861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.336900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.346119] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.346567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.346618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.355643] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.356021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.356065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.397 [2024-04-27 03:32:25.364203] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.397 [2024-04-27 03:32:25.364719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.397 [2024-04-27 03:32:25.364747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.656 [2024-04-27 03:32:25.374089] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.656 [2024-04-27 03:32:25.374536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.656 [2024-04-27 03:32:25.374582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.656 [2024-04-27 03:32:25.383648] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.656 [2024-04-27 03:32:25.384061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.656 [2024-04-27 03:32:25.384090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.393093] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.393509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.393539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.402387] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.402753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.402783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.411918] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.412195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.412239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.421225] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.421657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.421700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.430789] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.431089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.431119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.438850] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.439232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.439310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.448466] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.448759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.448797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.457391] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.457724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.457763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.465164] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.465537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.465583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.474574] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.474944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.474990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.482908] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.483266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.483297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.491397] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.491716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.491747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.499856] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.500194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.500226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.507891] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.508176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.508207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.516945] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.517259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.517291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.526218] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.526600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.526635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.534737] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.535049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.535080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.543533] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.543814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.543851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.552706] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.553023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.553058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.561481] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.561812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.561851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.570868] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.571216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.571254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.580018] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.580387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.580426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.589324] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.589683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.589728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.597747] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.598041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.598073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.606809] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.607140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.607176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.615730] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.616167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.616197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.624611] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.657 [2024-04-27 03:32:25.624945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.657 [2024-04-27 03:32:25.624990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.657 [2024-04-27 03:32:25.633303] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.918 [2024-04-27 03:32:25.633728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.918 [2024-04-27 03:32:25.633760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.918 [2024-04-27 03:32:25.641416] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.918 [2024-04-27 03:32:25.641749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.918 [2024-04-27 03:32:25.641795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.918 [2024-04-27 03:32:25.649930] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.918 [2024-04-27 03:32:25.650298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.918 [2024-04-27 03:32:25.650344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.918 [2024-04-27 03:32:25.658279] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.918 [2024-04-27 03:32:25.658603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.918 [2024-04-27 03:32:25.658640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.918 [2024-04-27 03:32:25.667022] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.918 [2024-04-27 03:32:25.667376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.918 [2024-04-27 03:32:25.667407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.918 [2024-04-27 03:32:25.674592] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.918 [2024-04-27 03:32:25.674872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.918 [2024-04-27 03:32:25.674909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.682321] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.682654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.682684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.690861] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.691170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.691201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.698923] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.699262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.699305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.707728] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.708064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.708095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.716623] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.716972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.717006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.725007] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.725233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.725279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.732759] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.732921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.732959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.741147] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.741345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.741384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.749011] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.749138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.749175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.756792] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.756962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.757000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.764690] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.764833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.764872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.771942] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.772088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.772126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.779456] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.779667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.779705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.787143] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.787307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.787345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.795326] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.795533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.795579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.802849] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.803046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.803083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.810585] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.810784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.810822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.818134] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.818365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.818403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.826282] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.826522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.826560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.833773] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.833947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.833985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.841325] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.841549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.841588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.848233] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.848434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.848472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.856365] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.856549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.856587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.864463] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.864666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.864703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.872077] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.872285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.872323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.879512] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.879840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.879878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:00.919 [2024-04-27 03:32:25.887902] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:00.919 [2024-04-27 03:32:25.888046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:00.919 [2024-04-27 03:32:25.888084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.895344] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.895528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.895566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.903262] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.903486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.903524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.911122] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.911332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.911370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.919540] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.919784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.919823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.927112] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.927373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.927424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.935512] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.935712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.935750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.942772] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.942939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.942976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.950995] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.951243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.951288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.959071] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.959198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.959236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.966888] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.967135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.967173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.975102] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.975392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.975430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.983237] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.983450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.983488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:25.991747] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:25.992008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:25.992045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:26.000199] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:26.000447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:26.000485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:26.008726] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:26.008909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:26.008947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:26.016926] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:26.017201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:26.017239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:26.025449] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:26.025710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:26.025748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:26.033609] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:26.033810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:26.033849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:26.041699] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:26.041826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:26.041863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:26.049088] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:26.049282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:26.049321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.181 [2024-04-27 03:32:26.057241] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.181 [2024-04-27 03:32:26.057443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.181 [2024-04-27 03:32:26.057481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.064482] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.064644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.064681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.073115] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.073322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.073361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.080464] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.080727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.080765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.088866] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.089085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.089123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.096955] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.097182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.097219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.104839] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.105082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.105120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.112220] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.112367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.112406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.118693] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.118877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.118915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.125783] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.126016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.126054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.133903] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.134116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.134163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.141903] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.142080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.142119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.182 [2024-04-27 03:32:26.149754] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.182 [2024-04-27 03:32:26.150016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.182 [2024-04-27 03:32:26.150054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.158034] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.158213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.158257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.165497] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.165703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.165741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.173108] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.173378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.173416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.181546] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.181788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.181826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.189738] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.189914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.189952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.197258] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.197425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.197463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.204608] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.204846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.204884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.211785] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.211913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.211952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.219224] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.219534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.219572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.227103] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.227363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.227401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.234510] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.234722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.234760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.243004] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.243236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.243282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.251042] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.251255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.251294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.258646] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.258879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.258917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.265979] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.442 [2024-04-27 03:32:26.266187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.442 [2024-04-27 03:32:26.266224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.442 [2024-04-27 03:32:26.273386] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.273583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.273621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.280382] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.280524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.280562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.287959] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.288196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.288234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.295507] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.295711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.295749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.303309] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.303558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.303596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.311024] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.311272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.311313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.318865] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.319074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.319112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.327471] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.327754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.327792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.336520] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.336793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.336839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.345310] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.345552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.345590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.353731] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.353964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.354002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.362708] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.362956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.362994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.371135] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.371342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.371380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.379005] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.379149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.379187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.387046] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.387260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.387298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.395786] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.395998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.396037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.404213] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.404455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.404494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.443 [2024-04-27 03:32:26.412377] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.443 [2024-04-27 03:32:26.412623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.443 [2024-04-27 03:32:26.412661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.421070] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.421317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.421356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.429477] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.429687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.429726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.438330] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.438570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.438620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.446756] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.447001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.447039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.456225] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.456449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.456487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.465297] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.465437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.465468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.473999] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.474300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.474337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.482856] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.483102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.483140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.492074] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.492312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.492351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.501108] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.501319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.501357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.510325] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.510566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.510604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.518797] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.519026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.519064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.527221] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.527443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.527482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.535839] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.536011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.536042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.544569] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.544804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.544842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.552785] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.553055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.553093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.561334] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.561574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.561619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.569839] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.570002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.570035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.578723] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.578926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.578964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.587544] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.587791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.587828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.596143] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.596352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.596391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.605204] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.605420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.605459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.613831] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.614022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.614060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.621910] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.622152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.704 [2024-04-27 03:32:26.622190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.704 [2024-04-27 03:32:26.630843] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.704 [2024-04-27 03:32:26.631024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.705 [2024-04-27 03:32:26.631062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.705 [2024-04-27 03:32:26.639968] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.705 [2024-04-27 03:32:26.640229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.705 [2024-04-27 03:32:26.640275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.705 [2024-04-27 03:32:26.648613] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.705 [2024-04-27 03:32:26.648874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.705 [2024-04-27 03:32:26.648912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.705 [2024-04-27 03:32:26.657607] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.705 [2024-04-27 03:32:26.657819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.705 [2024-04-27 03:32:26.657852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.705 [2024-04-27 03:32:26.666507] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.705 [2024-04-27 03:32:26.666708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.705 [2024-04-27 03:32:26.666745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.705 [2024-04-27 03:32:26.675816] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.705 [2024-04-27 03:32:26.676082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.705 [2024-04-27 03:32:26.676120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.683760] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.683958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.683997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.691612] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.691841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.691878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.699393] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.699569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.699607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.707551] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.707752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.707797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.715059] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.715301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.715339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.722954] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.723162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.723200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.731649] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.731857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.731895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.740629] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.740824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.740856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.749919] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.750132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.750169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.758743] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.758972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.759010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.767841] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.768135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.768177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.776268] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.776461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.776500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.784497] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.784817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.784855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.793059] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.793320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.793359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.801637] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.801855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.801893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.810759] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.966 [2024-04-27 03:32:26.810897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.966 [2024-04-27 03:32:26.810926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.966 [2024-04-27 03:32:26.819476] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.819698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.819735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.828214] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.828379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.828417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.836296] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.836499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.836538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.845263] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.845465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.845504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.854761] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.854972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.855010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.862964] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.863224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.863271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.872203] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.872412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.872450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.881360] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.881522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.881559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.890155] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.890379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.890417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.898234] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.898450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.898487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.907438] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.907666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.907704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.916612] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.916850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.916888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.925500] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.925673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.925703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.934255] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.934438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.934482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:01.967 [2024-04-27 03:32:26.942298] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:01.967 [2024-04-27 03:32:26.942548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:01.967 [2024-04-27 03:32:26.942586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:02.226 [2024-04-27 03:32:26.950707] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.226 [2024-04-27 03:32:26.950889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.226 [2024-04-27 03:32:26.950927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:02.226 [2024-04-27 03:32:26.959775] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.226 [2024-04-27 03:32:26.959998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.226 [2024-04-27 03:32:26.960037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:02.226 [2024-04-27 03:32:26.967891] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.226 [2024-04-27 03:32:26.968137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.226 [2024-04-27 03:32:26.968175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:02.226 [2024-04-27 03:32:26.976857] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.226 [2024-04-27 03:32:26.977069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.226 [2024-04-27 03:32:26.977106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:02.226 [2024-04-27 03:32:26.985594] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.226 [2024-04-27 03:32:26.985825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.226 [2024-04-27 03:32:26.985863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:02.226 [2024-04-27 03:32:26.994266] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.226 [2024-04-27 03:32:26.994501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.226 [2024-04-27 03:32:26.994539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:02.226 [2024-04-27 03:32:27.002656] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.226 [2024-04-27 03:32:27.002823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.226 [2024-04-27 03:32:27.002860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:02.226 [2024-04-27 03:32:27.010976] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.226 [2024-04-27 03:32:27.011132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.226 [2024-04-27 03:32:27.011170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:21:02.226 [2024-04-27 03:32:27.018164] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.227 [2024-04-27 03:32:27.018366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.227 [2024-04-27 03:32:27.018404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:21:02.227 [2024-04-27 03:32:27.026374] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.227 [2024-04-27 03:32:27.026607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.227 [2024-04-27 03:32:27.026645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:21:02.227 [2024-04-27 03:32:27.035067] tcp.c:2047:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1864ca0) with pdu=0x2000190fef90 00:21:02.227 [2024-04-27 03:32:27.035313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:02.227 [2024-04-27 03:32:27.035351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:21:02.227 00:21:02.227 Latency(us) 00:21:02.227 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:02.227 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:21:02.227 nvme0n1 : 2.00 3635.17 454.40 0.00 0.00 4389.57 3046.21 10582.85 00:21:02.227 =================================================================================================================== 00:21:02.227 Total : 3635.17 454.40 0.00 0.00 4389.57 3046.21 10582.85 00:21:02.227 0 00:21:02.227 03:32:27 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:21:02.227 03:32:27 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:21:02.227 03:32:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:21:02.227 03:32:27 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:21:02.227 | .driver_specific 00:21:02.227 | .nvme_error 00:21:02.227 | .status_code 00:21:02.227 | .command_transient_transport_error' 00:21:02.485 03:32:27 -- host/digest.sh@71 -- # (( 235 > 0 )) 00:21:02.485 03:32:27 -- host/digest.sh@73 -- # killprocess 1524623 00:21:02.485 03:32:27 -- common/autotest_common.sh@936 -- # '[' -z 1524623 ']' 00:21:02.485 03:32:27 -- common/autotest_common.sh@940 -- # kill -0 1524623 00:21:02.485 03:32:27 -- common/autotest_common.sh@941 -- # uname 00:21:02.485 03:32:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:02.485 03:32:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1524623 00:21:02.485 03:32:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:02.485 03:32:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:02.485 03:32:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1524623' 00:21:02.485 killing process with pid 1524623 00:21:02.485 03:32:27 -- common/autotest_common.sh@955 -- # kill 1524623 00:21:02.485 Received shutdown signal, test time was about 2.000000 seconds 00:21:02.485 00:21:02.485 Latency(us) 00:21:02.485 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:02.485 =================================================================================================================== 00:21:02.485 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:02.485 03:32:27 -- common/autotest_common.sh@960 -- # wait 1524623 00:21:02.743 03:32:27 -- host/digest.sh@116 -- # killprocess 1523238 00:21:02.743 03:32:27 -- common/autotest_common.sh@936 -- # '[' -z 1523238 ']' 00:21:02.743 03:32:27 -- common/autotest_common.sh@940 -- # kill -0 1523238 00:21:02.743 03:32:27 -- common/autotest_common.sh@941 -- # uname 00:21:02.743 03:32:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:02.743 03:32:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1523238 00:21:02.743 03:32:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:02.743 03:32:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:02.743 03:32:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1523238' 00:21:02.743 killing process with pid 1523238 00:21:02.743 03:32:27 -- common/autotest_common.sh@955 -- # kill 1523238 00:21:02.743 03:32:27 -- common/autotest_common.sh@960 -- # wait 1523238 00:21:03.001 00:21:03.001 real 0m16.100s 00:21:03.001 user 0m31.299s 00:21:03.001 sys 0m4.269s 00:21:03.001 03:32:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:03.001 03:32:27 -- common/autotest_common.sh@10 -- # set +x 00:21:03.001 ************************************ 00:21:03.001 END TEST nvmf_digest_error 00:21:03.001 ************************************ 00:21:03.001 03:32:27 -- host/digest.sh@149 -- # trap - SIGINT SIGTERM EXIT 00:21:03.001 03:32:27 -- host/digest.sh@150 -- # nvmftestfini 00:21:03.001 03:32:27 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:03.001 03:32:27 -- nvmf/common.sh@117 -- # sync 00:21:03.001 03:32:27 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:21:03.001 03:32:27 -- nvmf/common.sh@120 -- # set +e 00:21:03.001 03:32:27 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:03.001 03:32:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:21:03.001 rmmod nvme_tcp 00:21:03.001 rmmod nvme_fabrics 00:21:03.001 rmmod nvme_keyring 00:21:03.001 03:32:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:03.001 03:32:27 -- nvmf/common.sh@124 -- # set -e 00:21:03.001 03:32:27 -- nvmf/common.sh@125 -- # return 0 00:21:03.001 03:32:27 -- nvmf/common.sh@478 -- # '[' -n 1523238 ']' 00:21:03.001 03:32:27 -- nvmf/common.sh@479 -- # killprocess 1523238 00:21:03.001 03:32:27 -- common/autotest_common.sh@936 -- # '[' -z 1523238 ']' 00:21:03.001 03:32:27 -- common/autotest_common.sh@940 -- # kill -0 1523238 00:21:03.001 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1523238) - No such process 00:21:03.001 03:32:27 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1523238 is not found' 00:21:03.001 Process with pid 1523238 is not found 00:21:03.001 03:32:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:03.001 03:32:27 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:21:03.001 03:32:27 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:21:03.001 03:32:27 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:03.001 03:32:27 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:21:03.001 03:32:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:03.001 03:32:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:03.001 03:32:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:05.539 03:32:29 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:21:05.539 00:21:05.539 real 0m36.034s 00:21:05.539 user 1m2.078s 00:21:05.539 sys 0m10.192s 00:21:05.539 03:32:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:05.539 03:32:29 -- common/autotest_common.sh@10 -- # set +x 00:21:05.539 ************************************ 00:21:05.539 END TEST nvmf_digest 00:21:05.539 ************************************ 00:21:05.539 03:32:29 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:21:05.539 03:32:29 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:21:05.539 03:32:29 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:21:05.539 03:32:29 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:21:05.539 03:32:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:05.539 03:32:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:05.539 03:32:29 -- common/autotest_common.sh@10 -- # set +x 00:21:05.539 ************************************ 00:21:05.539 START TEST nvmf_bdevperf 00:21:05.539 ************************************ 00:21:05.539 03:32:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:21:05.539 * Looking for test storage... 00:21:05.539 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:21:05.539 03:32:30 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:05.539 03:32:30 -- nvmf/common.sh@7 -- # uname -s 00:21:05.539 03:32:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:05.539 03:32:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:05.539 03:32:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:05.539 03:32:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:05.539 03:32:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:05.539 03:32:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:05.539 03:32:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:05.539 03:32:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:05.539 03:32:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:05.539 03:32:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:05.539 03:32:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:21:05.539 03:32:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:21:05.539 03:32:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:05.539 03:32:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:05.539 03:32:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:05.539 03:32:30 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:05.539 03:32:30 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:05.539 03:32:30 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:05.539 03:32:30 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:05.539 03:32:30 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:05.539 03:32:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.539 03:32:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.539 03:32:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.539 03:32:30 -- paths/export.sh@5 -- # export PATH 00:21:05.539 03:32:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.539 03:32:30 -- nvmf/common.sh@47 -- # : 0 00:21:05.539 03:32:30 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:05.539 03:32:30 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:05.539 03:32:30 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:05.539 03:32:30 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:05.539 03:32:30 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:05.539 03:32:30 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:05.539 03:32:30 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:05.539 03:32:30 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:05.539 03:32:30 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:05.539 03:32:30 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:05.539 03:32:30 -- host/bdevperf.sh@24 -- # nvmftestinit 00:21:05.539 03:32:30 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:21:05.539 03:32:30 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:05.539 03:32:30 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:05.539 03:32:30 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:05.539 03:32:30 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:05.539 03:32:30 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:05.539 03:32:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:05.540 03:32:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:05.540 03:32:30 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:05.540 03:32:30 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:05.540 03:32:30 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:05.540 03:32:30 -- common/autotest_common.sh@10 -- # set +x 00:21:07.443 03:32:32 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:07.443 03:32:32 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:07.443 03:32:32 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:07.443 03:32:32 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:07.443 03:32:32 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:07.443 03:32:32 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:07.443 03:32:32 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:07.443 03:32:32 -- nvmf/common.sh@295 -- # net_devs=() 00:21:07.443 03:32:32 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:07.443 03:32:32 -- nvmf/common.sh@296 -- # e810=() 00:21:07.443 03:32:32 -- nvmf/common.sh@296 -- # local -ga e810 00:21:07.443 03:32:32 -- nvmf/common.sh@297 -- # x722=() 00:21:07.443 03:32:32 -- nvmf/common.sh@297 -- # local -ga x722 00:21:07.443 03:32:32 -- nvmf/common.sh@298 -- # mlx=() 00:21:07.444 03:32:32 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:07.444 03:32:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:07.444 03:32:32 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:07.444 03:32:32 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:21:07.444 03:32:32 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:07.444 03:32:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:07.444 03:32:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:21:07.444 Found 0000:09:00.0 (0x8086 - 0x159b) 00:21:07.444 03:32:32 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:07.444 03:32:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:21:07.444 Found 0000:09:00.1 (0x8086 - 0x159b) 00:21:07.444 03:32:32 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:07.444 03:32:32 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:07.444 03:32:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:07.444 03:32:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:07.444 03:32:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:07.444 03:32:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:21:07.444 Found net devices under 0000:09:00.0: cvl_0_0 00:21:07.444 03:32:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:07.444 03:32:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:07.444 03:32:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:07.444 03:32:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:07.444 03:32:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:07.444 03:32:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:21:07.444 Found net devices under 0000:09:00.1: cvl_0_1 00:21:07.444 03:32:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:07.444 03:32:32 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:07.444 03:32:32 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:07.444 03:32:32 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:21:07.444 03:32:32 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:07.444 03:32:32 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:07.444 03:32:32 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:07.444 03:32:32 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:21:07.444 03:32:32 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:07.444 03:32:32 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:07.444 03:32:32 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:21:07.444 03:32:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:07.444 03:32:32 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:07.444 03:32:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:21:07.444 03:32:32 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:21:07.444 03:32:32 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:21:07.444 03:32:32 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:07.444 03:32:32 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:07.444 03:32:32 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:07.444 03:32:32 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:21:07.444 03:32:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:07.444 03:32:32 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:07.444 03:32:32 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:07.444 03:32:32 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:21:07.444 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:07.444 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.168 ms 00:21:07.444 00:21:07.444 --- 10.0.0.2 ping statistics --- 00:21:07.444 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:07.444 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:21:07.444 03:32:32 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:07.444 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:07.444 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:21:07.444 00:21:07.444 --- 10.0.0.1 ping statistics --- 00:21:07.444 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:07.444 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:21:07.444 03:32:32 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:07.444 03:32:32 -- nvmf/common.sh@411 -- # return 0 00:21:07.444 03:32:32 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:07.444 03:32:32 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:07.444 03:32:32 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:21:07.444 03:32:32 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:07.444 03:32:32 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:21:07.444 03:32:32 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:21:07.444 03:32:32 -- host/bdevperf.sh@25 -- # tgt_init 00:21:07.444 03:32:32 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:21:07.444 03:32:32 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:07.444 03:32:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:07.444 03:32:32 -- common/autotest_common.sh@10 -- # set +x 00:21:07.444 03:32:32 -- nvmf/common.sh@470 -- # nvmfpid=1527053 00:21:07.444 03:32:32 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:21:07.444 03:32:32 -- nvmf/common.sh@471 -- # waitforlisten 1527053 00:21:07.444 03:32:32 -- common/autotest_common.sh@817 -- # '[' -z 1527053 ']' 00:21:07.444 03:32:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:07.444 03:32:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:07.444 03:32:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:07.444 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:07.444 03:32:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:07.444 03:32:32 -- common/autotest_common.sh@10 -- # set +x 00:21:07.444 [2024-04-27 03:32:32.245534] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:21:07.444 [2024-04-27 03:32:32.245626] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:07.444 EAL: No free 2048 kB hugepages reported on node 1 00:21:07.444 [2024-04-27 03:32:32.312897] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:21:07.702 [2024-04-27 03:32:32.426818] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:07.702 [2024-04-27 03:32:32.426876] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:07.702 [2024-04-27 03:32:32.426893] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:07.702 [2024-04-27 03:32:32.426906] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:07.702 [2024-04-27 03:32:32.426918] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:07.702 [2024-04-27 03:32:32.427004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:07.702 [2024-04-27 03:32:32.427134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:07.702 [2024-04-27 03:32:32.427137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:08.268 03:32:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:08.269 03:32:33 -- common/autotest_common.sh@850 -- # return 0 00:21:08.269 03:32:33 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:08.269 03:32:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:08.269 03:32:33 -- common/autotest_common.sh@10 -- # set +x 00:21:08.269 03:32:33 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:08.269 03:32:33 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:08.269 03:32:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:08.269 03:32:33 -- common/autotest_common.sh@10 -- # set +x 00:21:08.269 [2024-04-27 03:32:33.186772] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:08.269 03:32:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:08.269 03:32:33 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:08.269 03:32:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:08.269 03:32:33 -- common/autotest_common.sh@10 -- # set +x 00:21:08.269 Malloc0 00:21:08.269 03:32:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:08.269 03:32:33 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:08.269 03:32:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:08.269 03:32:33 -- common/autotest_common.sh@10 -- # set +x 00:21:08.269 03:32:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:08.269 03:32:33 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:08.269 03:32:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:08.269 03:32:33 -- common/autotest_common.sh@10 -- # set +x 00:21:08.269 03:32:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:08.269 03:32:33 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:08.269 03:32:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:08.269 03:32:33 -- common/autotest_common.sh@10 -- # set +x 00:21:08.269 [2024-04-27 03:32:33.244458] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:08.529 03:32:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:08.529 03:32:33 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:21:08.529 03:32:33 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:21:08.529 03:32:33 -- nvmf/common.sh@521 -- # config=() 00:21:08.529 03:32:33 -- nvmf/common.sh@521 -- # local subsystem config 00:21:08.529 03:32:33 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.529 03:32:33 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.529 { 00:21:08.529 "params": { 00:21:08.529 "name": "Nvme$subsystem", 00:21:08.529 "trtype": "$TEST_TRANSPORT", 00:21:08.529 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.529 "adrfam": "ipv4", 00:21:08.529 "trsvcid": "$NVMF_PORT", 00:21:08.529 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.529 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.529 "hdgst": ${hdgst:-false}, 00:21:08.529 "ddgst": ${ddgst:-false} 00:21:08.529 }, 00:21:08.529 "method": "bdev_nvme_attach_controller" 00:21:08.529 } 00:21:08.529 EOF 00:21:08.529 )") 00:21:08.530 03:32:33 -- nvmf/common.sh@543 -- # cat 00:21:08.530 03:32:33 -- nvmf/common.sh@545 -- # jq . 00:21:08.530 03:32:33 -- nvmf/common.sh@546 -- # IFS=, 00:21:08.530 03:32:33 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:21:08.530 "params": { 00:21:08.530 "name": "Nvme1", 00:21:08.530 "trtype": "tcp", 00:21:08.530 "traddr": "10.0.0.2", 00:21:08.530 "adrfam": "ipv4", 00:21:08.530 "trsvcid": "4420", 00:21:08.530 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:08.530 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:08.530 "hdgst": false, 00:21:08.530 "ddgst": false 00:21:08.530 }, 00:21:08.530 "method": "bdev_nvme_attach_controller" 00:21:08.530 }' 00:21:08.530 [2024-04-27 03:32:33.291285] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:21:08.530 [2024-04-27 03:32:33.291363] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1527138 ] 00:21:08.530 EAL: No free 2048 kB hugepages reported on node 1 00:21:08.530 [2024-04-27 03:32:33.355122] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:08.530 [2024-04-27 03:32:33.463461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:09.099 Running I/O for 1 seconds... 00:21:10.034 00:21:10.034 Latency(us) 00:21:10.034 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:10.034 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:21:10.034 Verification LBA range: start 0x0 length 0x4000 00:21:10.034 Nvme1n1 : 1.02 8745.89 34.16 0.00 0.00 14571.87 2827.76 16505.36 00:21:10.034 =================================================================================================================== 00:21:10.034 Total : 8745.89 34.16 0.00 0.00 14571.87 2827.76 16505.36 00:21:10.295 03:32:35 -- host/bdevperf.sh@30 -- # bdevperfpid=1527394 00:21:10.295 03:32:35 -- host/bdevperf.sh@32 -- # sleep 3 00:21:10.295 03:32:35 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:21:10.295 03:32:35 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:21:10.295 03:32:35 -- nvmf/common.sh@521 -- # config=() 00:21:10.295 03:32:35 -- nvmf/common.sh@521 -- # local subsystem config 00:21:10.295 03:32:35 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:10.295 03:32:35 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:10.295 { 00:21:10.295 "params": { 00:21:10.295 "name": "Nvme$subsystem", 00:21:10.295 "trtype": "$TEST_TRANSPORT", 00:21:10.295 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.295 "adrfam": "ipv4", 00:21:10.295 "trsvcid": "$NVMF_PORT", 00:21:10.295 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.295 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.295 "hdgst": ${hdgst:-false}, 00:21:10.295 "ddgst": ${ddgst:-false} 00:21:10.295 }, 00:21:10.295 "method": "bdev_nvme_attach_controller" 00:21:10.295 } 00:21:10.295 EOF 00:21:10.295 )") 00:21:10.295 03:32:35 -- nvmf/common.sh@543 -- # cat 00:21:10.295 03:32:35 -- nvmf/common.sh@545 -- # jq . 00:21:10.295 03:32:35 -- nvmf/common.sh@546 -- # IFS=, 00:21:10.295 03:32:35 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:21:10.295 "params": { 00:21:10.295 "name": "Nvme1", 00:21:10.295 "trtype": "tcp", 00:21:10.295 "traddr": "10.0.0.2", 00:21:10.295 "adrfam": "ipv4", 00:21:10.295 "trsvcid": "4420", 00:21:10.295 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:10.295 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:10.295 "hdgst": false, 00:21:10.295 "ddgst": false 00:21:10.295 }, 00:21:10.295 "method": "bdev_nvme_attach_controller" 00:21:10.295 }' 00:21:10.295 [2024-04-27 03:32:35.115646] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:21:10.295 [2024-04-27 03:32:35.115717] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1527394 ] 00:21:10.295 EAL: No free 2048 kB hugepages reported on node 1 00:21:10.295 [2024-04-27 03:32:35.174389] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:10.554 [2024-04-27 03:32:35.279928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:10.554 Running I/O for 15 seconds... 00:21:13.851 03:32:38 -- host/bdevperf.sh@33 -- # kill -9 1527053 00:21:13.851 03:32:38 -- host/bdevperf.sh@35 -- # sleep 3 00:21:13.851 [2024-04-27 03:32:38.085370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:40728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:40736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:40744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:40760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:40768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:40776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:40784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:40792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:40808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:40816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:40824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:40832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:40840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:40848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.851 [2024-04-27 03:32:38.085970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.085987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:41552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:41568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:41576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:41584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:41592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:41600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:41608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:41624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:41632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:41640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:41648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:41656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:41664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:41672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:41680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:41688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:41696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:41704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:41712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.851 [2024-04-27 03:32:38.086681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.851 [2024-04-27 03:32:38.086698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:41720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.852 [2024-04-27 03:32:38.086712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.086729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:41728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.852 [2024-04-27 03:32:38.086745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.086761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:41736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.852 [2024-04-27 03:32:38.086776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.086792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:40856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.086807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.086824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:40864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.086838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.086855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.086870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.086886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:40880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.086901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.086917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:40888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.086932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.086949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:40896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.086963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.086980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:40904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.086995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:40912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:40920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:40928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:40936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:40944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:40952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:40960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:40968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:40976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:40984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:40992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:41000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:41008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:41016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:41024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:41032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:41040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:41048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:41056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:41064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:41072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:41080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:41088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:41096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:41104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:41112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:41120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:41128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:41136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.087971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.852 [2024-04-27 03:32:38.087987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:41144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.852 [2024-04-27 03:32:38.088002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:41152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:41160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:41168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:41176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:41184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:41192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:41200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:41208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:41216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:41224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:41232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:41240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:41248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:41256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:41272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:41280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:41288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:41744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:13.853 [2024-04-27 03:32:38.088626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:41296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:41304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:41312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:41320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:41328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:41336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:41344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:41352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:41360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:41368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:41376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.088976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.088993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:41384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.089007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.089024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:41392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.089038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.089055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:41400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.089070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.089090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:41408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.089105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.089122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:41416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.089137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.089153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:41424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.089168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.089185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:41432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.089199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.089216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:41440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.089231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.089254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:41448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.089271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.853 [2024-04-27 03:32:38.089302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:41456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.853 [2024-04-27 03:32:38.089316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:41464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.854 [2024-04-27 03:32:38.089345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:41472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.854 [2024-04-27 03:32:38.089373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:41480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.854 [2024-04-27 03:32:38.089401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:41488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.854 [2024-04-27 03:32:38.089429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:41496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.854 [2024-04-27 03:32:38.089457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:41504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.854 [2024-04-27 03:32:38.089491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:41512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.854 [2024-04-27 03:32:38.089520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.854 [2024-04-27 03:32:38.089568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:41528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.854 [2024-04-27 03:32:38.089599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:41536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:13.854 [2024-04-27 03:32:38.089638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b00e90 is same with the state(5) to be set 00:21:13.854 [2024-04-27 03:32:38.089672] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:21:13.854 [2024-04-27 03:32:38.089685] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:21:13.854 [2024-04-27 03:32:38.089697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:41544 len:8 PRP1 0x0 PRP2 0x0 00:21:13.854 [2024-04-27 03:32:38.089711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089774] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1b00e90 was disconnected and freed. reset controller. 00:21:13.854 [2024-04-27 03:32:38.089848] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:13.854 [2024-04-27 03:32:38.089879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089896] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:13.854 [2024-04-27 03:32:38.089911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089925] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:13.854 [2024-04-27 03:32:38.089940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089955] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:13.854 [2024-04-27 03:32:38.089969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:13.854 [2024-04-27 03:32:38.089983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.854 [2024-04-27 03:32:38.093781] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.854 [2024-04-27 03:32:38.093821] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.854 [2024-04-27 03:32:38.094470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.094634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.094664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.854 [2024-04-27 03:32:38.094681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.854 [2024-04-27 03:32:38.094919] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.854 [2024-04-27 03:32:38.095159] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.854 [2024-04-27 03:32:38.095183] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.854 [2024-04-27 03:32:38.095200] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.854 [2024-04-27 03:32:38.098749] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.854 [2024-04-27 03:32:38.107935] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.854 [2024-04-27 03:32:38.108351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.108498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.108527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.854 [2024-04-27 03:32:38.108544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.854 [2024-04-27 03:32:38.108781] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.854 [2024-04-27 03:32:38.109022] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.854 [2024-04-27 03:32:38.109044] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.854 [2024-04-27 03:32:38.109059] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.854 [2024-04-27 03:32:38.112605] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.854 [2024-04-27 03:32:38.121779] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.854 [2024-04-27 03:32:38.122184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.122357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.122386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.854 [2024-04-27 03:32:38.122403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.854 [2024-04-27 03:32:38.122639] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.854 [2024-04-27 03:32:38.122880] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.854 [2024-04-27 03:32:38.122903] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.854 [2024-04-27 03:32:38.122918] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.854 [2024-04-27 03:32:38.126465] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.854 [2024-04-27 03:32:38.135643] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.854 [2024-04-27 03:32:38.136035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.136239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.136281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.854 [2024-04-27 03:32:38.136314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.854 [2024-04-27 03:32:38.136527] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.854 [2024-04-27 03:32:38.136783] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.854 [2024-04-27 03:32:38.136805] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.854 [2024-04-27 03:32:38.136820] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.854 [2024-04-27 03:32:38.140356] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.854 [2024-04-27 03:32:38.149533] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.854 [2024-04-27 03:32:38.149914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.150060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.150088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.854 [2024-04-27 03:32:38.150105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.854 [2024-04-27 03:32:38.150352] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.854 [2024-04-27 03:32:38.150592] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.854 [2024-04-27 03:32:38.150616] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.854 [2024-04-27 03:32:38.150630] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.854 [2024-04-27 03:32:38.154252] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.854 [2024-04-27 03:32:38.163433] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.854 [2024-04-27 03:32:38.163839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.854 [2024-04-27 03:32:38.163985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.164013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.855 [2024-04-27 03:32:38.164030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.855 [2024-04-27 03:32:38.164277] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.855 [2024-04-27 03:32:38.164518] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.855 [2024-04-27 03:32:38.164540] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.855 [2024-04-27 03:32:38.164555] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.855 [2024-04-27 03:32:38.168089] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.855 [2024-04-27 03:32:38.177270] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.855 [2024-04-27 03:32:38.177692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.177836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.177877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.855 [2024-04-27 03:32:38.177900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.855 [2024-04-27 03:32:38.178136] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.855 [2024-04-27 03:32:38.178387] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.855 [2024-04-27 03:32:38.178411] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.855 [2024-04-27 03:32:38.178426] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.855 [2024-04-27 03:32:38.181960] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.855 [2024-04-27 03:32:38.191139] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.855 [2024-04-27 03:32:38.191523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.191689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.191717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.855 [2024-04-27 03:32:38.191734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.855 [2024-04-27 03:32:38.191969] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.855 [2024-04-27 03:32:38.192210] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.855 [2024-04-27 03:32:38.192232] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.855 [2024-04-27 03:32:38.192256] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.855 [2024-04-27 03:32:38.195795] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.855 [2024-04-27 03:32:38.204972] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.855 [2024-04-27 03:32:38.205455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.205595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.205620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.855 [2024-04-27 03:32:38.205635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.855 [2024-04-27 03:32:38.205892] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.855 [2024-04-27 03:32:38.206133] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.855 [2024-04-27 03:32:38.206156] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.855 [2024-04-27 03:32:38.206171] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.855 [2024-04-27 03:32:38.209708] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.855 [2024-04-27 03:32:38.218902] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.855 [2024-04-27 03:32:38.219311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.219454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.219483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.855 [2024-04-27 03:32:38.219500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.855 [2024-04-27 03:32:38.219742] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.855 [2024-04-27 03:32:38.219982] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.855 [2024-04-27 03:32:38.220006] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.855 [2024-04-27 03:32:38.220020] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.855 [2024-04-27 03:32:38.223562] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.855 [2024-04-27 03:32:38.232735] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.855 [2024-04-27 03:32:38.233113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.233283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.233309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.855 [2024-04-27 03:32:38.233324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.855 [2024-04-27 03:32:38.233557] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.855 [2024-04-27 03:32:38.233797] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.855 [2024-04-27 03:32:38.233820] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.855 [2024-04-27 03:32:38.233835] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.855 [2024-04-27 03:32:38.237387] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.855 [2024-04-27 03:32:38.246665] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.855 [2024-04-27 03:32:38.247091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.247239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.247284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.855 [2024-04-27 03:32:38.247302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.855 [2024-04-27 03:32:38.247545] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.855 [2024-04-27 03:32:38.247794] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.855 [2024-04-27 03:32:38.247819] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.855 [2024-04-27 03:32:38.247843] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.855 [2024-04-27 03:32:38.251492] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.855 [2024-04-27 03:32:38.260735] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.855 [2024-04-27 03:32:38.261150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.261316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.855 [2024-04-27 03:32:38.261343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.855 [2024-04-27 03:32:38.261359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.855 [2024-04-27 03:32:38.261615] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.855 [2024-04-27 03:32:38.261870] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.855 [2024-04-27 03:32:38.261895] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.856 [2024-04-27 03:32:38.261910] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.856 [2024-04-27 03:32:38.265501] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.856 [2024-04-27 03:32:38.274702] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.856 [2024-04-27 03:32:38.275121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.275297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.275323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.856 [2024-04-27 03:32:38.275339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.856 [2024-04-27 03:32:38.275588] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.856 [2024-04-27 03:32:38.275828] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.856 [2024-04-27 03:32:38.275851] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.856 [2024-04-27 03:32:38.275866] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.856 [2024-04-27 03:32:38.279408] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.856 [2024-04-27 03:32:38.288564] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.856 [2024-04-27 03:32:38.288934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.289093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.289118] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.856 [2024-04-27 03:32:38.289133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.856 [2024-04-27 03:32:38.289403] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.856 [2024-04-27 03:32:38.289636] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.856 [2024-04-27 03:32:38.289658] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.856 [2024-04-27 03:32:38.289672] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.856 [2024-04-27 03:32:38.293035] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.856 [2024-04-27 03:32:38.302037] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.856 [2024-04-27 03:32:38.302394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.302527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.302552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.856 [2024-04-27 03:32:38.302567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.856 [2024-04-27 03:32:38.302808] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.856 [2024-04-27 03:32:38.303011] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.856 [2024-04-27 03:32:38.303035] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.856 [2024-04-27 03:32:38.303048] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.856 [2024-04-27 03:32:38.306149] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.856 [2024-04-27 03:32:38.316032] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.856 [2024-04-27 03:32:38.316442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.316599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.316627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.856 [2024-04-27 03:32:38.316644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.856 [2024-04-27 03:32:38.316886] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.856 [2024-04-27 03:32:38.317135] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.856 [2024-04-27 03:32:38.317159] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.856 [2024-04-27 03:32:38.317175] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.856 [2024-04-27 03:32:38.320834] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.856 [2024-04-27 03:32:38.329959] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.856 [2024-04-27 03:32:38.330376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.330536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.330565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.856 [2024-04-27 03:32:38.330583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.856 [2024-04-27 03:32:38.330828] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.856 [2024-04-27 03:32:38.331075] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.856 [2024-04-27 03:32:38.331099] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.856 [2024-04-27 03:32:38.331119] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.856 [2024-04-27 03:32:38.334727] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.856 [2024-04-27 03:32:38.343907] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.856 [2024-04-27 03:32:38.344298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.344413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.344441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.856 [2024-04-27 03:32:38.344459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.856 [2024-04-27 03:32:38.344695] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.856 [2024-04-27 03:32:38.344942] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.856 [2024-04-27 03:32:38.344964] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.856 [2024-04-27 03:32:38.344984] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.856 [2024-04-27 03:32:38.348612] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.856 [2024-04-27 03:32:38.357996] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.856 [2024-04-27 03:32:38.358407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.358544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.358569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.856 [2024-04-27 03:32:38.358585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.856 [2024-04-27 03:32:38.358827] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.856 [2024-04-27 03:32:38.359077] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.856 [2024-04-27 03:32:38.359100] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.856 [2024-04-27 03:32:38.359115] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.856 [2024-04-27 03:32:38.362708] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.856 [2024-04-27 03:32:38.371901] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.856 [2024-04-27 03:32:38.372316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.372430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.372457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.856 [2024-04-27 03:32:38.372472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.856 [2024-04-27 03:32:38.372728] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.856 [2024-04-27 03:32:38.372969] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.856 [2024-04-27 03:32:38.372991] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.856 [2024-04-27 03:32:38.373007] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.856 [2024-04-27 03:32:38.376554] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.856 [2024-04-27 03:32:38.385743] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.856 [2024-04-27 03:32:38.386144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.386288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.386316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.856 [2024-04-27 03:32:38.386333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.856 [2024-04-27 03:32:38.386569] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.856 [2024-04-27 03:32:38.386808] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.856 [2024-04-27 03:32:38.386830] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.856 [2024-04-27 03:32:38.386846] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.856 [2024-04-27 03:32:38.390400] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.856 [2024-04-27 03:32:38.399581] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.856 [2024-04-27 03:32:38.399957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.856 [2024-04-27 03:32:38.400128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.400156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.857 [2024-04-27 03:32:38.400172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.857 [2024-04-27 03:32:38.400419] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.857 [2024-04-27 03:32:38.400660] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.857 [2024-04-27 03:32:38.400683] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.857 [2024-04-27 03:32:38.400698] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.857 [2024-04-27 03:32:38.404234] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.857 [2024-04-27 03:32:38.413424] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.857 [2024-04-27 03:32:38.413824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.413950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.413978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.857 [2024-04-27 03:32:38.413995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.857 [2024-04-27 03:32:38.414231] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.857 [2024-04-27 03:32:38.414482] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.857 [2024-04-27 03:32:38.414505] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.857 [2024-04-27 03:32:38.414520] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.857 [2024-04-27 03:32:38.418055] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.857 [2024-04-27 03:32:38.427242] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.857 [2024-04-27 03:32:38.427653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.427822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.427850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.857 [2024-04-27 03:32:38.427868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.857 [2024-04-27 03:32:38.428104] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.857 [2024-04-27 03:32:38.428355] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.857 [2024-04-27 03:32:38.428379] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.857 [2024-04-27 03:32:38.428394] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.857 [2024-04-27 03:32:38.431926] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.857 [2024-04-27 03:32:38.441114] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.857 [2024-04-27 03:32:38.441557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.441682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.441708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.857 [2024-04-27 03:32:38.441724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.857 [2024-04-27 03:32:38.441973] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.857 [2024-04-27 03:32:38.442214] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.857 [2024-04-27 03:32:38.442237] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.857 [2024-04-27 03:32:38.442262] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.857 [2024-04-27 03:32:38.445801] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.857 [2024-04-27 03:32:38.454983] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.857 [2024-04-27 03:32:38.455410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.455651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.455679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.857 [2024-04-27 03:32:38.455695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.857 [2024-04-27 03:32:38.455932] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.857 [2024-04-27 03:32:38.456171] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.857 [2024-04-27 03:32:38.456193] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.857 [2024-04-27 03:32:38.456208] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.857 [2024-04-27 03:32:38.459749] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.857 [2024-04-27 03:32:38.468930] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.857 [2024-04-27 03:32:38.469318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.469467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.469495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.857 [2024-04-27 03:32:38.469512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.857 [2024-04-27 03:32:38.469748] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.857 [2024-04-27 03:32:38.469988] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.857 [2024-04-27 03:32:38.470010] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.857 [2024-04-27 03:32:38.470025] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.857 [2024-04-27 03:32:38.473567] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.857 [2024-04-27 03:32:38.482745] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.857 [2024-04-27 03:32:38.483157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.483291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.483320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.857 [2024-04-27 03:32:38.483338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.857 [2024-04-27 03:32:38.483574] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.857 [2024-04-27 03:32:38.483813] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.857 [2024-04-27 03:32:38.483836] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.857 [2024-04-27 03:32:38.483850] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.857 [2024-04-27 03:32:38.487394] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.857 [2024-04-27 03:32:38.496580] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.857 [2024-04-27 03:32:38.496932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.497105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.497132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.857 [2024-04-27 03:32:38.497149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.857 [2024-04-27 03:32:38.497395] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.857 [2024-04-27 03:32:38.497636] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.857 [2024-04-27 03:32:38.497659] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.857 [2024-04-27 03:32:38.497674] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.857 [2024-04-27 03:32:38.501208] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.857 [2024-04-27 03:32:38.510396] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.857 [2024-04-27 03:32:38.510785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.510954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.510982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.857 [2024-04-27 03:32:38.510999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.857 [2024-04-27 03:32:38.511235] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.857 [2024-04-27 03:32:38.511486] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.857 [2024-04-27 03:32:38.511509] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.857 [2024-04-27 03:32:38.511524] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.857 [2024-04-27 03:32:38.515058] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.857 [2024-04-27 03:32:38.524251] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.857 [2024-04-27 03:32:38.524650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.524778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.857 [2024-04-27 03:32:38.524823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.857 [2024-04-27 03:32:38.524840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.857 [2024-04-27 03:32:38.525098] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.857 [2024-04-27 03:32:38.525350] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.858 [2024-04-27 03:32:38.525373] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.858 [2024-04-27 03:32:38.525388] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.858 [2024-04-27 03:32:38.528922] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.858 [2024-04-27 03:32:38.538106] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.858 [2024-04-27 03:32:38.538472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.538618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.538646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.858 [2024-04-27 03:32:38.538663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.858 [2024-04-27 03:32:38.538899] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.858 [2024-04-27 03:32:38.539139] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.858 [2024-04-27 03:32:38.539161] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.858 [2024-04-27 03:32:38.539176] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.858 [2024-04-27 03:32:38.542723] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.858 [2024-04-27 03:32:38.551925] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.858 [2024-04-27 03:32:38.552320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.552477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.552504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.858 [2024-04-27 03:32:38.552521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.858 [2024-04-27 03:32:38.552757] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.858 [2024-04-27 03:32:38.552997] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.858 [2024-04-27 03:32:38.553019] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.858 [2024-04-27 03:32:38.553034] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.858 [2024-04-27 03:32:38.556579] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.858 [2024-04-27 03:32:38.565767] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.858 [2024-04-27 03:32:38.566167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.566309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.566338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.858 [2024-04-27 03:32:38.566360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.858 [2024-04-27 03:32:38.566597] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.858 [2024-04-27 03:32:38.566836] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.858 [2024-04-27 03:32:38.566859] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.858 [2024-04-27 03:32:38.566874] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.858 [2024-04-27 03:32:38.570420] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.858 [2024-04-27 03:32:38.579603] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.858 [2024-04-27 03:32:38.580003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.580168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.580196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.858 [2024-04-27 03:32:38.580213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.858 [2024-04-27 03:32:38.580457] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.858 [2024-04-27 03:32:38.580698] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.858 [2024-04-27 03:32:38.580721] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.858 [2024-04-27 03:32:38.580736] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.858 [2024-04-27 03:32:38.584281] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.858 [2024-04-27 03:32:38.593475] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.858 [2024-04-27 03:32:38.593874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.594002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.594030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.858 [2024-04-27 03:32:38.594047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.858 [2024-04-27 03:32:38.594295] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.858 [2024-04-27 03:32:38.594536] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.858 [2024-04-27 03:32:38.594559] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.858 [2024-04-27 03:32:38.594574] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.858 [2024-04-27 03:32:38.598107] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.858 [2024-04-27 03:32:38.607300] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.858 [2024-04-27 03:32:38.607698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.607931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.607959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.858 [2024-04-27 03:32:38.607976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.858 [2024-04-27 03:32:38.608220] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.858 [2024-04-27 03:32:38.608470] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.858 [2024-04-27 03:32:38.608493] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.858 [2024-04-27 03:32:38.608508] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.858 [2024-04-27 03:32:38.612041] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.858 [2024-04-27 03:32:38.621225] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.858 [2024-04-27 03:32:38.621642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.621835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.621898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.858 [2024-04-27 03:32:38.621915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.858 [2024-04-27 03:32:38.622151] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.858 [2024-04-27 03:32:38.622403] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.858 [2024-04-27 03:32:38.622426] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.858 [2024-04-27 03:32:38.622441] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.858 [2024-04-27 03:32:38.625980] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.858 [2024-04-27 03:32:38.635166] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.858 [2024-04-27 03:32:38.635573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.635724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.635751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.858 [2024-04-27 03:32:38.635768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.858 [2024-04-27 03:32:38.636004] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.858 [2024-04-27 03:32:38.636243] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.858 [2024-04-27 03:32:38.636276] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.858 [2024-04-27 03:32:38.636291] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.858 [2024-04-27 03:32:38.639828] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.858 [2024-04-27 03:32:38.649006] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.858 [2024-04-27 03:32:38.649424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.649568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.858 [2024-04-27 03:32:38.649596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.858 [2024-04-27 03:32:38.649612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.858 [2024-04-27 03:32:38.649848] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.858 [2024-04-27 03:32:38.650094] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.858 [2024-04-27 03:32:38.650117] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.858 [2024-04-27 03:32:38.650132] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.858 [2024-04-27 03:32:38.653678] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.858 [2024-04-27 03:32:38.662860] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.859 [2024-04-27 03:32:38.663236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.663404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.663431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.859 [2024-04-27 03:32:38.663448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.859 [2024-04-27 03:32:38.663685] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.859 [2024-04-27 03:32:38.663925] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.859 [2024-04-27 03:32:38.663947] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.859 [2024-04-27 03:32:38.663962] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.859 [2024-04-27 03:32:38.667506] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.859 [2024-04-27 03:32:38.676687] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.859 [2024-04-27 03:32:38.677164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.677332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.677361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.859 [2024-04-27 03:32:38.677378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.859 [2024-04-27 03:32:38.677614] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.859 [2024-04-27 03:32:38.677853] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.859 [2024-04-27 03:32:38.677876] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.859 [2024-04-27 03:32:38.677890] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.859 [2024-04-27 03:32:38.681432] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.859 [2024-04-27 03:32:38.690620] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.859 [2024-04-27 03:32:38.691019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.691187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.691214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.859 [2024-04-27 03:32:38.691231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.859 [2024-04-27 03:32:38.691476] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.859 [2024-04-27 03:32:38.691716] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.859 [2024-04-27 03:32:38.691745] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.859 [2024-04-27 03:32:38.691761] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.859 [2024-04-27 03:32:38.695304] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.859 [2024-04-27 03:32:38.704482] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.859 [2024-04-27 03:32:38.704858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.704999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.705027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.859 [2024-04-27 03:32:38.705044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.859 [2024-04-27 03:32:38.705290] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.859 [2024-04-27 03:32:38.705531] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.859 [2024-04-27 03:32:38.705554] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.859 [2024-04-27 03:32:38.705569] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.859 [2024-04-27 03:32:38.709102] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.859 [2024-04-27 03:32:38.718289] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.859 [2024-04-27 03:32:38.718686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.718828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.718856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.859 [2024-04-27 03:32:38.718873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.859 [2024-04-27 03:32:38.719109] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.859 [2024-04-27 03:32:38.719360] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.859 [2024-04-27 03:32:38.719384] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.859 [2024-04-27 03:32:38.719400] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.859 [2024-04-27 03:32:38.722938] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.859 [2024-04-27 03:32:38.732127] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.859 [2024-04-27 03:32:38.732532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.732675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.732703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.859 [2024-04-27 03:32:38.732719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.859 [2024-04-27 03:32:38.732955] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.859 [2024-04-27 03:32:38.733195] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.859 [2024-04-27 03:32:38.733217] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.859 [2024-04-27 03:32:38.733238] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.859 [2024-04-27 03:32:38.736785] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.859 [2024-04-27 03:32:38.745965] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.859 [2024-04-27 03:32:38.746367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.746481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.746510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.859 [2024-04-27 03:32:38.746527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.859 [2024-04-27 03:32:38.746763] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.859 [2024-04-27 03:32:38.747003] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.859 [2024-04-27 03:32:38.747026] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.859 [2024-04-27 03:32:38.747041] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.859 [2024-04-27 03:32:38.750590] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.859 [2024-04-27 03:32:38.759800] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.859 [2024-04-27 03:32:38.760176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.760330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.760358] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.859 [2024-04-27 03:32:38.760375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.859 [2024-04-27 03:32:38.760611] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.859 [2024-04-27 03:32:38.760851] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.859 [2024-04-27 03:32:38.760873] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.859 [2024-04-27 03:32:38.760889] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.859 [2024-04-27 03:32:38.764435] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.859 [2024-04-27 03:32:38.773621] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.859 [2024-04-27 03:32:38.774023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.774167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.774195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.859 [2024-04-27 03:32:38.774212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.859 [2024-04-27 03:32:38.774457] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.859 [2024-04-27 03:32:38.774698] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.859 [2024-04-27 03:32:38.774720] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.859 [2024-04-27 03:32:38.774735] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.859 [2024-04-27 03:32:38.778288] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.859 [2024-04-27 03:32:38.787476] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.859 [2024-04-27 03:32:38.787938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.788104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.859 [2024-04-27 03:32:38.788132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.860 [2024-04-27 03:32:38.788148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.860 [2024-04-27 03:32:38.788393] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.860 [2024-04-27 03:32:38.788633] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.860 [2024-04-27 03:32:38.788656] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.860 [2024-04-27 03:32:38.788670] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.860 [2024-04-27 03:32:38.792208] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.860 [2024-04-27 03:32:38.801403] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.860 [2024-04-27 03:32:38.801779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.860 [2024-04-27 03:32:38.801948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.860 [2024-04-27 03:32:38.801975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.860 [2024-04-27 03:32:38.801992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.860 [2024-04-27 03:32:38.802228] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.860 [2024-04-27 03:32:38.802477] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.860 [2024-04-27 03:32:38.802501] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.860 [2024-04-27 03:32:38.802516] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.860 [2024-04-27 03:32:38.806056] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:13.860 [2024-04-27 03:32:38.815243] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:13.860 [2024-04-27 03:32:38.815689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.860 [2024-04-27 03:32:38.815809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:13.860 [2024-04-27 03:32:38.815837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:13.860 [2024-04-27 03:32:38.815853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:13.860 [2024-04-27 03:32:38.816090] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:13.860 [2024-04-27 03:32:38.816345] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:13.860 [2024-04-27 03:32:38.816369] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:13.860 [2024-04-27 03:32:38.816385] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:13.860 [2024-04-27 03:32:38.819988] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.124 [2024-04-27 03:32:38.829106] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.124 [2024-04-27 03:32:38.829506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.124 [2024-04-27 03:32:38.829656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.829684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.125 [2024-04-27 03:32:38.829701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.125 [2024-04-27 03:32:38.829938] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.125 [2024-04-27 03:32:38.830178] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.125 [2024-04-27 03:32:38.830200] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.125 [2024-04-27 03:32:38.830215] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.125 [2024-04-27 03:32:38.833761] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.125 [2024-04-27 03:32:38.843061] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.125 [2024-04-27 03:32:38.843481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.843659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.843687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.125 [2024-04-27 03:32:38.843704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.125 [2024-04-27 03:32:38.843939] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.125 [2024-04-27 03:32:38.844179] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.125 [2024-04-27 03:32:38.844202] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.125 [2024-04-27 03:32:38.844217] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.125 [2024-04-27 03:32:38.847763] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.125 [2024-04-27 03:32:38.856957] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.125 [2024-04-27 03:32:38.857344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.857517] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.857546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.125 [2024-04-27 03:32:38.857564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.125 [2024-04-27 03:32:38.857800] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.125 [2024-04-27 03:32:38.858041] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.125 [2024-04-27 03:32:38.858071] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.125 [2024-04-27 03:32:38.858086] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.125 [2024-04-27 03:32:38.861638] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.125 [2024-04-27 03:32:38.870837] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.125 [2024-04-27 03:32:38.871222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.871393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.871421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.125 [2024-04-27 03:32:38.871438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.125 [2024-04-27 03:32:38.871673] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.125 [2024-04-27 03:32:38.871913] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.125 [2024-04-27 03:32:38.871937] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.125 [2024-04-27 03:32:38.871952] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.125 [2024-04-27 03:32:38.875500] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.125 [2024-04-27 03:32:38.884689] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.125 [2024-04-27 03:32:38.885066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.885238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.885273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.125 [2024-04-27 03:32:38.885290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.125 [2024-04-27 03:32:38.885526] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.125 [2024-04-27 03:32:38.885766] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.125 [2024-04-27 03:32:38.885789] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.125 [2024-04-27 03:32:38.885804] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.125 [2024-04-27 03:32:38.889351] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.125 [2024-04-27 03:32:38.898555] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.125 [2024-04-27 03:32:38.899064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.899252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.899281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.125 [2024-04-27 03:32:38.899298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.125 [2024-04-27 03:32:38.899534] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.125 [2024-04-27 03:32:38.899773] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.125 [2024-04-27 03:32:38.899796] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.125 [2024-04-27 03:32:38.899810] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.125 [2024-04-27 03:32:38.903355] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.125 [2024-04-27 03:32:38.912538] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.125 [2024-04-27 03:32:38.912970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.913113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.913147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.125 [2024-04-27 03:32:38.913165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.125 [2024-04-27 03:32:38.913409] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.125 [2024-04-27 03:32:38.913650] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.125 [2024-04-27 03:32:38.913673] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.125 [2024-04-27 03:32:38.913688] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.125 [2024-04-27 03:32:38.917224] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.125 [2024-04-27 03:32:38.926435] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.125 [2024-04-27 03:32:38.926813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.926982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.927010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.125 [2024-04-27 03:32:38.927027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.125 [2024-04-27 03:32:38.927274] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.125 [2024-04-27 03:32:38.927516] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.125 [2024-04-27 03:32:38.927539] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.125 [2024-04-27 03:32:38.927554] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.125 [2024-04-27 03:32:38.931090] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.125 [2024-04-27 03:32:38.940302] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.125 [2024-04-27 03:32:38.940701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.940917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.940971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.125 [2024-04-27 03:32:38.940988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.125 [2024-04-27 03:32:38.941223] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.125 [2024-04-27 03:32:38.941471] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.125 [2024-04-27 03:32:38.941496] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.125 [2024-04-27 03:32:38.941510] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.125 [2024-04-27 03:32:38.945045] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.125 [2024-04-27 03:32:38.954243] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.125 [2024-04-27 03:32:38.954651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.954830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.125 [2024-04-27 03:32:38.954898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.126 [2024-04-27 03:32:38.954921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.126 [2024-04-27 03:32:38.955157] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.126 [2024-04-27 03:32:38.955408] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.126 [2024-04-27 03:32:38.955432] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.126 [2024-04-27 03:32:38.955446] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.126 [2024-04-27 03:32:38.958988] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.126 [2024-04-27 03:32:38.968199] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.126 [2024-04-27 03:32:38.968709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:38.968995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:38.969045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.126 [2024-04-27 03:32:38.969061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.126 [2024-04-27 03:32:38.969308] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.126 [2024-04-27 03:32:38.969549] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.126 [2024-04-27 03:32:38.969572] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.126 [2024-04-27 03:32:38.969587] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.126 [2024-04-27 03:32:38.973137] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.126 [2024-04-27 03:32:38.982134] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.126 [2024-04-27 03:32:38.982544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:38.982688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:38.982715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.126 [2024-04-27 03:32:38.982732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.126 [2024-04-27 03:32:38.982968] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.126 [2024-04-27 03:32:38.983208] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.126 [2024-04-27 03:32:38.983230] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.126 [2024-04-27 03:32:38.983245] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.126 [2024-04-27 03:32:38.986811] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.126 [2024-04-27 03:32:38.996005] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.126 [2024-04-27 03:32:38.996416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:38.996563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:38.996591] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.126 [2024-04-27 03:32:38.996608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.126 [2024-04-27 03:32:38.996849] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.126 [2024-04-27 03:32:38.997088] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.126 [2024-04-27 03:32:38.997111] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.126 [2024-04-27 03:32:38.997126] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.126 [2024-04-27 03:32:39.000674] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.126 [2024-04-27 03:32:39.009869] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.126 [2024-04-27 03:32:39.010326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.010590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.010646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.126 [2024-04-27 03:32:39.010663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.126 [2024-04-27 03:32:39.010898] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.126 [2024-04-27 03:32:39.011138] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.126 [2024-04-27 03:32:39.011161] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.126 [2024-04-27 03:32:39.011176] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.126 [2024-04-27 03:32:39.014719] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.126 [2024-04-27 03:32:39.023715] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.126 [2024-04-27 03:32:39.024088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.024232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.024270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.126 [2024-04-27 03:32:39.024289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.126 [2024-04-27 03:32:39.024524] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.126 [2024-04-27 03:32:39.024764] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.126 [2024-04-27 03:32:39.024787] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.126 [2024-04-27 03:32:39.024801] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.126 [2024-04-27 03:32:39.028342] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.126 [2024-04-27 03:32:39.037536] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.126 [2024-04-27 03:32:39.038016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.038185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.038213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.126 [2024-04-27 03:32:39.038230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.126 [2024-04-27 03:32:39.038474] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.126 [2024-04-27 03:32:39.038720] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.126 [2024-04-27 03:32:39.038743] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.126 [2024-04-27 03:32:39.038758] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.126 [2024-04-27 03:32:39.042309] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.126 [2024-04-27 03:32:39.051498] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.126 [2024-04-27 03:32:39.051895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.052033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.052061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.126 [2024-04-27 03:32:39.052078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.126 [2024-04-27 03:32:39.052325] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.126 [2024-04-27 03:32:39.052566] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.126 [2024-04-27 03:32:39.052589] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.126 [2024-04-27 03:32:39.052604] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.126 [2024-04-27 03:32:39.056139] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.126 [2024-04-27 03:32:39.065328] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.126 [2024-04-27 03:32:39.065733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.065890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.065918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.126 [2024-04-27 03:32:39.065935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.126 [2024-04-27 03:32:39.066171] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.126 [2024-04-27 03:32:39.066422] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.126 [2024-04-27 03:32:39.066446] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.126 [2024-04-27 03:32:39.066461] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.126 [2024-04-27 03:32:39.069998] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.126 [2024-04-27 03:32:39.079183] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.126 [2024-04-27 03:32:39.079543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.079712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.126 [2024-04-27 03:32:39.079740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.126 [2024-04-27 03:32:39.079757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.126 [2024-04-27 03:32:39.079994] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.126 [2024-04-27 03:32:39.080234] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.126 [2024-04-27 03:32:39.080273] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.127 [2024-04-27 03:32:39.080290] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.127 [2024-04-27 03:32:39.083823] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.127 [2024-04-27 03:32:39.093001] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.127 [2024-04-27 03:32:39.093388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.127 [2024-04-27 03:32:39.093535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.127 [2024-04-27 03:32:39.093563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.127 [2024-04-27 03:32:39.093580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.127 [2024-04-27 03:32:39.093815] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.127 [2024-04-27 03:32:39.094055] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.127 [2024-04-27 03:32:39.094077] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.127 [2024-04-27 03:32:39.094092] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.127 [2024-04-27 03:32:39.097747] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.388 [2024-04-27 03:32:39.106879] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.389 [2024-04-27 03:32:39.107264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.107428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.107457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.389 [2024-04-27 03:32:39.107487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.389 [2024-04-27 03:32:39.107729] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.389 [2024-04-27 03:32:39.107969] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.389 [2024-04-27 03:32:39.107992] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.389 [2024-04-27 03:32:39.108007] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.389 [2024-04-27 03:32:39.111578] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.389 [2024-04-27 03:32:39.120717] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.389 [2024-04-27 03:32:39.121122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.121289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.121318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.389 [2024-04-27 03:32:39.121335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.389 [2024-04-27 03:32:39.121572] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.389 [2024-04-27 03:32:39.121812] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.389 [2024-04-27 03:32:39.121835] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.389 [2024-04-27 03:32:39.121857] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.389 [2024-04-27 03:32:39.125407] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.389 [2024-04-27 03:32:39.134591] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.389 [2024-04-27 03:32:39.134971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.135125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.135153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.389 [2024-04-27 03:32:39.135170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.389 [2024-04-27 03:32:39.135417] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.389 [2024-04-27 03:32:39.135658] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.389 [2024-04-27 03:32:39.135681] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.389 [2024-04-27 03:32:39.135696] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.389 [2024-04-27 03:32:39.139231] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.389 [2024-04-27 03:32:39.148430] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.389 [2024-04-27 03:32:39.148831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.148955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.148983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.389 [2024-04-27 03:32:39.149000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.389 [2024-04-27 03:32:39.149236] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.389 [2024-04-27 03:32:39.149490] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.389 [2024-04-27 03:32:39.149513] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.389 [2024-04-27 03:32:39.149528] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.389 [2024-04-27 03:32:39.153060] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.389 [2024-04-27 03:32:39.162240] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.389 [2024-04-27 03:32:39.162645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.162791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.162819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.389 [2024-04-27 03:32:39.162836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.389 [2024-04-27 03:32:39.163072] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.389 [2024-04-27 03:32:39.163324] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.389 [2024-04-27 03:32:39.163347] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.389 [2024-04-27 03:32:39.163362] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.389 [2024-04-27 03:32:39.166903] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.389 [2024-04-27 03:32:39.176097] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.389 [2024-04-27 03:32:39.176527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.176716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.176784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.389 [2024-04-27 03:32:39.176801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.389 [2024-04-27 03:32:39.177037] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.389 [2024-04-27 03:32:39.177289] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.389 [2024-04-27 03:32:39.177312] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.389 [2024-04-27 03:32:39.177327] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.389 [2024-04-27 03:32:39.180860] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.389 [2024-04-27 03:32:39.190044] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.389 [2024-04-27 03:32:39.190453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.190623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.190651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.389 [2024-04-27 03:32:39.190668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.389 [2024-04-27 03:32:39.190904] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.389 [2024-04-27 03:32:39.191144] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.389 [2024-04-27 03:32:39.191167] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.389 [2024-04-27 03:32:39.191181] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.389 [2024-04-27 03:32:39.194724] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.389 [2024-04-27 03:32:39.203901] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.389 [2024-04-27 03:32:39.204302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.204551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.204580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.389 [2024-04-27 03:32:39.204598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.389 [2024-04-27 03:32:39.204834] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.389 [2024-04-27 03:32:39.205075] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.389 [2024-04-27 03:32:39.205097] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.389 [2024-04-27 03:32:39.205112] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.389 [2024-04-27 03:32:39.208657] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.389 [2024-04-27 03:32:39.217844] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.389 [2024-04-27 03:32:39.218218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.218368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.218397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.389 [2024-04-27 03:32:39.218414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.389 [2024-04-27 03:32:39.218650] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.389 [2024-04-27 03:32:39.218890] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.389 [2024-04-27 03:32:39.218912] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.389 [2024-04-27 03:32:39.218927] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.389 [2024-04-27 03:32:39.222473] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.389 [2024-04-27 03:32:39.231656] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.389 [2024-04-27 03:32:39.232055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.232202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.389 [2024-04-27 03:32:39.232230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.390 [2024-04-27 03:32:39.232255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.390 [2024-04-27 03:32:39.232494] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.390 [2024-04-27 03:32:39.232734] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.390 [2024-04-27 03:32:39.232757] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.390 [2024-04-27 03:32:39.232771] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.390 [2024-04-27 03:32:39.236316] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.390 [2024-04-27 03:32:39.245501] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.390 [2024-04-27 03:32:39.245878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.246000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.246027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.390 [2024-04-27 03:32:39.246043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.390 [2024-04-27 03:32:39.246291] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.390 [2024-04-27 03:32:39.246532] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.390 [2024-04-27 03:32:39.246555] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.390 [2024-04-27 03:32:39.246570] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.390 [2024-04-27 03:32:39.250107] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.390 [2024-04-27 03:32:39.259500] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.390 [2024-04-27 03:32:39.259884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.260034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.260062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.390 [2024-04-27 03:32:39.260080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.390 [2024-04-27 03:32:39.260327] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.390 [2024-04-27 03:32:39.260568] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.390 [2024-04-27 03:32:39.260592] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.390 [2024-04-27 03:32:39.260606] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.390 [2024-04-27 03:32:39.264139] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.390 [2024-04-27 03:32:39.273324] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.390 [2024-04-27 03:32:39.273737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.273907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.273935] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.390 [2024-04-27 03:32:39.273952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.390 [2024-04-27 03:32:39.274188] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.390 [2024-04-27 03:32:39.274438] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.390 [2024-04-27 03:32:39.274462] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.390 [2024-04-27 03:32:39.274477] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.390 [2024-04-27 03:32:39.278010] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.390 [2024-04-27 03:32:39.287194] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.390 [2024-04-27 03:32:39.287558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.287715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.287743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.390 [2024-04-27 03:32:39.287760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.390 [2024-04-27 03:32:39.287996] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.390 [2024-04-27 03:32:39.288236] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.390 [2024-04-27 03:32:39.288270] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.390 [2024-04-27 03:32:39.288286] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.390 [2024-04-27 03:32:39.291821] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.390 [2024-04-27 03:32:39.301002] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.390 [2024-04-27 03:32:39.301410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.301579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.301611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.390 [2024-04-27 03:32:39.301629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.390 [2024-04-27 03:32:39.301865] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.390 [2024-04-27 03:32:39.302106] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.390 [2024-04-27 03:32:39.302128] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.390 [2024-04-27 03:32:39.302143] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.390 [2024-04-27 03:32:39.305686] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.390 [2024-04-27 03:32:39.314870] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.390 [2024-04-27 03:32:39.315258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.315403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.315432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.390 [2024-04-27 03:32:39.315448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.390 [2024-04-27 03:32:39.315685] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.390 [2024-04-27 03:32:39.315926] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.390 [2024-04-27 03:32:39.315949] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.390 [2024-04-27 03:32:39.315963] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.390 [2024-04-27 03:32:39.319505] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.390 [2024-04-27 03:32:39.328690] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.390 [2024-04-27 03:32:39.329090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.329304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.329351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.390 [2024-04-27 03:32:39.329368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.390 [2024-04-27 03:32:39.329604] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.390 [2024-04-27 03:32:39.329843] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.390 [2024-04-27 03:32:39.329866] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.390 [2024-04-27 03:32:39.329881] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.390 [2024-04-27 03:32:39.333425] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.390 [2024-04-27 03:32:39.342616] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.390 [2024-04-27 03:32:39.343027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.343175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.343203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.390 [2024-04-27 03:32:39.343225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.390 [2024-04-27 03:32:39.343472] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.390 [2024-04-27 03:32:39.343711] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.390 [2024-04-27 03:32:39.343735] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.390 [2024-04-27 03:32:39.343749] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.390 [2024-04-27 03:32:39.347291] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.390 [2024-04-27 03:32:39.356479] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.390 [2024-04-27 03:32:39.356874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.357019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.390 [2024-04-27 03:32:39.357047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.390 [2024-04-27 03:32:39.357063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.390 [2024-04-27 03:32:39.357310] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.390 [2024-04-27 03:32:39.357551] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.390 [2024-04-27 03:32:39.357574] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.390 [2024-04-27 03:32:39.357588] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.391 [2024-04-27 03:32:39.361198] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.652 [2024-04-27 03:32:39.370378] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.652 [2024-04-27 03:32:39.370756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.652 [2024-04-27 03:32:39.370927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.652 [2024-04-27 03:32:39.370955] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.652 [2024-04-27 03:32:39.370973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.652 [2024-04-27 03:32:39.371222] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.652 [2024-04-27 03:32:39.371473] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.652 [2024-04-27 03:32:39.371497] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.652 [2024-04-27 03:32:39.371512] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.652 [2024-04-27 03:32:39.375052] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.652 [2024-04-27 03:32:39.384261] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.652 [2024-04-27 03:32:39.384632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.652 [2024-04-27 03:32:39.384805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.652 [2024-04-27 03:32:39.384832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.652 [2024-04-27 03:32:39.384849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.652 [2024-04-27 03:32:39.385091] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.652 [2024-04-27 03:32:39.385345] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.652 [2024-04-27 03:32:39.385377] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.652 [2024-04-27 03:32:39.385392] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.652 [2024-04-27 03:32:39.388928] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.652 [2024-04-27 03:32:39.398255] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.652 [2024-04-27 03:32:39.398660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.652 [2024-04-27 03:32:39.398813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.652 [2024-04-27 03:32:39.398842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.652 [2024-04-27 03:32:39.398860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.652 [2024-04-27 03:32:39.399103] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.652 [2024-04-27 03:32:39.399371] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.652 [2024-04-27 03:32:39.399397] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.652 [2024-04-27 03:32:39.399412] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.652 [2024-04-27 03:32:39.403059] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.652 [2024-04-27 03:32:39.412318] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.652 [2024-04-27 03:32:39.412711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.652 [2024-04-27 03:32:39.412875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.652 [2024-04-27 03:32:39.412903] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.652 [2024-04-27 03:32:39.412927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.652 [2024-04-27 03:32:39.413173] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.652 [2024-04-27 03:32:39.413431] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.652 [2024-04-27 03:32:39.413456] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.652 [2024-04-27 03:32:39.413479] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.652 [2024-04-27 03:32:39.417124] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.652 [2024-04-27 03:32:39.426154] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.652 [2024-04-27 03:32:39.426560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.652 [2024-04-27 03:32:39.426706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.652 [2024-04-27 03:32:39.426734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.652 [2024-04-27 03:32:39.426751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.652 [2024-04-27 03:32:39.426986] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.652 [2024-04-27 03:32:39.427236] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.652 [2024-04-27 03:32:39.427270] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.652 [2024-04-27 03:32:39.427296] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.652 [2024-04-27 03:32:39.430834] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.652 [2024-04-27 03:32:39.440037] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.652 [2024-04-27 03:32:39.440426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.440555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.440582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.653 [2024-04-27 03:32:39.440600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.653 [2024-04-27 03:32:39.440836] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.653 [2024-04-27 03:32:39.441076] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.653 [2024-04-27 03:32:39.441100] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.653 [2024-04-27 03:32:39.441115] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.653 [2024-04-27 03:32:39.444661] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.653 [2024-04-27 03:32:39.453857] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.653 [2024-04-27 03:32:39.454259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.454406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.454434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.653 [2024-04-27 03:32:39.454451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.653 [2024-04-27 03:32:39.454687] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.653 [2024-04-27 03:32:39.454927] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.653 [2024-04-27 03:32:39.454951] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.653 [2024-04-27 03:32:39.454966] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.653 [2024-04-27 03:32:39.458517] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.653 [2024-04-27 03:32:39.467707] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.653 [2024-04-27 03:32:39.468091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.468239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.468275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.653 [2024-04-27 03:32:39.468293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.653 [2024-04-27 03:32:39.468529] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.653 [2024-04-27 03:32:39.468769] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.653 [2024-04-27 03:32:39.468797] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.653 [2024-04-27 03:32:39.468814] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.653 [2024-04-27 03:32:39.472361] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.653 [2024-04-27 03:32:39.481819] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.653 [2024-04-27 03:32:39.482211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.482390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.482419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.653 [2024-04-27 03:32:39.482437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.653 [2024-04-27 03:32:39.482679] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.653 [2024-04-27 03:32:39.482932] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.653 [2024-04-27 03:32:39.482956] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.653 [2024-04-27 03:32:39.482971] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.653 [2024-04-27 03:32:39.486626] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.653 [2024-04-27 03:32:39.495796] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.653 [2024-04-27 03:32:39.496194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.496336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.496365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.653 [2024-04-27 03:32:39.496383] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.653 [2024-04-27 03:32:39.496619] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.653 [2024-04-27 03:32:39.496858] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.653 [2024-04-27 03:32:39.496882] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.653 [2024-04-27 03:32:39.496896] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.653 [2024-04-27 03:32:39.500446] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.653 [2024-04-27 03:32:39.509650] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.653 [2024-04-27 03:32:39.510054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.510225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.510260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.653 [2024-04-27 03:32:39.510279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.653 [2024-04-27 03:32:39.510515] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.653 [2024-04-27 03:32:39.510754] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.653 [2024-04-27 03:32:39.510777] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.653 [2024-04-27 03:32:39.510798] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.653 [2024-04-27 03:32:39.514345] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.653 [2024-04-27 03:32:39.523546] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.653 [2024-04-27 03:32:39.523928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.524095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.524123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.653 [2024-04-27 03:32:39.524140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.653 [2024-04-27 03:32:39.524386] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.653 [2024-04-27 03:32:39.524627] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.653 [2024-04-27 03:32:39.524651] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.653 [2024-04-27 03:32:39.524665] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.653 [2024-04-27 03:32:39.528208] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.653 [2024-04-27 03:32:39.537419] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.653 [2024-04-27 03:32:39.537796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.537970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.537998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.653 [2024-04-27 03:32:39.538015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.653 [2024-04-27 03:32:39.538260] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.653 [2024-04-27 03:32:39.538500] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.653 [2024-04-27 03:32:39.538524] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.653 [2024-04-27 03:32:39.538539] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.653 [2024-04-27 03:32:39.542079] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.653 [2024-04-27 03:32:39.551273] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.653 [2024-04-27 03:32:39.551670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.551794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.551820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.653 [2024-04-27 03:32:39.551837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.653 [2024-04-27 03:32:39.552073] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.653 [2024-04-27 03:32:39.552324] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.653 [2024-04-27 03:32:39.552348] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.653 [2024-04-27 03:32:39.552363] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.653 [2024-04-27 03:32:39.555904] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.653 [2024-04-27 03:32:39.565093] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.653 [2024-04-27 03:32:39.565510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.565646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.653 [2024-04-27 03:32:39.565673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.654 [2024-04-27 03:32:39.565690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.654 [2024-04-27 03:32:39.565926] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.654 [2024-04-27 03:32:39.566166] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.654 [2024-04-27 03:32:39.566189] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.654 [2024-04-27 03:32:39.566203] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.654 [2024-04-27 03:32:39.569750] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.654 [2024-04-27 03:32:39.578941] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.654 [2024-04-27 03:32:39.579348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.654 [2024-04-27 03:32:39.579468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.654 [2024-04-27 03:32:39.579496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.654 [2024-04-27 03:32:39.579513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.654 [2024-04-27 03:32:39.579749] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.654 [2024-04-27 03:32:39.579989] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.654 [2024-04-27 03:32:39.580011] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.654 [2024-04-27 03:32:39.580026] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.654 [2024-04-27 03:32:39.583571] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.654 [2024-04-27 03:32:39.592776] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.654 [2024-04-27 03:32:39.593174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.654 [2024-04-27 03:32:39.593317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.654 [2024-04-27 03:32:39.593346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.654 [2024-04-27 03:32:39.593363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.654 [2024-04-27 03:32:39.593599] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.654 [2024-04-27 03:32:39.593838] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.654 [2024-04-27 03:32:39.593861] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.654 [2024-04-27 03:32:39.593876] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.654 [2024-04-27 03:32:39.597421] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.654 [2024-04-27 03:32:39.606615] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.654 [2024-04-27 03:32:39.606994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.654 [2024-04-27 03:32:39.607141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.654 [2024-04-27 03:32:39.607168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.654 [2024-04-27 03:32:39.607185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.654 [2024-04-27 03:32:39.607430] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.654 [2024-04-27 03:32:39.607671] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.654 [2024-04-27 03:32:39.607694] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.654 [2024-04-27 03:32:39.607708] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.654 [2024-04-27 03:32:39.611241] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.654 [2024-04-27 03:32:39.620426] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.654 [2024-04-27 03:32:39.620805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.654 [2024-04-27 03:32:39.620963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.654 [2024-04-27 03:32:39.620991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.654 [2024-04-27 03:32:39.621008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.654 [2024-04-27 03:32:39.621244] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.654 [2024-04-27 03:32:39.621493] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.654 [2024-04-27 03:32:39.621516] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.654 [2024-04-27 03:32:39.621531] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.654 [2024-04-27 03:32:39.625180] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.916 [2024-04-27 03:32:39.633929] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.916 [2024-04-27 03:32:39.634293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.916 [2024-04-27 03:32:39.634453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.916 [2024-04-27 03:32:39.634479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.916 [2024-04-27 03:32:39.634494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.916 [2024-04-27 03:32:39.634735] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.916 [2024-04-27 03:32:39.634962] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.916 [2024-04-27 03:32:39.635002] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.916 [2024-04-27 03:32:39.635016] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.916 [2024-04-27 03:32:39.638009] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.916 [2024-04-27 03:32:39.647190] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.916 [2024-04-27 03:32:39.647640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.916 [2024-04-27 03:32:39.647823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.916 [2024-04-27 03:32:39.647848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.916 [2024-04-27 03:32:39.647863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.916 [2024-04-27 03:32:39.648110] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.916 [2024-04-27 03:32:39.648335] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.916 [2024-04-27 03:32:39.648356] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.916 [2024-04-27 03:32:39.648369] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.916 [2024-04-27 03:32:39.651327] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.916 [2024-04-27 03:32:39.660361] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.916 [2024-04-27 03:32:39.660696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.916 [2024-04-27 03:32:39.660834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.916 [2024-04-27 03:32:39.660859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.916 [2024-04-27 03:32:39.660874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.916 [2024-04-27 03:32:39.661126] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.916 [2024-04-27 03:32:39.661353] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.916 [2024-04-27 03:32:39.661374] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.916 [2024-04-27 03:32:39.661386] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.916 [2024-04-27 03:32:39.664343] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.916 [2024-04-27 03:32:39.673611] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.916 [2024-04-27 03:32:39.673950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.916 [2024-04-27 03:32:39.674094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.916 [2024-04-27 03:32:39.674119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.916 [2024-04-27 03:32:39.674134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.916 [2024-04-27 03:32:39.674373] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.916 [2024-04-27 03:32:39.674596] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.916 [2024-04-27 03:32:39.674615] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.916 [2024-04-27 03:32:39.674628] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.916 [2024-04-27 03:32:39.677644] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.916 [2024-04-27 03:32:39.686863] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.916 [2024-04-27 03:32:39.687252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.916 [2024-04-27 03:32:39.687400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.916 [2024-04-27 03:32:39.687430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.916 [2024-04-27 03:32:39.687446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.916 [2024-04-27 03:32:39.687697] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.916 [2024-04-27 03:32:39.687895] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.916 [2024-04-27 03:32:39.687913] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.916 [2024-04-27 03:32:39.687926] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.917 [2024-04-27 03:32:39.690874] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.917 [2024-04-27 03:32:39.700025] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.917 [2024-04-27 03:32:39.700430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.700534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.700559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.917 [2024-04-27 03:32:39.700574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.917 [2024-04-27 03:32:39.700800] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.917 [2024-04-27 03:32:39.701013] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.917 [2024-04-27 03:32:39.701032] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.917 [2024-04-27 03:32:39.701044] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.917 [2024-04-27 03:32:39.704003] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.917 [2024-04-27 03:32:39.713172] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.917 [2024-04-27 03:32:39.713521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.713663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.713688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.917 [2024-04-27 03:32:39.713703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.917 [2024-04-27 03:32:39.713943] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.917 [2024-04-27 03:32:39.714156] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.917 [2024-04-27 03:32:39.714174] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.917 [2024-04-27 03:32:39.714187] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.917 [2024-04-27 03:32:39.717147] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.917 [2024-04-27 03:32:39.726365] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.917 [2024-04-27 03:32:39.726787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.726941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.726966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.917 [2024-04-27 03:32:39.726986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.917 [2024-04-27 03:32:39.727224] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.917 [2024-04-27 03:32:39.727450] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.917 [2024-04-27 03:32:39.727470] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.917 [2024-04-27 03:32:39.727483] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.917 [2024-04-27 03:32:39.730431] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.917 [2024-04-27 03:32:39.739654] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.917 [2024-04-27 03:32:39.740054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.740207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.740232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.917 [2024-04-27 03:32:39.740255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.917 [2024-04-27 03:32:39.740484] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.917 [2024-04-27 03:32:39.740713] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.917 [2024-04-27 03:32:39.740733] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.917 [2024-04-27 03:32:39.740745] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.917 [2024-04-27 03:32:39.743696] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.917 [2024-04-27 03:32:39.753031] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.917 [2024-04-27 03:32:39.753409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.753546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.753571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.917 [2024-04-27 03:32:39.753586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.917 [2024-04-27 03:32:39.753812] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.917 [2024-04-27 03:32:39.754025] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.917 [2024-04-27 03:32:39.754044] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.917 [2024-04-27 03:32:39.754057] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.917 [2024-04-27 03:32:39.757073] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.917 [2024-04-27 03:32:39.766359] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.917 [2024-04-27 03:32:39.766732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.766832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.766857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.917 [2024-04-27 03:32:39.766871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.917 [2024-04-27 03:32:39.767096] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.917 [2024-04-27 03:32:39.767327] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.917 [2024-04-27 03:32:39.767348] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.917 [2024-04-27 03:32:39.767361] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.917 [2024-04-27 03:32:39.770550] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.917 [2024-04-27 03:32:39.779774] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.917 [2024-04-27 03:32:39.780117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.780284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.780320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.917 [2024-04-27 03:32:39.780335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.917 [2024-04-27 03:32:39.780561] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.917 [2024-04-27 03:32:39.780775] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.917 [2024-04-27 03:32:39.780794] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.917 [2024-04-27 03:32:39.780806] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.917 [2024-04-27 03:32:39.783822] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.917 [2024-04-27 03:32:39.793179] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.917 [2024-04-27 03:32:39.793563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.793726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.793751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.917 [2024-04-27 03:32:39.793766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.917 [2024-04-27 03:32:39.793993] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.917 [2024-04-27 03:32:39.794208] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.917 [2024-04-27 03:32:39.794241] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.917 [2024-04-27 03:32:39.794264] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.917 [2024-04-27 03:32:39.797349] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.917 [2024-04-27 03:32:39.806487] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.917 [2024-04-27 03:32:39.806871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.807087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.807113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.917 [2024-04-27 03:32:39.807128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.917 [2024-04-27 03:32:39.807382] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.917 [2024-04-27 03:32:39.807618] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.917 [2024-04-27 03:32:39.807638] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.917 [2024-04-27 03:32:39.807650] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.917 [2024-04-27 03:32:39.810738] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.917 [2024-04-27 03:32:39.819798] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.917 [2024-04-27 03:32:39.820137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.820307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.917 [2024-04-27 03:32:39.820334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.918 [2024-04-27 03:32:39.820349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.918 [2024-04-27 03:32:39.820576] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.918 [2024-04-27 03:32:39.820789] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.918 [2024-04-27 03:32:39.820809] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.918 [2024-04-27 03:32:39.820821] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.918 [2024-04-27 03:32:39.823779] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.918 [2024-04-27 03:32:39.833043] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.918 [2024-04-27 03:32:39.833490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.918 [2024-04-27 03:32:39.833701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.918 [2024-04-27 03:32:39.833726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.918 [2024-04-27 03:32:39.833742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.918 [2024-04-27 03:32:39.833993] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.918 [2024-04-27 03:32:39.834189] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.918 [2024-04-27 03:32:39.834208] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.918 [2024-04-27 03:32:39.834220] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.918 [2024-04-27 03:32:39.837212] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.918 [2024-04-27 03:32:39.846307] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.918 [2024-04-27 03:32:39.846735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.918 [2024-04-27 03:32:39.846891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.918 [2024-04-27 03:32:39.846916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.918 [2024-04-27 03:32:39.846931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.918 [2024-04-27 03:32:39.847170] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.918 [2024-04-27 03:32:39.847396] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.918 [2024-04-27 03:32:39.847421] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.918 [2024-04-27 03:32:39.847434] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.918 [2024-04-27 03:32:39.850386] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.918 [2024-04-27 03:32:39.859596] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.918 [2024-04-27 03:32:39.859976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.918 [2024-04-27 03:32:39.860087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.918 [2024-04-27 03:32:39.860113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.918 [2024-04-27 03:32:39.860128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.918 [2024-04-27 03:32:39.860381] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.918 [2024-04-27 03:32:39.860599] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.918 [2024-04-27 03:32:39.860619] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.918 [2024-04-27 03:32:39.860633] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.918 [2024-04-27 03:32:39.864038] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.918 [2024-04-27 03:32:39.872998] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.918 [2024-04-27 03:32:39.873364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.918 [2024-04-27 03:32:39.873499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.918 [2024-04-27 03:32:39.873524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.918 [2024-04-27 03:32:39.873539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.918 [2024-04-27 03:32:39.873780] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.918 [2024-04-27 03:32:39.873992] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.918 [2024-04-27 03:32:39.874011] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.918 [2024-04-27 03:32:39.874023] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.918 [2024-04-27 03:32:39.877043] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:14.918 [2024-04-27 03:32:39.886343] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:14.918 [2024-04-27 03:32:39.886761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.918 [2024-04-27 03:32:39.886918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:14.918 [2024-04-27 03:32:39.886943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:14.918 [2024-04-27 03:32:39.886959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:14.918 [2024-04-27 03:32:39.887198] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:14.918 [2024-04-27 03:32:39.887432] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:14.918 [2024-04-27 03:32:39.887453] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:14.918 [2024-04-27 03:32:39.887499] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:14.918 [2024-04-27 03:32:39.890596] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.179 [2024-04-27 03:32:39.899717] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.179 [2024-04-27 03:32:39.900135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.179 [2024-04-27 03:32:39.900286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.179 [2024-04-27 03:32:39.900313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.179 [2024-04-27 03:32:39.900328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.179 [2024-04-27 03:32:39.900556] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.179 [2024-04-27 03:32:39.900770] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.179 [2024-04-27 03:32:39.900789] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.179 [2024-04-27 03:32:39.900801] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.179 [2024-04-27 03:32:39.903754] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.179 [2024-04-27 03:32:39.913001] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.179 [2024-04-27 03:32:39.913410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.913523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.913549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.180 [2024-04-27 03:32:39.913565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.180 [2024-04-27 03:32:39.913819] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.180 [2024-04-27 03:32:39.914016] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.180 [2024-04-27 03:32:39.914034] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.180 [2024-04-27 03:32:39.914047] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.180 [2024-04-27 03:32:39.917021] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.180 [2024-04-27 03:32:39.926234] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.180 [2024-04-27 03:32:39.926602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.926737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.926762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.180 [2024-04-27 03:32:39.926777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.180 [2024-04-27 03:32:39.927028] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.180 [2024-04-27 03:32:39.927225] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.180 [2024-04-27 03:32:39.927244] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.180 [2024-04-27 03:32:39.927280] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.180 [2024-04-27 03:32:39.930241] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.180 [2024-04-27 03:32:39.939515] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.180 [2024-04-27 03:32:39.940009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.940181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.940206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.180 [2024-04-27 03:32:39.940221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.180 [2024-04-27 03:32:39.940442] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.180 [2024-04-27 03:32:39.940675] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.180 [2024-04-27 03:32:39.940694] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.180 [2024-04-27 03:32:39.940706] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.180 [2024-04-27 03:32:39.943658] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.180 [2024-04-27 03:32:39.952710] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.180 [2024-04-27 03:32:39.953094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.953201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.953227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.180 [2024-04-27 03:32:39.953242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.180 [2024-04-27 03:32:39.953479] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.180 [2024-04-27 03:32:39.953709] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.180 [2024-04-27 03:32:39.953728] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.180 [2024-04-27 03:32:39.953740] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.180 [2024-04-27 03:32:39.956693] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.180 [2024-04-27 03:32:39.965902] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.180 [2024-04-27 03:32:39.966371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.966519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.966544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.180 [2024-04-27 03:32:39.966559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.180 [2024-04-27 03:32:39.966809] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.180 [2024-04-27 03:32:39.967006] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.180 [2024-04-27 03:32:39.967025] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.180 [2024-04-27 03:32:39.967037] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.180 [2024-04-27 03:32:39.970024] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.180 [2024-04-27 03:32:39.979139] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.180 [2024-04-27 03:32:39.979594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.979736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.979761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.180 [2024-04-27 03:32:39.979776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.180 [2024-04-27 03:32:39.980015] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.180 [2024-04-27 03:32:39.980212] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.180 [2024-04-27 03:32:39.980254] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.180 [2024-04-27 03:32:39.980269] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.180 [2024-04-27 03:32:39.983237] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.180 [2024-04-27 03:32:39.992466] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.180 [2024-04-27 03:32:39.992895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.993037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:39.993061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.180 [2024-04-27 03:32:39.993076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.180 [2024-04-27 03:32:39.993341] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.180 [2024-04-27 03:32:39.993551] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.180 [2024-04-27 03:32:39.993586] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.180 [2024-04-27 03:32:39.993598] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.180 [2024-04-27 03:32:39.996533] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.180 [2024-04-27 03:32:40.006707] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.180 [2024-04-27 03:32:40.007068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:40.007214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:40.007241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.180 [2024-04-27 03:32:40.007268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.180 [2024-04-27 03:32:40.007489] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.180 [2024-04-27 03:32:40.007720] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.180 [2024-04-27 03:32:40.007740] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.180 [2024-04-27 03:32:40.007754] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.180 [2024-04-27 03:32:40.011000] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.180 [2024-04-27 03:32:40.020331] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.180 [2024-04-27 03:32:40.020688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:40.020836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.180 [2024-04-27 03:32:40.020861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.180 [2024-04-27 03:32:40.020877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.180 [2024-04-27 03:32:40.021090] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.180 [2024-04-27 03:32:40.021350] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.180 [2024-04-27 03:32:40.021372] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.180 [2024-04-27 03:32:40.021386] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.180 [2024-04-27 03:32:40.024670] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.181 [2024-04-27 03:32:40.033778] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.181 [2024-04-27 03:32:40.034195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.034350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.034376] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.181 [2024-04-27 03:32:40.034392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.181 [2024-04-27 03:32:40.034606] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.181 [2024-04-27 03:32:40.034833] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.181 [2024-04-27 03:32:40.034853] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.181 [2024-04-27 03:32:40.034868] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.181 [2024-04-27 03:32:40.038205] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.181 [2024-04-27 03:32:40.047106] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.181 [2024-04-27 03:32:40.047489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.047609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.047633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.181 [2024-04-27 03:32:40.047648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.181 [2024-04-27 03:32:40.047900] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.181 [2024-04-27 03:32:40.048097] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.181 [2024-04-27 03:32:40.048115] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.181 [2024-04-27 03:32:40.048128] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.181 [2024-04-27 03:32:40.051192] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.181 [2024-04-27 03:32:40.060441] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.181 [2024-04-27 03:32:40.060889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.061064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.061095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.181 [2024-04-27 03:32:40.061112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.181 [2024-04-27 03:32:40.061346] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.181 [2024-04-27 03:32:40.061572] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.181 [2024-04-27 03:32:40.061608] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.181 [2024-04-27 03:32:40.061620] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.181 [2024-04-27 03:32:40.064691] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.181 [2024-04-27 03:32:40.073949] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.181 [2024-04-27 03:32:40.074338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.074454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.074479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.181 [2024-04-27 03:32:40.074495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.181 [2024-04-27 03:32:40.074722] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.181 [2024-04-27 03:32:40.074951] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.181 [2024-04-27 03:32:40.074970] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.181 [2024-04-27 03:32:40.074982] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.181 [2024-04-27 03:32:40.078089] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.181 [2024-04-27 03:32:40.087307] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.181 [2024-04-27 03:32:40.087720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.087881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.087906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.181 [2024-04-27 03:32:40.087922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.181 [2024-04-27 03:32:40.088133] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.181 [2024-04-27 03:32:40.088367] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.181 [2024-04-27 03:32:40.088389] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.181 [2024-04-27 03:32:40.088402] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.181 [2024-04-27 03:32:40.091445] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.181 [2024-04-27 03:32:40.100600] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.181 [2024-04-27 03:32:40.100973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.101108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.101133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.181 [2024-04-27 03:32:40.101153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.181 [2024-04-27 03:32:40.101402] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.181 [2024-04-27 03:32:40.101620] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.181 [2024-04-27 03:32:40.101639] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.181 [2024-04-27 03:32:40.101651] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.181 [2024-04-27 03:32:40.104726] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.181 [2024-04-27 03:32:40.113844] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.181 [2024-04-27 03:32:40.114227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.114364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.114389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.181 [2024-04-27 03:32:40.114404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.181 [2024-04-27 03:32:40.114617] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.181 [2024-04-27 03:32:40.114832] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.181 [2024-04-27 03:32:40.114853] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.181 [2024-04-27 03:32:40.114866] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.181 [2024-04-27 03:32:40.118215] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.181 [2024-04-27 03:32:40.127186] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.181 [2024-04-27 03:32:40.127566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.127728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.127753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.181 [2024-04-27 03:32:40.127769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.181 [2024-04-27 03:32:40.128009] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.181 [2024-04-27 03:32:40.128226] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.181 [2024-04-27 03:32:40.128267] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.181 [2024-04-27 03:32:40.128281] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.181 [2024-04-27 03:32:40.131394] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.181 [2024-04-27 03:32:40.140906] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.181 [2024-04-27 03:32:40.141327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.141438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.141464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.181 [2024-04-27 03:32:40.141480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.181 [2024-04-27 03:32:40.141713] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.181 [2024-04-27 03:32:40.141927] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.181 [2024-04-27 03:32:40.141946] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.181 [2024-04-27 03:32:40.141958] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.181 [2024-04-27 03:32:40.144990] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.181 [2024-04-27 03:32:40.154403] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.181 [2024-04-27 03:32:40.154832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.154963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.181 [2024-04-27 03:32:40.154992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.181 [2024-04-27 03:32:40.155007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.182 [2024-04-27 03:32:40.155259] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.445 [2024-04-27 03:32:40.155462] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.445 [2024-04-27 03:32:40.155484] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.445 [2024-04-27 03:32:40.155497] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.445 [2024-04-27 03:32:40.158575] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.445 [2024-04-27 03:32:40.167754] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.445 [2024-04-27 03:32:40.168145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.168311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.168337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.445 [2024-04-27 03:32:40.168353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.445 [2024-04-27 03:32:40.168566] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.445 [2024-04-27 03:32:40.168777] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.445 [2024-04-27 03:32:40.168810] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.445 [2024-04-27 03:32:40.168823] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.445 [2024-04-27 03:32:40.171875] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.445 [2024-04-27 03:32:40.181066] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.445 [2024-04-27 03:32:40.181527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.181684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.181713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.445 [2024-04-27 03:32:40.181728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.445 [2024-04-27 03:32:40.181954] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.445 [2024-04-27 03:32:40.182172] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.445 [2024-04-27 03:32:40.182192] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.445 [2024-04-27 03:32:40.182204] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.445 [2024-04-27 03:32:40.185231] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.445 [2024-04-27 03:32:40.194990] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.445 [2024-04-27 03:32:40.195375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.195556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.195581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.445 [2024-04-27 03:32:40.195597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.445 [2024-04-27 03:32:40.195823] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.445 [2024-04-27 03:32:40.196079] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.445 [2024-04-27 03:32:40.196103] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.445 [2024-04-27 03:32:40.196118] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.445 [2024-04-27 03:32:40.199660] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.445 [2024-04-27 03:32:40.208857] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.445 [2024-04-27 03:32:40.209283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.209423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.209448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.445 [2024-04-27 03:32:40.209463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.445 [2024-04-27 03:32:40.209715] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.445 [2024-04-27 03:32:40.209965] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.445 [2024-04-27 03:32:40.209988] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.445 [2024-04-27 03:32:40.210003] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.445 [2024-04-27 03:32:40.213552] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.445 [2024-04-27 03:32:40.222759] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.445 [2024-04-27 03:32:40.223168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.223329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.223356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.445 [2024-04-27 03:32:40.223371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.445 [2024-04-27 03:32:40.223609] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.445 [2024-04-27 03:32:40.223860] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.445 [2024-04-27 03:32:40.223889] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.445 [2024-04-27 03:32:40.223905] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.445 [2024-04-27 03:32:40.227455] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.445 [2024-04-27 03:32:40.236648] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.445 [2024-04-27 03:32:40.237059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.237226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.237263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.445 [2024-04-27 03:32:40.237282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.445 [2024-04-27 03:32:40.237518] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.445 [2024-04-27 03:32:40.237759] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.445 [2024-04-27 03:32:40.237782] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.445 [2024-04-27 03:32:40.237796] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.445 [2024-04-27 03:32:40.241343] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.445 [2024-04-27 03:32:40.250538] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.445 [2024-04-27 03:32:40.250941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.251093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.251118] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.445 [2024-04-27 03:32:40.251133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.445 [2024-04-27 03:32:40.251374] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.445 [2024-04-27 03:32:40.251629] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.445 [2024-04-27 03:32:40.251652] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.445 [2024-04-27 03:32:40.251667] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.445 [2024-04-27 03:32:40.255205] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.445 [2024-04-27 03:32:40.264428] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.445 [2024-04-27 03:32:40.264807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.264990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.445 [2024-04-27 03:32:40.265015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.445 [2024-04-27 03:32:40.265030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.445 [2024-04-27 03:32:40.265304] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.445 [2024-04-27 03:32:40.265557] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.445 [2024-04-27 03:32:40.265580] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.446 [2024-04-27 03:32:40.265601] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.446 [2024-04-27 03:32:40.269140] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.446 [2024-04-27 03:32:40.278339] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.446 [2024-04-27 03:32:40.278719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.278862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.278890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.446 [2024-04-27 03:32:40.278907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.446 [2024-04-27 03:32:40.279142] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.446 [2024-04-27 03:32:40.279396] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.446 [2024-04-27 03:32:40.279419] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.446 [2024-04-27 03:32:40.279434] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.446 [2024-04-27 03:32:40.282970] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.446 [2024-04-27 03:32:40.292163] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.446 [2024-04-27 03:32:40.292570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.292741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.292769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.446 [2024-04-27 03:32:40.292786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.446 [2024-04-27 03:32:40.293022] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.446 [2024-04-27 03:32:40.293276] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.446 [2024-04-27 03:32:40.293299] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.446 [2024-04-27 03:32:40.293314] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.446 [2024-04-27 03:32:40.296852] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.446 [2024-04-27 03:32:40.306042] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.446 [2024-04-27 03:32:40.306453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.306621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.306649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.446 [2024-04-27 03:32:40.306666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.446 [2024-04-27 03:32:40.306902] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.446 [2024-04-27 03:32:40.307142] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.446 [2024-04-27 03:32:40.307164] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.446 [2024-04-27 03:32:40.307179] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.446 [2024-04-27 03:32:40.310726] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.446 [2024-04-27 03:32:40.319911] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.446 [2024-04-27 03:32:40.320289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.320432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.320460] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.446 [2024-04-27 03:32:40.320477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.446 [2024-04-27 03:32:40.320714] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.446 [2024-04-27 03:32:40.320954] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.446 [2024-04-27 03:32:40.320976] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.446 [2024-04-27 03:32:40.320992] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.446 [2024-04-27 03:32:40.324541] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.446 [2024-04-27 03:32:40.333734] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.446 [2024-04-27 03:32:40.334114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.334271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.334300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.446 [2024-04-27 03:32:40.334317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.446 [2024-04-27 03:32:40.334553] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.446 [2024-04-27 03:32:40.334793] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.446 [2024-04-27 03:32:40.334815] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.446 [2024-04-27 03:32:40.334830] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.446 [2024-04-27 03:32:40.338379] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.446 [2024-04-27 03:32:40.347573] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.446 [2024-04-27 03:32:40.347973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.348144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.348172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.446 [2024-04-27 03:32:40.348189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.446 [2024-04-27 03:32:40.348438] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.446 [2024-04-27 03:32:40.348679] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.446 [2024-04-27 03:32:40.348702] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.446 [2024-04-27 03:32:40.348716] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.446 [2024-04-27 03:32:40.352266] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.446 [2024-04-27 03:32:40.361471] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.446 [2024-04-27 03:32:40.361870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.361998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.362026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.446 [2024-04-27 03:32:40.362043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.446 [2024-04-27 03:32:40.362292] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.446 [2024-04-27 03:32:40.362533] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.446 [2024-04-27 03:32:40.362557] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.446 [2024-04-27 03:32:40.362571] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.446 [2024-04-27 03:32:40.366110] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.446 [2024-04-27 03:32:40.375308] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.446 [2024-04-27 03:32:40.375687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.375807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.375835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.446 [2024-04-27 03:32:40.375852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.446 [2024-04-27 03:32:40.376087] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.446 [2024-04-27 03:32:40.376336] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.446 [2024-04-27 03:32:40.376360] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.446 [2024-04-27 03:32:40.376375] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.446 [2024-04-27 03:32:40.379907] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.446 [2024-04-27 03:32:40.389307] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.446 [2024-04-27 03:32:40.389688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.389851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.389879] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.446 [2024-04-27 03:32:40.389896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.446 [2024-04-27 03:32:40.390132] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.446 [2024-04-27 03:32:40.390385] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.446 [2024-04-27 03:32:40.390409] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.446 [2024-04-27 03:32:40.390423] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.446 [2024-04-27 03:32:40.393958] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.446 [2024-04-27 03:32:40.403144] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.446 [2024-04-27 03:32:40.403555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.446 [2024-04-27 03:32:40.403692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.447 [2024-04-27 03:32:40.403720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.447 [2024-04-27 03:32:40.403737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.447 [2024-04-27 03:32:40.403973] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.447 [2024-04-27 03:32:40.404213] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.447 [2024-04-27 03:32:40.404235] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.447 [2024-04-27 03:32:40.404261] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.447 [2024-04-27 03:32:40.407802] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.447 [2024-04-27 03:32:40.417087] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.447 [2024-04-27 03:32:40.417536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.447 [2024-04-27 03:32:40.417780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.447 [2024-04-27 03:32:40.417809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.447 [2024-04-27 03:32:40.417825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.447 [2024-04-27 03:32:40.418062] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.447 [2024-04-27 03:32:40.418326] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.447 [2024-04-27 03:32:40.418351] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.447 [2024-04-27 03:32:40.418366] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.709 [2024-04-27 03:32:40.421976] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.709 [2024-04-27 03:32:40.431041] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.709 [2024-04-27 03:32:40.431453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.709 [2024-04-27 03:32:40.431590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.709 [2024-04-27 03:32:40.431637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.709 [2024-04-27 03:32:40.431654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.709 [2024-04-27 03:32:40.431891] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.709 [2024-04-27 03:32:40.432131] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.709 [2024-04-27 03:32:40.432154] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.709 [2024-04-27 03:32:40.432169] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.709 [2024-04-27 03:32:40.435714] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.709 [2024-04-27 03:32:40.444893] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.709 [2024-04-27 03:32:40.445271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.709 [2024-04-27 03:32:40.445447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.709 [2024-04-27 03:32:40.445476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.709 [2024-04-27 03:32:40.445493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.709 [2024-04-27 03:32:40.445730] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.709 [2024-04-27 03:32:40.445970] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.709 [2024-04-27 03:32:40.445992] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.709 [2024-04-27 03:32:40.446007] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.709 [2024-04-27 03:32:40.449555] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.709 [2024-04-27 03:32:40.458737] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.709 [2024-04-27 03:32:40.459137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.709 [2024-04-27 03:32:40.459259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.709 [2024-04-27 03:32:40.459288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.709 [2024-04-27 03:32:40.459305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.709 [2024-04-27 03:32:40.459541] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.709 [2024-04-27 03:32:40.459780] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.709 [2024-04-27 03:32:40.459803] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.709 [2024-04-27 03:32:40.459817] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.709 [2024-04-27 03:32:40.463358] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.709 [2024-04-27 03:32:40.472547] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.709 [2024-04-27 03:32:40.472952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.709 [2024-04-27 03:32:40.473097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.709 [2024-04-27 03:32:40.473126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.709 [2024-04-27 03:32:40.473142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.709 [2024-04-27 03:32:40.473390] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.709 [2024-04-27 03:32:40.473631] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.709 [2024-04-27 03:32:40.473654] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.710 [2024-04-27 03:32:40.473669] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.710 [2024-04-27 03:32:40.477201] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.710 [2024-04-27 03:32:40.486390] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.710 [2024-04-27 03:32:40.486765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.486930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.486977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.710 [2024-04-27 03:32:40.487001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.710 [2024-04-27 03:32:40.487237] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.710 [2024-04-27 03:32:40.487490] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.710 [2024-04-27 03:32:40.487512] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.710 [2024-04-27 03:32:40.487527] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.710 [2024-04-27 03:32:40.491064] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.710 [2024-04-27 03:32:40.500257] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.710 [2024-04-27 03:32:40.500657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.500783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.500811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.710 [2024-04-27 03:32:40.500828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.710 [2024-04-27 03:32:40.501063] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.710 [2024-04-27 03:32:40.501316] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.710 [2024-04-27 03:32:40.501340] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.710 [2024-04-27 03:32:40.501355] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.710 [2024-04-27 03:32:40.504893] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.710 [2024-04-27 03:32:40.514092] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.710 [2024-04-27 03:32:40.514492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.514659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.514687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.710 [2024-04-27 03:32:40.514704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.710 [2024-04-27 03:32:40.514940] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.710 [2024-04-27 03:32:40.515180] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.710 [2024-04-27 03:32:40.515203] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.710 [2024-04-27 03:32:40.515217] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.710 [2024-04-27 03:32:40.518762] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.710 [2024-04-27 03:32:40.527958] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.710 [2024-04-27 03:32:40.528335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.528462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.528489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.710 [2024-04-27 03:32:40.528506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.710 [2024-04-27 03:32:40.528752] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.710 [2024-04-27 03:32:40.528992] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.710 [2024-04-27 03:32:40.529015] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.710 [2024-04-27 03:32:40.529030] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.710 [2024-04-27 03:32:40.532579] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.710 [2024-04-27 03:32:40.541770] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.710 [2024-04-27 03:32:40.542161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.542309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.542338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.710 [2024-04-27 03:32:40.542355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.710 [2024-04-27 03:32:40.542592] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.710 [2024-04-27 03:32:40.542832] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.710 [2024-04-27 03:32:40.542855] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.710 [2024-04-27 03:32:40.542870] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.710 [2024-04-27 03:32:40.546414] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.710 [2024-04-27 03:32:40.555686] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.710 [2024-04-27 03:32:40.556101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.556275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.556305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.710 [2024-04-27 03:32:40.556322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.710 [2024-04-27 03:32:40.556566] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.710 [2024-04-27 03:32:40.556813] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.710 [2024-04-27 03:32:40.556837] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.710 [2024-04-27 03:32:40.556852] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.710 [2024-04-27 03:32:40.560531] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.710 [2024-04-27 03:32:40.569803] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.710 [2024-04-27 03:32:40.570217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.570352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.570381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.710 [2024-04-27 03:32:40.570399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.710 [2024-04-27 03:32:40.570641] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.710 [2024-04-27 03:32:40.570897] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.710 [2024-04-27 03:32:40.570922] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.710 [2024-04-27 03:32:40.570937] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.710 [2024-04-27 03:32:40.574588] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.710 [2024-04-27 03:32:40.583698] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.710 [2024-04-27 03:32:40.584112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.584283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.584312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.710 [2024-04-27 03:32:40.584330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.710 [2024-04-27 03:32:40.584567] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.710 [2024-04-27 03:32:40.584807] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.710 [2024-04-27 03:32:40.584829] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.710 [2024-04-27 03:32:40.584844] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.710 [2024-04-27 03:32:40.588403] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.710 [2024-04-27 03:32:40.597602] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.710 [2024-04-27 03:32:40.598013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.598136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.598165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.710 [2024-04-27 03:32:40.598181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.710 [2024-04-27 03:32:40.598428] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.710 [2024-04-27 03:32:40.598669] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.710 [2024-04-27 03:32:40.598692] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.710 [2024-04-27 03:32:40.598707] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.710 [2024-04-27 03:32:40.602243] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.710 [2024-04-27 03:32:40.611425] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.710 [2024-04-27 03:32:40.611832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.710 [2024-04-27 03:32:40.611962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.611990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.711 [2024-04-27 03:32:40.612008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.711 [2024-04-27 03:32:40.612243] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.711 [2024-04-27 03:32:40.612494] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.711 [2024-04-27 03:32:40.612523] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.711 [2024-04-27 03:32:40.612539] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.711 [2024-04-27 03:32:40.616071] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.711 [2024-04-27 03:32:40.625254] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.711 [2024-04-27 03:32:40.625654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.625823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.625851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.711 [2024-04-27 03:32:40.625869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.711 [2024-04-27 03:32:40.626104] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.711 [2024-04-27 03:32:40.626354] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.711 [2024-04-27 03:32:40.626377] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.711 [2024-04-27 03:32:40.626392] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.711 [2024-04-27 03:32:40.630040] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.711 [2024-04-27 03:32:40.639342] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.711 [2024-04-27 03:32:40.639754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.639900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.639936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.711 [2024-04-27 03:32:40.639956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.711 [2024-04-27 03:32:40.640193] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.711 [2024-04-27 03:32:40.640446] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.711 [2024-04-27 03:32:40.640470] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.711 [2024-04-27 03:32:40.640485] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.711 [2024-04-27 03:32:40.644121] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.711 [2024-04-27 03:32:40.653170] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.711 [2024-04-27 03:32:40.653574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.653700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.653729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.711 [2024-04-27 03:32:40.653746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.711 [2024-04-27 03:32:40.653983] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.711 [2024-04-27 03:32:40.654223] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.711 [2024-04-27 03:32:40.654255] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.711 [2024-04-27 03:32:40.654278] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.711 [2024-04-27 03:32:40.657818] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.711 [2024-04-27 03:32:40.667013] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.711 [2024-04-27 03:32:40.667424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.667670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.667698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.711 [2024-04-27 03:32:40.667715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.711 [2024-04-27 03:32:40.667951] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.711 [2024-04-27 03:32:40.668191] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.711 [2024-04-27 03:32:40.668214] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.711 [2024-04-27 03:32:40.668229] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.711 [2024-04-27 03:32:40.671776] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.711 [2024-04-27 03:32:40.681014] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.711 [2024-04-27 03:32:40.681404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.681605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.711 [2024-04-27 03:32:40.681668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.711 [2024-04-27 03:32:40.681690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.711 [2024-04-27 03:32:40.681936] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.711 [2024-04-27 03:32:40.682178] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.711 [2024-04-27 03:32:40.682201] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.711 [2024-04-27 03:32:40.682216] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.977 [2024-04-27 03:32:40.685821] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.977 [2024-04-27 03:32:40.694924] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.977 [2024-04-27 03:32:40.695330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.977 [2024-04-27 03:32:40.695481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.977 [2024-04-27 03:32:40.695509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.977 [2024-04-27 03:32:40.695527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.977 [2024-04-27 03:32:40.695763] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.977 [2024-04-27 03:32:40.696004] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.977 [2024-04-27 03:32:40.696026] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.977 [2024-04-27 03:32:40.696041] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.977 [2024-04-27 03:32:40.699601] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.977 [2024-04-27 03:32:40.708791] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.977 [2024-04-27 03:32:40.709172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.977 [2024-04-27 03:32:40.709323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.977 [2024-04-27 03:32:40.709352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.977 [2024-04-27 03:32:40.709369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.977 [2024-04-27 03:32:40.709606] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.977 [2024-04-27 03:32:40.709846] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.977 [2024-04-27 03:32:40.709869] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.977 [2024-04-27 03:32:40.709884] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.977 [2024-04-27 03:32:40.713430] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.977 [2024-04-27 03:32:40.722622] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.977 [2024-04-27 03:32:40.723022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.977 [2024-04-27 03:32:40.723167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.977 [2024-04-27 03:32:40.723195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.977 [2024-04-27 03:32:40.723212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.977 [2024-04-27 03:32:40.723460] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.977 [2024-04-27 03:32:40.723701] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.977 [2024-04-27 03:32:40.723724] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.977 [2024-04-27 03:32:40.723738] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.977 [2024-04-27 03:32:40.727294] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.977 [2024-04-27 03:32:40.736490] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.977 [2024-04-27 03:32:40.736892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.977 [2024-04-27 03:32:40.737063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.977 [2024-04-27 03:32:40.737091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.977 [2024-04-27 03:32:40.737108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.977 [2024-04-27 03:32:40.737357] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.977 [2024-04-27 03:32:40.737598] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.977 [2024-04-27 03:32:40.737621] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.977 [2024-04-27 03:32:40.737636] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.977 [2024-04-27 03:32:40.741172] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.977 [2024-04-27 03:32:40.750372] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.977 [2024-04-27 03:32:40.750767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.977 [2024-04-27 03:32:40.750935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.977 [2024-04-27 03:32:40.750963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.977 [2024-04-27 03:32:40.750980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.977 [2024-04-27 03:32:40.751215] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.978 [2024-04-27 03:32:40.751466] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.978 [2024-04-27 03:32:40.751489] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.978 [2024-04-27 03:32:40.751504] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.978 [2024-04-27 03:32:40.755042] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.978 [2024-04-27 03:32:40.764220] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.978 [2024-04-27 03:32:40.764622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.764799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.764827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.978 [2024-04-27 03:32:40.764844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.978 [2024-04-27 03:32:40.765079] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.978 [2024-04-27 03:32:40.765333] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.978 [2024-04-27 03:32:40.765357] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.978 [2024-04-27 03:32:40.765371] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.978 [2024-04-27 03:32:40.768906] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.978 [2024-04-27 03:32:40.778102] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.978 [2024-04-27 03:32:40.778516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.778688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.778716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.978 [2024-04-27 03:32:40.778733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.978 [2024-04-27 03:32:40.778968] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.978 [2024-04-27 03:32:40.779208] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.978 [2024-04-27 03:32:40.779231] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.978 [2024-04-27 03:32:40.779254] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.978 [2024-04-27 03:32:40.782792] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.978 [2024-04-27 03:32:40.791970] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.978 [2024-04-27 03:32:40.792398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.792535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.792562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.978 [2024-04-27 03:32:40.792579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.978 [2024-04-27 03:32:40.792814] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.978 [2024-04-27 03:32:40.793054] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.978 [2024-04-27 03:32:40.793077] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.978 [2024-04-27 03:32:40.793091] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.978 [2024-04-27 03:32:40.796633] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.978 [2024-04-27 03:32:40.805817] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.978 [2024-04-27 03:32:40.806204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.806373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.806402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.978 [2024-04-27 03:32:40.806418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.978 [2024-04-27 03:32:40.806654] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.978 [2024-04-27 03:32:40.806894] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.978 [2024-04-27 03:32:40.806916] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.978 [2024-04-27 03:32:40.806931] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.978 [2024-04-27 03:32:40.810476] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.978 [2024-04-27 03:32:40.819650] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.978 [2024-04-27 03:32:40.820047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.820164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.820192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.978 [2024-04-27 03:32:40.820209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.978 [2024-04-27 03:32:40.820456] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.978 [2024-04-27 03:32:40.820696] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.978 [2024-04-27 03:32:40.820719] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.978 [2024-04-27 03:32:40.820734] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.978 [2024-04-27 03:32:40.824278] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.978 [2024-04-27 03:32:40.833451] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.978 [2024-04-27 03:32:40.833838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.833985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.834013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.978 [2024-04-27 03:32:40.834030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.978 [2024-04-27 03:32:40.834278] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.978 [2024-04-27 03:32:40.834519] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.978 [2024-04-27 03:32:40.834542] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.978 [2024-04-27 03:32:40.834557] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.978 [2024-04-27 03:32:40.838094] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.978 [2024-04-27 03:32:40.847283] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.978 [2024-04-27 03:32:40.847665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.847836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.847864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.978 [2024-04-27 03:32:40.847881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.978 [2024-04-27 03:32:40.848116] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.978 [2024-04-27 03:32:40.848368] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.978 [2024-04-27 03:32:40.848392] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.978 [2024-04-27 03:32:40.848406] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.978 [2024-04-27 03:32:40.851942] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.978 [2024-04-27 03:32:40.861129] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.978 [2024-04-27 03:32:40.861524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.861710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.861755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.978 [2024-04-27 03:32:40.861772] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.978 [2024-04-27 03:32:40.862007] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.978 [2024-04-27 03:32:40.862257] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.978 [2024-04-27 03:32:40.862280] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.978 [2024-04-27 03:32:40.862295] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.978 [2024-04-27 03:32:40.865828] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.978 [2024-04-27 03:32:40.875004] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.978 [2024-04-27 03:32:40.875366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.875529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.978 [2024-04-27 03:32:40.875556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.978 [2024-04-27 03:32:40.875578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.979 [2024-04-27 03:32:40.875815] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.979 [2024-04-27 03:32:40.876055] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.979 [2024-04-27 03:32:40.876078] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.979 [2024-04-27 03:32:40.876093] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.979 [2024-04-27 03:32:40.879636] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.979 [2024-04-27 03:32:40.888820] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.979 [2024-04-27 03:32:40.889232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.979 [2024-04-27 03:32:40.889385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.979 [2024-04-27 03:32:40.889413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.979 [2024-04-27 03:32:40.889430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.979 [2024-04-27 03:32:40.889665] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.979 [2024-04-27 03:32:40.889905] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.979 [2024-04-27 03:32:40.889927] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.979 [2024-04-27 03:32:40.889942] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.979 [2024-04-27 03:32:40.893487] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.979 [2024-04-27 03:32:40.902669] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.979 [2024-04-27 03:32:40.903111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.979 [2024-04-27 03:32:40.903230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.979 [2024-04-27 03:32:40.903268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.979 [2024-04-27 03:32:40.903288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.979 [2024-04-27 03:32:40.903524] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.979 [2024-04-27 03:32:40.903763] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.979 [2024-04-27 03:32:40.903786] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.979 [2024-04-27 03:32:40.903801] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.979 [2024-04-27 03:32:40.907342] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.979 [2024-04-27 03:32:40.916525] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.979 [2024-04-27 03:32:40.916933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.979 [2024-04-27 03:32:40.917078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.979 [2024-04-27 03:32:40.917106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.979 [2024-04-27 03:32:40.917122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.979 [2024-04-27 03:32:40.917376] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.979 [2024-04-27 03:32:40.917617] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.979 [2024-04-27 03:32:40.917640] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.979 [2024-04-27 03:32:40.917655] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.979 [2024-04-27 03:32:40.921192] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.979 [2024-04-27 03:32:40.930382] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.979 [2024-04-27 03:32:40.930756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.979 [2024-04-27 03:32:40.930904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.979 [2024-04-27 03:32:40.930932] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.979 [2024-04-27 03:32:40.930948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.979 [2024-04-27 03:32:40.931184] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.979 [2024-04-27 03:32:40.931435] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.979 [2024-04-27 03:32:40.931458] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.979 [2024-04-27 03:32:40.931473] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.979 [2024-04-27 03:32:40.935007] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:15.979 [2024-04-27 03:32:40.944234] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:15.979 [2024-04-27 03:32:40.944630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.979 [2024-04-27 03:32:40.944778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:15.979 [2024-04-27 03:32:40.944807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:15.979 [2024-04-27 03:32:40.944824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:15.979 [2024-04-27 03:32:40.945060] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:15.979 [2024-04-27 03:32:40.945316] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:15.979 [2024-04-27 03:32:40.945340] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:15.979 [2024-04-27 03:32:40.945355] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:15.979 [2024-04-27 03:32:40.949047] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.262 [2024-04-27 03:32:40.958179] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.262 [2024-04-27 03:32:40.958589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:40.958735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:40.958763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.262 [2024-04-27 03:32:40.958781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.262 [2024-04-27 03:32:40.959028] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.262 [2024-04-27 03:32:40.959291] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.262 [2024-04-27 03:32:40.959316] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.262 [2024-04-27 03:32:40.959331] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.262 [2024-04-27 03:32:40.962997] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.262 [2024-04-27 03:32:40.972221] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.262 [2024-04-27 03:32:40.972683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:40.972875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:40.972905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.262 [2024-04-27 03:32:40.972922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.262 [2024-04-27 03:32:40.973158] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.262 [2024-04-27 03:32:40.973424] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.262 [2024-04-27 03:32:40.973449] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.262 [2024-04-27 03:32:40.973464] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.262 [2024-04-27 03:32:40.977064] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.262 [2024-04-27 03:32:40.986136] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.262 [2024-04-27 03:32:40.986582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:40.986788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:40.986840] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.262 [2024-04-27 03:32:40.986859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.262 [2024-04-27 03:32:40.987095] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.262 [2024-04-27 03:32:40.987350] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.262 [2024-04-27 03:32:40.987374] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.262 [2024-04-27 03:32:40.987389] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.262 [2024-04-27 03:32:40.990964] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.262 [2024-04-27 03:32:41.000015] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.262 [2024-04-27 03:32:41.000406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:41.000534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:41.000562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.262 [2024-04-27 03:32:41.000579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.262 [2024-04-27 03:32:41.000816] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.262 [2024-04-27 03:32:41.001056] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.262 [2024-04-27 03:32:41.001086] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.262 [2024-04-27 03:32:41.001102] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.262 [2024-04-27 03:32:41.004653] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.262 [2024-04-27 03:32:41.013837] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.262 [2024-04-27 03:32:41.014287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:41.014429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:41.014457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.262 [2024-04-27 03:32:41.014474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.262 [2024-04-27 03:32:41.014710] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.262 [2024-04-27 03:32:41.014950] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.262 [2024-04-27 03:32:41.014973] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.262 [2024-04-27 03:32:41.014988] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.262 [2024-04-27 03:32:41.018536] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.262 [2024-04-27 03:32:41.027727] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.262 [2024-04-27 03:32:41.028106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.262 [2024-04-27 03:32:41.028273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.028302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.263 [2024-04-27 03:32:41.028319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.263 [2024-04-27 03:32:41.028555] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.263 [2024-04-27 03:32:41.028795] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.263 [2024-04-27 03:32:41.028818] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.263 [2024-04-27 03:32:41.028833] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.263 [2024-04-27 03:32:41.032381] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.263 [2024-04-27 03:32:41.041568] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.263 [2024-04-27 03:32:41.041982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.042127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.042154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.263 [2024-04-27 03:32:41.042171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.263 [2024-04-27 03:32:41.042418] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.263 [2024-04-27 03:32:41.042659] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.263 [2024-04-27 03:32:41.042682] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.263 [2024-04-27 03:32:41.042704] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.263 [2024-04-27 03:32:41.046245] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.263 [2024-04-27 03:32:41.055430] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.263 [2024-04-27 03:32:41.055809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.055933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.055961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.263 [2024-04-27 03:32:41.055978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.263 [2024-04-27 03:32:41.056213] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.263 [2024-04-27 03:32:41.056463] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.263 [2024-04-27 03:32:41.056486] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.263 [2024-04-27 03:32:41.056502] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.263 [2024-04-27 03:32:41.060038] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.263 [2024-04-27 03:32:41.069218] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.263 [2024-04-27 03:32:41.069623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.069839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.069897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.263 [2024-04-27 03:32:41.069914] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.263 [2024-04-27 03:32:41.070150] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.263 [2024-04-27 03:32:41.070401] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.263 [2024-04-27 03:32:41.070424] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.263 [2024-04-27 03:32:41.070439] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.263 [2024-04-27 03:32:41.073973] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.263 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1527053 Killed "${NVMF_APP[@]}" "$@" 00:21:16.263 03:32:41 -- host/bdevperf.sh@36 -- # tgt_init 00:21:16.263 03:32:41 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:21:16.263 03:32:41 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:16.263 03:32:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:16.263 03:32:41 -- common/autotest_common.sh@10 -- # set +x 00:21:16.263 [2024-04-27 03:32:41.083158] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.263 [2024-04-27 03:32:41.083535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.083645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.083673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.263 [2024-04-27 03:32:41.083690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.263 [2024-04-27 03:32:41.083926] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.263 [2024-04-27 03:32:41.084171] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.263 [2024-04-27 03:32:41.084194] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.263 [2024-04-27 03:32:41.084209] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.263 03:32:41 -- nvmf/common.sh@470 -- # nvmfpid=1528060 00:21:16.263 03:32:41 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:21:16.263 03:32:41 -- nvmf/common.sh@471 -- # waitforlisten 1528060 00:21:16.263 03:32:41 -- common/autotest_common.sh@817 -- # '[' -z 1528060 ']' 00:21:16.263 03:32:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:16.263 03:32:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:16.263 03:32:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:16.263 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:16.263 03:32:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:16.263 03:32:41 -- common/autotest_common.sh@10 -- # set +x 00:21:16.263 [2024-04-27 03:32:41.087761] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.263 [2024-04-27 03:32:41.097183] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.263 [2024-04-27 03:32:41.097582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.097760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.097788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.263 [2024-04-27 03:32:41.097805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.263 [2024-04-27 03:32:41.098041] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.263 [2024-04-27 03:32:41.098293] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.263 [2024-04-27 03:32:41.098317] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.263 [2024-04-27 03:32:41.098333] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.263 [2024-04-27 03:32:41.101867] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.263 [2024-04-27 03:32:41.111060] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.263 [2024-04-27 03:32:41.111425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.111544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.111573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.263 [2024-04-27 03:32:41.111591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.263 [2024-04-27 03:32:41.111827] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.263 [2024-04-27 03:32:41.112066] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.263 [2024-04-27 03:32:41.112089] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.263 [2024-04-27 03:32:41.112105] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.263 [2024-04-27 03:32:41.115652] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.263 [2024-04-27 03:32:41.125059] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.263 [2024-04-27 03:32:41.125458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.125575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.263 [2024-04-27 03:32:41.125602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.263 [2024-04-27 03:32:41.125618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.263 [2024-04-27 03:32:41.125856] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.263 [2024-04-27 03:32:41.126096] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.263 [2024-04-27 03:32:41.126119] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.263 [2024-04-27 03:32:41.126134] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.263 [2024-04-27 03:32:41.129682] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.263 [2024-04-27 03:32:41.133465] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:21:16.263 [2024-04-27 03:32:41.133560] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:16.263 [2024-04-27 03:32:41.138864] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.264 [2024-04-27 03:32:41.139262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.139386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.139414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.264 [2024-04-27 03:32:41.139432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.264 [2024-04-27 03:32:41.139668] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.264 [2024-04-27 03:32:41.139907] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.264 [2024-04-27 03:32:41.139931] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.264 [2024-04-27 03:32:41.139946] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.264 [2024-04-27 03:32:41.143492] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.264 [2024-04-27 03:32:41.152698] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.264 [2024-04-27 03:32:41.153098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.153263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.153292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.264 [2024-04-27 03:32:41.153309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.264 [2024-04-27 03:32:41.153545] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.264 [2024-04-27 03:32:41.153785] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.264 [2024-04-27 03:32:41.153808] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.264 [2024-04-27 03:32:41.153823] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.264 [2024-04-27 03:32:41.157376] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.264 [2024-04-27 03:32:41.166517] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.264 [2024-04-27 03:32:41.166921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.167063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.167092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.264 [2024-04-27 03:32:41.167109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.264 [2024-04-27 03:32:41.167358] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.264 [2024-04-27 03:32:41.167599] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.264 [2024-04-27 03:32:41.167623] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.264 [2024-04-27 03:32:41.167638] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.264 [2024-04-27 03:32:41.171177] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.264 EAL: No free 2048 kB hugepages reported on node 1 00:21:16.264 [2024-04-27 03:32:41.180413] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.264 [2024-04-27 03:32:41.180797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.180951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.180979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.264 [2024-04-27 03:32:41.180996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.264 [2024-04-27 03:32:41.181232] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.264 [2024-04-27 03:32:41.181483] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.264 [2024-04-27 03:32:41.181507] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.264 [2024-04-27 03:32:41.181522] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.264 [2024-04-27 03:32:41.185058] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.264 [2024-04-27 03:32:41.194261] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.264 [2024-04-27 03:32:41.194644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.194797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.194825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.264 [2024-04-27 03:32:41.194842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.264 [2024-04-27 03:32:41.195077] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.264 [2024-04-27 03:32:41.195330] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.264 [2024-04-27 03:32:41.195353] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.264 [2024-04-27 03:32:41.195368] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.264 [2024-04-27 03:32:41.198914] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.264 [2024-04-27 03:32:41.208114] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.264 [2024-04-27 03:32:41.208493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.208631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.208659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.264 [2024-04-27 03:32:41.208676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.264 [2024-04-27 03:32:41.208913] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.264 [2024-04-27 03:32:41.209153] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.264 [2024-04-27 03:32:41.209176] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.264 [2024-04-27 03:32:41.209191] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.264 [2024-04-27 03:32:41.209682] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:21:16.264 [2024-04-27 03:32:41.212763] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.264 [2024-04-27 03:32:41.222064] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.264 [2024-04-27 03:32:41.222639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.222814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.222843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.264 [2024-04-27 03:32:41.222863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.264 [2024-04-27 03:32:41.223112] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.264 [2024-04-27 03:32:41.223395] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.264 [2024-04-27 03:32:41.223421] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.264 [2024-04-27 03:32:41.223439] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.264 [2024-04-27 03:32:41.227030] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.264 [2024-04-27 03:32:41.236132] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.264 [2024-04-27 03:32:41.236531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.236669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.264 [2024-04-27 03:32:41.236706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.264 [2024-04-27 03:32:41.236724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.264 [2024-04-27 03:32:41.236964] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.264 [2024-04-27 03:32:41.237206] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.264 [2024-04-27 03:32:41.237229] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.264 [2024-04-27 03:32:41.237278] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.524 [2024-04-27 03:32:41.240954] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.524 [2024-04-27 03:32:41.250037] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.524 [2024-04-27 03:32:41.250410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.250573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.250602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.524 [2024-04-27 03:32:41.250620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.524 [2024-04-27 03:32:41.250857] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.524 [2024-04-27 03:32:41.251098] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.524 [2024-04-27 03:32:41.251122] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.524 [2024-04-27 03:32:41.251137] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.524 [2024-04-27 03:32:41.254686] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.524 [2024-04-27 03:32:41.263875] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.524 [2024-04-27 03:32:41.264274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.264403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.264432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.524 [2024-04-27 03:32:41.264450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.524 [2024-04-27 03:32:41.264686] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.524 [2024-04-27 03:32:41.264926] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.524 [2024-04-27 03:32:41.264950] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.524 [2024-04-27 03:32:41.264976] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.524 [2024-04-27 03:32:41.268538] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.524 [2024-04-27 03:32:41.277757] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.524 [2024-04-27 03:32:41.278897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.279078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.279109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.524 [2024-04-27 03:32:41.279130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.524 [2024-04-27 03:32:41.279410] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.524 [2024-04-27 03:32:41.279658] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.524 [2024-04-27 03:32:41.279682] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.524 [2024-04-27 03:32:41.279700] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.524 [2024-04-27 03:32:41.283303] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.524 [2024-04-27 03:32:41.291713] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.524 [2024-04-27 03:32:41.292199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.292378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.292409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.524 [2024-04-27 03:32:41.292429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.524 [2024-04-27 03:32:41.292672] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.524 [2024-04-27 03:32:41.292915] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.524 [2024-04-27 03:32:41.292939] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.524 [2024-04-27 03:32:41.292956] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.524 [2024-04-27 03:32:41.296508] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.524 [2024-04-27 03:32:41.305693] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.524 [2024-04-27 03:32:41.306102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.306260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.306289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.524 [2024-04-27 03:32:41.306307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.524 [2024-04-27 03:32:41.306544] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.524 [2024-04-27 03:32:41.306792] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.524 [2024-04-27 03:32:41.306815] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.524 [2024-04-27 03:32:41.306830] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.524 [2024-04-27 03:32:41.310376] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.524 [2024-04-27 03:32:41.319556] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.524 [2024-04-27 03:32:41.319945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.320095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.320124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.524 [2024-04-27 03:32:41.320142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.524 [2024-04-27 03:32:41.320389] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.524 [2024-04-27 03:32:41.320631] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.524 [2024-04-27 03:32:41.320654] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.524 [2024-04-27 03:32:41.320669] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.524 [2024-04-27 03:32:41.324209] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.524 [2024-04-27 03:32:41.331871] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:16.524 [2024-04-27 03:32:41.331909] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:16.524 [2024-04-27 03:32:41.331932] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:16.524 [2024-04-27 03:32:41.331946] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:16.524 [2024-04-27 03:32:41.331958] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:16.524 [2024-04-27 03:32:41.332051] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:16.524 [2024-04-27 03:32:41.332112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:16.524 [2024-04-27 03:32:41.332116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:16.524 [2024-04-27 03:32:41.333412] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.524 [2024-04-27 03:32:41.333815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.333969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.333999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.524 [2024-04-27 03:32:41.334017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.524 [2024-04-27 03:32:41.334264] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.524 [2024-04-27 03:32:41.334505] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.524 [2024-04-27 03:32:41.334528] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.524 [2024-04-27 03:32:41.334544] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.524 [2024-04-27 03:32:41.338079] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.524 [2024-04-27 03:32:41.347283] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.524 [2024-04-27 03:32:41.347799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.347988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.524 [2024-04-27 03:32:41.348017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.524 [2024-04-27 03:32:41.348037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.524 [2024-04-27 03:32:41.348293] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.525 [2024-04-27 03:32:41.348547] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.525 [2024-04-27 03:32:41.348571] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.525 [2024-04-27 03:32:41.348589] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.525 [2024-04-27 03:32:41.352130] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.525 [2024-04-27 03:32:41.361124] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.525 [2024-04-27 03:32:41.361670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.361862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.361890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.525 [2024-04-27 03:32:41.361910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.525 [2024-04-27 03:32:41.362155] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.525 [2024-04-27 03:32:41.362418] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.525 [2024-04-27 03:32:41.362443] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.525 [2024-04-27 03:32:41.362461] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.525 [2024-04-27 03:32:41.366001] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.525 [2024-04-27 03:32:41.375007] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.525 [2024-04-27 03:32:41.375554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.375712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.375739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.525 [2024-04-27 03:32:41.375759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.525 [2024-04-27 03:32:41.376005] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.525 [2024-04-27 03:32:41.376259] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.525 [2024-04-27 03:32:41.376283] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.525 [2024-04-27 03:32:41.376302] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.525 [2024-04-27 03:32:41.379846] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.525 [2024-04-27 03:32:41.389041] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.525 [2024-04-27 03:32:41.389501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.389689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.389718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.525 [2024-04-27 03:32:41.389737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.525 [2024-04-27 03:32:41.389981] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.525 [2024-04-27 03:32:41.390235] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.525 [2024-04-27 03:32:41.390271] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.525 [2024-04-27 03:32:41.390289] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.525 [2024-04-27 03:32:41.393825] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.525 [2024-04-27 03:32:41.403023] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.525 [2024-04-27 03:32:41.403563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.403724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.403753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.525 [2024-04-27 03:32:41.403773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.525 [2024-04-27 03:32:41.404018] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.525 [2024-04-27 03:32:41.404273] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.525 [2024-04-27 03:32:41.404308] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.525 [2024-04-27 03:32:41.404327] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.525 [2024-04-27 03:32:41.407865] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.525 [2024-04-27 03:32:41.417054] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.525 [2024-04-27 03:32:41.417431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.417586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.417613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.525 [2024-04-27 03:32:41.417630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.525 [2024-04-27 03:32:41.417866] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.525 [2024-04-27 03:32:41.418106] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.525 [2024-04-27 03:32:41.418129] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.525 [2024-04-27 03:32:41.418144] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.525 [2024-04-27 03:32:41.421691] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.525 [2024-04-27 03:32:41.430884] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.525 [2024-04-27 03:32:41.431243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.431374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.431404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.525 [2024-04-27 03:32:41.431421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.525 [2024-04-27 03:32:41.431659] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.525 [2024-04-27 03:32:41.431899] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.525 [2024-04-27 03:32:41.431922] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.525 [2024-04-27 03:32:41.431937] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.525 [2024-04-27 03:32:41.435376] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.525 [2024-04-27 03:32:41.444536] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.525 [2024-04-27 03:32:41.444915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.445063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.445088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.525 [2024-04-27 03:32:41.445104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.525 [2024-04-27 03:32:41.445325] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.525 [2024-04-27 03:32:41.445541] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.525 [2024-04-27 03:32:41.445562] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.525 [2024-04-27 03:32:41.445584] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.525 03:32:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:16.525 03:32:41 -- common/autotest_common.sh@850 -- # return 0 00:21:16.525 03:32:41 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:16.525 03:32:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:16.525 03:32:41 -- common/autotest_common.sh@10 -- # set +x 00:21:16.525 [2024-04-27 03:32:41.448826] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.525 [2024-04-27 03:32:41.457998] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.525 [2024-04-27 03:32:41.458357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.458475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.458500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.525 [2024-04-27 03:32:41.458516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.525 [2024-04-27 03:32:41.458743] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.525 [2024-04-27 03:32:41.458953] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.525 [2024-04-27 03:32:41.458973] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.525 [2024-04-27 03:32:41.458986] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.525 [2024-04-27 03:32:41.462165] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.525 03:32:41 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:16.525 03:32:41 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:16.525 03:32:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:16.525 03:32:41 -- common/autotest_common.sh@10 -- # set +x 00:21:16.525 [2024-04-27 03:32:41.469567] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:16.525 [2024-04-27 03:32:41.471676] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.525 [2024-04-27 03:32:41.472043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.525 [2024-04-27 03:32:41.472149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.526 [2024-04-27 03:32:41.472174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.526 [2024-04-27 03:32:41.472189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.526 [2024-04-27 03:32:41.472409] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.526 [2024-04-27 03:32:41.472626] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.526 [2024-04-27 03:32:41.472646] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.526 [2024-04-27 03:32:41.472660] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.526 03:32:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:16.526 03:32:41 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:16.526 03:32:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:16.526 03:32:41 -- common/autotest_common.sh@10 -- # set +x 00:21:16.526 [2024-04-27 03:32:41.475948] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.526 [2024-04-27 03:32:41.485164] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.526 [2024-04-27 03:32:41.485523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.526 [2024-04-27 03:32:41.485658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.526 [2024-04-27 03:32:41.485688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.526 [2024-04-27 03:32:41.485705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.526 [2024-04-27 03:32:41.485945] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.526 [2024-04-27 03:32:41.486148] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.526 [2024-04-27 03:32:41.486167] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.526 [2024-04-27 03:32:41.486180] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.526 [2024-04-27 03:32:41.489289] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.526 [2024-04-27 03:32:41.498932] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.526 [2024-04-27 03:32:41.499429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.526 [2024-04-27 03:32:41.499596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.526 [2024-04-27 03:32:41.499637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.526 [2024-04-27 03:32:41.499664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.526 [2024-04-27 03:32:41.499910] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.784 [2024-04-27 03:32:41.500145] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.784 [2024-04-27 03:32:41.500167] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.784 [2024-04-27 03:32:41.500190] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.785 [2024-04-27 03:32:41.503409] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.785 Malloc0 00:21:16.785 03:32:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:16.785 03:32:41 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:16.785 03:32:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:16.785 03:32:41 -- common/autotest_common.sh@10 -- # set +x 00:21:16.785 [2024-04-27 03:32:41.512576] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.785 [2024-04-27 03:32:41.512982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.785 [2024-04-27 03:32:41.513129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.785 [2024-04-27 03:32:41.513155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.785 [2024-04-27 03:32:41.513173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.785 [2024-04-27 03:32:41.513410] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.785 [2024-04-27 03:32:41.513643] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.785 [2024-04-27 03:32:41.513663] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.785 [2024-04-27 03:32:41.513677] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.785 [2024-04-27 03:32:41.516930] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.785 03:32:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:16.785 03:32:41 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:16.785 03:32:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:16.785 03:32:41 -- common/autotest_common.sh@10 -- # set +x 00:21:16.785 [2024-04-27 03:32:41.526140] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.785 03:32:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:16.785 [2024-04-27 03:32:41.526510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.785 [2024-04-27 03:32:41.526646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:16.785 03:32:41 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:16.785 [2024-04-27 03:32:41.526671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18d1260 with addr=10.0.0.2, port=4420 00:21:16.785 [2024-04-27 03:32:41.526687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d1260 is same with the state(5) to be set 00:21:16.785 03:32:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:16.785 [2024-04-27 03:32:41.526899] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d1260 (9): Bad file descriptor 00:21:16.785 03:32:41 -- common/autotest_common.sh@10 -- # set +x 00:21:16.785 [2024-04-27 03:32:41.527143] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:16.785 [2024-04-27 03:32:41.527163] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:16.785 [2024-04-27 03:32:41.527177] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:16.785 [2024-04-27 03:32:41.530373] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:16.785 [2024-04-27 03:32:41.530413] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:16.785 03:32:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:16.785 03:32:41 -- host/bdevperf.sh@38 -- # wait 1527394 00:21:16.785 [2024-04-27 03:32:41.539750] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:16.785 [2024-04-27 03:32:41.617867] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:21:26.765 00:21:26.765 Latency(us) 00:21:26.765 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:26.765 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:21:26.765 Verification LBA range: start 0x0 length 0x4000 00:21:26.765 Nvme1n1 : 15.00 6508.51 25.42 8883.78 0.00 8291.83 825.27 19515.16 00:21:26.765 =================================================================================================================== 00:21:26.765 Total : 6508.51 25.42 8883.78 0.00 8291.83 825.27 19515.16 00:21:26.765 03:32:50 -- host/bdevperf.sh@39 -- # sync 00:21:26.765 03:32:50 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:26.765 03:32:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:26.765 03:32:50 -- common/autotest_common.sh@10 -- # set +x 00:21:26.765 03:32:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:26.765 03:32:50 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:21:26.765 03:32:50 -- host/bdevperf.sh@44 -- # nvmftestfini 00:21:26.765 03:32:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:26.765 03:32:50 -- nvmf/common.sh@117 -- # sync 00:21:26.765 03:32:50 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:21:26.765 03:32:50 -- nvmf/common.sh@120 -- # set +e 00:21:26.765 03:32:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:26.765 03:32:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:21:26.765 rmmod nvme_tcp 00:21:26.765 rmmod nvme_fabrics 00:21:26.765 rmmod nvme_keyring 00:21:26.765 03:32:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:26.765 03:32:50 -- nvmf/common.sh@124 -- # set -e 00:21:26.765 03:32:50 -- nvmf/common.sh@125 -- # return 0 00:21:26.765 03:32:50 -- nvmf/common.sh@478 -- # '[' -n 1528060 ']' 00:21:26.765 03:32:50 -- nvmf/common.sh@479 -- # killprocess 1528060 00:21:26.765 03:32:50 -- common/autotest_common.sh@936 -- # '[' -z 1528060 ']' 00:21:26.765 03:32:50 -- common/autotest_common.sh@940 -- # kill -0 1528060 00:21:26.765 03:32:50 -- common/autotest_common.sh@941 -- # uname 00:21:26.765 03:32:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:26.765 03:32:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1528060 00:21:26.765 03:32:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:26.765 03:32:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:26.765 03:32:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1528060' 00:21:26.765 killing process with pid 1528060 00:21:26.765 03:32:50 -- common/autotest_common.sh@955 -- # kill 1528060 00:21:26.765 03:32:50 -- common/autotest_common.sh@960 -- # wait 1528060 00:21:26.765 03:32:51 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:26.765 03:32:51 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:21:26.765 03:32:51 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:21:26.765 03:32:51 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:26.765 03:32:51 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:21:26.765 03:32:51 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:26.765 03:32:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:26.765 03:32:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:28.669 03:32:53 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:21:28.669 00:21:28.669 real 0m23.083s 00:21:28.669 user 1m2.549s 00:21:28.669 sys 0m4.053s 00:21:28.669 03:32:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:28.669 03:32:53 -- common/autotest_common.sh@10 -- # set +x 00:21:28.669 ************************************ 00:21:28.669 END TEST nvmf_bdevperf 00:21:28.669 ************************************ 00:21:28.669 03:32:53 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:21:28.669 03:32:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:28.669 03:32:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:28.669 03:32:53 -- common/autotest_common.sh@10 -- # set +x 00:21:28.669 ************************************ 00:21:28.669 START TEST nvmf_target_disconnect 00:21:28.669 ************************************ 00:21:28.669 03:32:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:21:28.669 * Looking for test storage... 00:21:28.669 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:21:28.669 03:32:53 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:28.669 03:32:53 -- nvmf/common.sh@7 -- # uname -s 00:21:28.669 03:32:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:28.669 03:32:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:28.669 03:32:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:28.670 03:32:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:28.670 03:32:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:28.670 03:32:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:28.670 03:32:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:28.670 03:32:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:28.670 03:32:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:28.670 03:32:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:28.670 03:32:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:21:28.670 03:32:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:21:28.670 03:32:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:28.670 03:32:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:28.670 03:32:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:28.670 03:32:53 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:28.670 03:32:53 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:28.670 03:32:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:28.670 03:32:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:28.670 03:32:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:28.670 03:32:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.670 03:32:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.670 03:32:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.670 03:32:53 -- paths/export.sh@5 -- # export PATH 00:21:28.670 03:32:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.670 03:32:53 -- nvmf/common.sh@47 -- # : 0 00:21:28.670 03:32:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:28.670 03:32:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:28.670 03:32:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:28.670 03:32:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:28.670 03:32:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:28.670 03:32:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:28.670 03:32:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:28.670 03:32:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:28.670 03:32:53 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:21:28.670 03:32:53 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:21:28.670 03:32:53 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:21:28.670 03:32:53 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:21:28.670 03:32:53 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:21:28.670 03:32:53 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:28.670 03:32:53 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:28.670 03:32:53 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:28.670 03:32:53 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:28.670 03:32:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:28.670 03:32:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:28.670 03:32:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:28.670 03:32:53 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:28.670 03:32:53 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:28.670 03:32:53 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:28.670 03:32:53 -- common/autotest_common.sh@10 -- # set +x 00:21:30.576 03:32:55 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:30.576 03:32:55 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:30.576 03:32:55 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:30.576 03:32:55 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:30.576 03:32:55 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:30.576 03:32:55 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:30.576 03:32:55 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:30.576 03:32:55 -- nvmf/common.sh@295 -- # net_devs=() 00:21:30.576 03:32:55 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:30.576 03:32:55 -- nvmf/common.sh@296 -- # e810=() 00:21:30.576 03:32:55 -- nvmf/common.sh@296 -- # local -ga e810 00:21:30.576 03:32:55 -- nvmf/common.sh@297 -- # x722=() 00:21:30.576 03:32:55 -- nvmf/common.sh@297 -- # local -ga x722 00:21:30.576 03:32:55 -- nvmf/common.sh@298 -- # mlx=() 00:21:30.576 03:32:55 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:30.576 03:32:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:30.577 03:32:55 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:30.577 03:32:55 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:21:30.577 03:32:55 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:30.577 03:32:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:30.577 03:32:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:21:30.577 Found 0000:09:00.0 (0x8086 - 0x159b) 00:21:30.577 03:32:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:30.577 03:32:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:21:30.577 Found 0000:09:00.1 (0x8086 - 0x159b) 00:21:30.577 03:32:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:30.577 03:32:55 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:30.577 03:32:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:30.577 03:32:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:30.577 03:32:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:30.577 03:32:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:21:30.577 Found net devices under 0000:09:00.0: cvl_0_0 00:21:30.577 03:32:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:30.577 03:32:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:30.577 03:32:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:30.577 03:32:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:30.577 03:32:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:30.577 03:32:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:21:30.577 Found net devices under 0000:09:00.1: cvl_0_1 00:21:30.577 03:32:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:30.577 03:32:55 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:30.577 03:32:55 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:30.577 03:32:55 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:21:30.577 03:32:55 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:30.577 03:32:55 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:30.577 03:32:55 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:30.577 03:32:55 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:21:30.577 03:32:55 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:30.577 03:32:55 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:30.577 03:32:55 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:21:30.577 03:32:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:30.577 03:32:55 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:30.577 03:32:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:21:30.577 03:32:55 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:21:30.577 03:32:55 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:21:30.577 03:32:55 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:30.577 03:32:55 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:30.577 03:32:55 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:30.577 03:32:55 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:21:30.577 03:32:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:30.577 03:32:55 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:30.577 03:32:55 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:30.577 03:32:55 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:21:30.577 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:30.577 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:21:30.577 00:21:30.577 --- 10.0.0.2 ping statistics --- 00:21:30.577 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:30.577 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:21:30.577 03:32:55 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:30.577 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:30.577 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:21:30.577 00:21:30.577 --- 10.0.0.1 ping statistics --- 00:21:30.577 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:30.577 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:21:30.577 03:32:55 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:30.577 03:32:55 -- nvmf/common.sh@411 -- # return 0 00:21:30.577 03:32:55 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:30.577 03:32:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:30.577 03:32:55 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:21:30.577 03:32:55 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:30.577 03:32:55 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:21:30.577 03:32:55 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:21:30.577 03:32:55 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:21:30.577 03:32:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:30.577 03:32:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:30.577 03:32:55 -- common/autotest_common.sh@10 -- # set +x 00:21:30.577 ************************************ 00:21:30.577 START TEST nvmf_target_disconnect_tc1 00:21:30.577 ************************************ 00:21:30.577 03:32:55 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc1 00:21:30.577 03:32:55 -- host/target_disconnect.sh@32 -- # set +e 00:21:30.577 03:32:55 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:21:30.836 EAL: No free 2048 kB hugepages reported on node 1 00:21:30.836 [2024-04-27 03:32:55.598349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:30.836 [2024-04-27 03:32:55.598557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:30.836 [2024-04-27 03:32:55.598589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2105b30 with addr=10.0.0.2, port=4420 00:21:30.836 [2024-04-27 03:32:55.598621] nvme_tcp.c:2699:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:21:30.836 [2024-04-27 03:32:55.598649] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:21:30.836 [2024-04-27 03:32:55.598664] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:21:30.836 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:21:30.836 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:21:30.837 Initializing NVMe Controllers 00:21:30.837 03:32:55 -- host/target_disconnect.sh@33 -- # trap - ERR 00:21:30.837 03:32:55 -- host/target_disconnect.sh@33 -- # print_backtrace 00:21:30.837 03:32:55 -- common/autotest_common.sh@1139 -- # [[ hxBET =~ e ]] 00:21:30.837 03:32:55 -- common/autotest_common.sh@1139 -- # return 0 00:21:30.837 03:32:55 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:21:30.837 03:32:55 -- host/target_disconnect.sh@41 -- # set -e 00:21:30.837 00:21:30.837 real 0m0.090s 00:21:30.837 user 0m0.042s 00:21:30.837 sys 0m0.049s 00:21:30.837 03:32:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:30.837 03:32:55 -- common/autotest_common.sh@10 -- # set +x 00:21:30.837 ************************************ 00:21:30.837 END TEST nvmf_target_disconnect_tc1 00:21:30.837 ************************************ 00:21:30.837 03:32:55 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:21:30.837 03:32:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:30.837 03:32:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:30.837 03:32:55 -- common/autotest_common.sh@10 -- # set +x 00:21:30.837 ************************************ 00:21:30.837 START TEST nvmf_target_disconnect_tc2 00:21:30.837 ************************************ 00:21:30.837 03:32:55 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc2 00:21:30.837 03:32:55 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:21:30.837 03:32:55 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:21:30.837 03:32:55 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:30.837 03:32:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:30.837 03:32:55 -- common/autotest_common.sh@10 -- # set +x 00:21:30.837 03:32:55 -- nvmf/common.sh@470 -- # nvmfpid=1531233 00:21:30.837 03:32:55 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:21:30.837 03:32:55 -- nvmf/common.sh@471 -- # waitforlisten 1531233 00:21:30.837 03:32:55 -- common/autotest_common.sh@817 -- # '[' -z 1531233 ']' 00:21:30.837 03:32:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:30.837 03:32:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:30.837 03:32:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:30.837 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:30.837 03:32:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:30.837 03:32:55 -- common/autotest_common.sh@10 -- # set +x 00:21:30.837 [2024-04-27 03:32:55.773239] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:21:30.837 [2024-04-27 03:32:55.773338] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:30.837 EAL: No free 2048 kB hugepages reported on node 1 00:21:31.095 [2024-04-27 03:32:55.847900] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:31.095 [2024-04-27 03:32:55.967405] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:31.095 [2024-04-27 03:32:55.967456] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:31.095 [2024-04-27 03:32:55.967470] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:31.096 [2024-04-27 03:32:55.967482] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:31.096 [2024-04-27 03:32:55.967492] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:31.096 [2024-04-27 03:32:55.967612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:21:31.096 [2024-04-27 03:32:55.967684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:21:31.096 [2024-04-27 03:32:55.967738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:21:31.096 [2024-04-27 03:32:55.967741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:31.356 03:32:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:31.356 03:32:56 -- common/autotest_common.sh@850 -- # return 0 00:21:31.356 03:32:56 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:31.356 03:32:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:31.356 03:32:56 -- common/autotest_common.sh@10 -- # set +x 00:21:31.356 03:32:56 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:31.356 03:32:56 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:31.356 03:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:31.356 03:32:56 -- common/autotest_common.sh@10 -- # set +x 00:21:31.356 Malloc0 00:21:31.356 03:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:31.356 03:32:56 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:21:31.356 03:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:31.356 03:32:56 -- common/autotest_common.sh@10 -- # set +x 00:21:31.356 [2024-04-27 03:32:56.149752] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:31.356 03:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:31.356 03:32:56 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:31.356 03:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:31.356 03:32:56 -- common/autotest_common.sh@10 -- # set +x 00:21:31.356 03:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:31.356 03:32:56 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:31.356 03:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:31.356 03:32:56 -- common/autotest_common.sh@10 -- # set +x 00:21:31.356 03:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:31.356 03:32:56 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:31.356 03:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:31.356 03:32:56 -- common/autotest_common.sh@10 -- # set +x 00:21:31.356 [2024-04-27 03:32:56.178046] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:31.356 03:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:31.356 03:32:56 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:21:31.356 03:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:31.356 03:32:56 -- common/autotest_common.sh@10 -- # set +x 00:21:31.356 03:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:31.356 03:32:56 -- host/target_disconnect.sh@50 -- # reconnectpid=1531375 00:21:31.356 03:32:56 -- host/target_disconnect.sh@52 -- # sleep 2 00:21:31.356 03:32:56 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:21:31.356 EAL: No free 2048 kB hugepages reported on node 1 00:21:33.264 03:32:58 -- host/target_disconnect.sh@53 -- # kill -9 1531233 00:21:33.264 03:32:58 -- host/target_disconnect.sh@55 -- # sleep 2 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 [2024-04-27 03:32:58.206293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:21:33.264 [2024-04-27 03:32:58.206533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.206689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.206717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.206860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.206995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.207028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.207164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.207309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.207337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.207443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.207586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.207612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.207769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.207903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.207929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.208058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.208202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.208228] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.208353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.208459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.208485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.208624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.208737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.208765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.208963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.209086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.209117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.209291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.209399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.209426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.209538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.209715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.209740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.209926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.210107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.210133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.210328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.210431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.210457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.210589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.210714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.210739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.210899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.211034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.211061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.211169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.211303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.211330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.211437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.211572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.211598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.211710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.211875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.211901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.212006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.212168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.212194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.212381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.212485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.212511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.212681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.212818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.212846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 [2024-04-27 03:32:58.213033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.213185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.264 [2024-04-27 03:32:58.213211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.264 qpair failed and we were unable to recover it. 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 [2024-04-27 03:32:58.213543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 [2024-04-27 03:32:58.213887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Write completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.264 Read completed with error (sct=0, sc=8) 00:21:33.264 starting I/O failed 00:21:33.265 Read completed with error (sct=0, sc=8) 00:21:33.265 starting I/O failed 00:21:33.265 Write completed with error (sct=0, sc=8) 00:21:33.265 starting I/O failed 00:21:33.265 Write completed with error (sct=0, sc=8) 00:21:33.265 starting I/O failed 00:21:33.265 Read completed with error (sct=0, sc=8) 00:21:33.265 starting I/O failed 00:21:33.265 Read completed with error (sct=0, sc=8) 00:21:33.265 starting I/O failed 00:21:33.265 Read completed with error (sct=0, sc=8) 00:21:33.265 starting I/O failed 00:21:33.265 [2024-04-27 03:32:58.214192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:33.265 [2024-04-27 03:32:58.214335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.214449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.214475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.214585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.214741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.214806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.214970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.215125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.215171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.215307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.215431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.215458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.215592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.215722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.215748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.215860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.216019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.216046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.216223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.216363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.216391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.216520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.216678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.216705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.216887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.217077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.217103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.217262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.217375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.217402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.217531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.217662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.217688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.217831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.217989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.218015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.218173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.218334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.218362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.218497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.218665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.218691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.218825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.218957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.218984] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.219135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.219279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.219306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.219466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.219572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.219599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.219752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.219899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.219928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.220057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.220204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.220232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.220388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.220525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.220553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.220661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.220783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.220809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.220961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.221090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.221133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.221323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.221479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.221505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.221686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.221871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.221896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.222027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.222154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.222182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.222387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.222524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.222552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.222713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.222974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.223000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.223133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.223267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.223294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.223393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.223526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.223553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.223688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.223850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.223876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.224011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.224141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.224167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.224288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.224402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.224428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.224561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.224659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.224685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.224797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.224946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.224975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.225081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.225230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.225262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.225397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.225528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.225554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.225688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.225870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.225898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.226010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.226150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.226178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.226302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.226437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.226462] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.226589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.226718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.226745] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.226875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.226987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.227015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.227140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.227298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.227325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.227461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.227598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.227625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.227724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.227856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.227882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.228009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.228135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.228160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.228263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.228392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.228417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.228513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.228639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.228664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.228788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.228891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.228917] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.229051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.229184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.265 [2024-04-27 03:32:58.229211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.265 qpair failed and we were unable to recover it. 00:21:33.265 [2024-04-27 03:32:58.229358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.229542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.229568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.229696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.229804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.229830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.229957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.230051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.230077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.230210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.230322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.230348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.230501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.230611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.230636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.230790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.230949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.230974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.231137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.231322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.231348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.231480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.231636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.231661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.231788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.231894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.231920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.232081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.232233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.232266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.232394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.232525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.232553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.232707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.232842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.232870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.232988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.233111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.233139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.233293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.233438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.233472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.233624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.233725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.233751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.233941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.234100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.234131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.234275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.234440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.234469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.234616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.234716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.234741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.234907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.235066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.235096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.235215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.235377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.235403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.235554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.235693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.235719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.235834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.236037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.236072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.236216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.236412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.236438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.236573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.236705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.236731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.236927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.237067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.266 [2024-04-27 03:32:58.237098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.266 qpair failed and we were unable to recover it. 00:21:33.266 [2024-04-27 03:32:58.237346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.237477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.237504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.567 qpair failed and we were unable to recover it. 00:21:33.567 [2024-04-27 03:32:58.237646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.237779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.237804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.567 qpair failed and we were unable to recover it. 00:21:33.567 [2024-04-27 03:32:58.237957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.238076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.238121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.567 qpair failed and we were unable to recover it. 00:21:33.567 [2024-04-27 03:32:58.238284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.238399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.238428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.567 qpair failed and we were unable to recover it. 00:21:33.567 [2024-04-27 03:32:58.238581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.238695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.238722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.567 qpair failed and we were unable to recover it. 00:21:33.567 [2024-04-27 03:32:58.238880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.239003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.567 [2024-04-27 03:32:58.239028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.239186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.239286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.239312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.239436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.239566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.239592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.239781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.239910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.239935] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.240064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.240159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.240184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.240318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.240425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.240451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.240544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.240657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.240684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.240815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.240926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.240952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.241081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.241182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.241209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.241332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.241433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.241459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.241595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.241716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.241744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.241888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.241998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.242023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.242174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.242298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.242327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.242500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.242651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.242676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.242810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.242948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.242974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.243106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.243271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.243297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.243451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.243581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.243606] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.243745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.243873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.243898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.244047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.244156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.244181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.244290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.244399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.244424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.244555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.244677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.244704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.244860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.245046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.245072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.245228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.245386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.245417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.245576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.245730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.245763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.245959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.246135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.246161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.246296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.246468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.246494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.246644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.246797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.246823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.247010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.247119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.247147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.247319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.247499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.247524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.568 qpair failed and we were unable to recover it. 00:21:33.568 [2024-04-27 03:32:58.247688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.568 [2024-04-27 03:32:58.247796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.247822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.247980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.248113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.248138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.248292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.248423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.248465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.248581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.248741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.248767] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.248925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.249054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.249081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.249268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.249437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.249470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.249618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.249770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.249795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.249928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.250033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.250059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.250232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.250397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.250423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.250579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.250708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.250735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.250868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.250994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.251019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.251151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.251258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.251285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.251390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.251520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.251547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.251657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.251756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.251782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.251915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.252055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.252081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.252208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.252372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.252398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.252513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.252615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.252642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.252771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.252904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.252931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.253100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.253286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.253316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.253466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.253597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.253624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.253775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.253921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.253961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.254094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.254228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.254275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.254434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.254537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.254568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.254687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.254829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.254866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.255047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.255190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.255220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.255368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.255516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.255542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.255672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.255778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.255803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.255959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.256110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.256135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.569 qpair failed and we were unable to recover it. 00:21:33.569 [2024-04-27 03:32:58.256266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.569 [2024-04-27 03:32:58.256411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.256440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.256632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.256762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.256788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.256953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.257053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.257079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.257258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.257412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.257437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.257571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.257736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.257761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.257889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.257994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.258020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.258133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.258291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.258317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.258425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.258581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.258606] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.258717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.258872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.258898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.259014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.259141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.259167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.259296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.259448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.259474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.259608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.259711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.259736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.259882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.260066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.260091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.260222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.260391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.260419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.260599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.260709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.260733] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.260871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.261036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.261064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.261203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.261339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.261365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.261488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.261646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.261672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.261805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.261913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.261939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.262094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.262225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.262258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.262370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.262527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.262553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.262683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.262847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.262875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.263051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.263174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.263200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.263340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.263477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.263503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.263670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.263823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.263848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.263948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.264110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.264136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.264265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.264394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.264421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.264521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.264715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.264739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.264876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.265002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.570 [2024-04-27 03:32:58.265032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.570 qpair failed and we were unable to recover it. 00:21:33.570 [2024-04-27 03:32:58.265188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.265323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.265349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.265484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.265668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.265693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.265845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.265970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.266013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.266177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.266301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.266328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.266451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.266615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.266640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.266747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.266884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.266909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.267022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.267191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.267219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.267387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.267522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.267547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.267713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.267855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.267883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.268011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.268142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.268174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.268354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.268499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.268528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.268707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.268888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.268953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.269102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.269216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.269241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.269382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.269509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.269535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.269675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.269828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.269857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.270035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.270164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.270207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.270381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.270541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.270567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.270697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.270794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.270836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.270990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.271098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.271124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.271258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.271369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.271395] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.271509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.271638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.271667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.271865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.272000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.272026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.272158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.272299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.272325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.272480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.272606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.272634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.272789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.272915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.272941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.273073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.273178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.273204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.273345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.273474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.273501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.571 qpair failed and we were unable to recover it. 00:21:33.571 [2024-04-27 03:32:58.273632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.273768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.571 [2024-04-27 03:32:58.273794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.273961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.274092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.274120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.274244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.274381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.274408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.274567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.274705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.274732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.274833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.274966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.274993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.275149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.275301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.275328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.275455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.275592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.275621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.275776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.275902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.275926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.276076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.276206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.276232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.277470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.277658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.277690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.277832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.277998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.278028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.278162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.278292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.278318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.278455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.278593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.278619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.278765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.278928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.278954] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.279082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.279237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.279272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.279432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.279559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.279589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.279741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.279908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.279938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.280061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.280210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.280237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.280362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.280474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.280500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.280633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.280760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.280787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.280944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.281050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.281076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.572 qpair failed and we were unable to recover it. 00:21:33.572 [2024-04-27 03:32:58.281233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.281374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.572 [2024-04-27 03:32:58.281400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.281533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.281642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.281668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.281800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.281935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.281961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.282089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.282220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.282256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.282397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.282501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.282527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.282673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.282833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.282860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.283020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.283152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.283178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.283298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.283404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.283431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.283591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.283700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.283727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.283834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.283933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.283965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.284121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.284222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.284255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.284383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.284484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.284511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.284625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.284780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.284811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.284944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.285071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.285098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.285210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.285355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.285382] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.285514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.285622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.285648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.285799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.285933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.285959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.286074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.286175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.286200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.286338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.286445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.286472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.286609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.286750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.286776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.286889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.287000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.287027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.287198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.287343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.287370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.287487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.287643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.287668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.287804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.287991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.288016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.288147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.288275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.288311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.288419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.288530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.288556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.288694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.288807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.288834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.288962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.289094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.289120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.289225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.289336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.289362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.573 qpair failed and we were unable to recover it. 00:21:33.573 [2024-04-27 03:32:58.289464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.573 [2024-04-27 03:32:58.289611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.289654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.289756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.289884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.289910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.290045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.290191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.290221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.290387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.290502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.290528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.290658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.290789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.290815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.290978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.291132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.291158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.291302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.291461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.291489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.291631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.291792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.291818] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.291971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.292127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.292153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.292312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.292445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.292472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.292699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.292819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.292847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.293019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.293165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.293193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.293304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.293457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.293482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.293646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.293789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.293814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.293991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.294159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.294194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.294346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.294474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.294500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.294632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.294765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.294791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.294945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.295097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.295123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.295224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.295362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.295389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.295546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.295679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.295722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.295867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.296037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.296066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.296214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.296349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.296392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.296530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.296634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.296659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.296792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.296944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.296972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.297129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.297269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.297305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.297437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.297573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.297600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.297732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.297837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.297862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.297993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.298150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.298177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.298279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.298409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.574 [2024-04-27 03:32:58.298435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.574 qpair failed and we were unable to recover it. 00:21:33.574 [2024-04-27 03:32:58.298538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.298647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.298673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.298770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.298911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.298938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.299074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.299233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.299291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.299420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.299586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.299614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.299765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.299946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.299972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.300124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.300264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.300313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.300417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.300543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.300569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.300700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.300845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.300871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.301002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.301127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.301153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.301289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.301382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.301408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.301533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.301655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.301684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.301835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.301996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.302022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.302178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.302373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.302399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.302556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.302711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.302740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.302858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.303021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.303047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.303206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.303364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.303390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.303567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.303681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.303709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.303847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.303983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.304010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.304140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.304278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.304305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.304439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.304563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.304590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.304722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.304874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.304916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.305061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.305232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.305269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.305415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.305570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.305597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.305696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.305819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.305844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.305976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.306111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.306140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.306321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.306446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.306471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.306591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.306745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.306771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.306875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.306998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.307024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.307124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.307276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.575 [2024-04-27 03:32:58.307306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.575 qpair failed and we were unable to recover it. 00:21:33.575 [2024-04-27 03:32:58.307428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.307586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.307612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.307739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.307896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.307922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.308057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.308222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.308258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.308389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.308485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.308511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.308602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.308758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.308783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.308941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.309042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.309067] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.309210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.309337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.309363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.309497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.309616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.309642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.309751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.309862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.309887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.309998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.310108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.310134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.310270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.310377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.310406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.310546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.310703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.310729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.310833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.310963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.310988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.311118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.311217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.311243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.311389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.311533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.311566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.311718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.311846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.311876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.312003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.312129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.312154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.312293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.312401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.312427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.312519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.312639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.312664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.312798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.312947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.312975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.313099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.313212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.313237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.313385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.313522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.313548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.313688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.313888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.313913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.314046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.314176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.314202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.314306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.314409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.314435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.314564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.314719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.314761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.314890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.315030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.315056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.315167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.315297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.315332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.315459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.315609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.576 [2024-04-27 03:32:58.315635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.576 qpair failed and we were unable to recover it. 00:21:33.576 [2024-04-27 03:32:58.315761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.315908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.315936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.316066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.316208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.316235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.316345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.316477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.316502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.316678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.316863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.316888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.317023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.317137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.317162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.317305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.317435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.317461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.317566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.317728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.317753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.317893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.318024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.318049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.318158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.318290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.318320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.318449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.318547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.318572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.318684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.318819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.318844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.318963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.319114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.319144] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.319313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.319471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.319497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.319628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.319781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.319807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.319985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.320113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.320138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.320298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.320425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.320450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.320582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.320714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.320741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.320858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.321022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.321051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.321236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.321397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.321423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.321581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.321713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.321754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.321900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.322053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.322078] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.322253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.322409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.322435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.322549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.322658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.322685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.577 [2024-04-27 03:32:58.322817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.322956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.577 [2024-04-27 03:32:58.322985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.577 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.323175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.323277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.323309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.323467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.323570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.323595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.323726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.323857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.323882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.324057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.324185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.324213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.324399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.324528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.324553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.324658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.324785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.324811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.324966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.325115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.325140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.325265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.325372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.325398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.325500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.325644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.325669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.325792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.325939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.325973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.326096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.326230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.326263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.326417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.326567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.326595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.326730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.326879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.326905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.327062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.327235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.327304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.327445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.327613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.327642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.327758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.327900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.327928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.328080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.328182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.328208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.328342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.328490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.328519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.328674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.328804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.328832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.328960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.329097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.329122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.329236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.329384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.329411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.329525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.329667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.329693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.329839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.329972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.329997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.330150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.330337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.330363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.330500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.330633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.330659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.330758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.330889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.330915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.331054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.331175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.331204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.331359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.331473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.331500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.331624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.331760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.578 [2024-04-27 03:32:58.331787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.578 qpair failed and we were unable to recover it. 00:21:33.578 [2024-04-27 03:32:58.331915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.332065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.332093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.332264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.332412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.332438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.332569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.332696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.332723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.332905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.333049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.333077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.333235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.333366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.333392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.333526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.333653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.333679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.333835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.334018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.334048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.334185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.334307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.334334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.334496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.334637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.334688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.334809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.334954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.334983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.335166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.335322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.335349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.335482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.335616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.335643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.335813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.335961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.335990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.336099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.336222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.336259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.336416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.336580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.336621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.336780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.336935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.336961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.337139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.337295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.337320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.337446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.337546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.337571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.337730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.337899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.337927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.338106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.338310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.338362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.338520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.338678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.338719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.338842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.339031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.339056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.339189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.339346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.339387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.339488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.339584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.339610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.339714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.339866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.339891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.340078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.340211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.340239] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.340405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.340537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.340562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.340730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.340897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.340934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.579 [2024-04-27 03:32:58.341073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.341204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.579 [2024-04-27 03:32:58.341230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.579 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.341393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.341535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.341560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.341671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.341849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.341878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.342060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.342213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.342238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.342438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.342549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.342575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.342678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.342833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.342858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.343010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.343152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.343182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.343337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.343448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.343474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.343646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.343774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.343801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.343969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.344153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.344181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.344302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.344431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.344456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.344620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.344774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.344799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.344955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.345139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.345166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.345316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.345445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.345472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.345604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.345758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.345788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.345946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.346129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.346157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.346313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.346469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.346495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.346626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.346779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.346804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.346933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.347108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.347136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.347290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.347396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.347422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.347533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.347675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.347703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.347851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.348027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.348063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.348218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.348344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.348371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.348499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.348653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.348678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.348813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.348964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.348990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.349135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.349301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.349328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.349462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.349595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.349620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.349757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.349909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.349938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.350098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.350256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.580 [2024-04-27 03:32:58.350299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.580 qpair failed and we were unable to recover it. 00:21:33.580 [2024-04-27 03:32:58.350446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.350589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.350623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.350768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.350911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.350939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.351083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.351190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.351215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.351354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.351483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.351508] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.351658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.351804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.351832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.351984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.352143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.352168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.352338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.352472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.352500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.352682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.352823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.352852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.353007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.353138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.353166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.353348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.353468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.353497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.353650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.353754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.353780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.353911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.354070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.354095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.354258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.354407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.354432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.354588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.354704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.354732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.354874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.355004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.355030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.355216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.355337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.355367] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.355538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.355692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.355717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.355859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.356015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.356040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.356171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.356351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.356378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.356511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.356609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.356635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.581 qpair failed and we were unable to recover it. 00:21:33.581 [2024-04-27 03:32:58.356765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.581 [2024-04-27 03:32:58.356920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.356945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.357058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.357191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.357219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.357355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.357512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.357538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.357667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.357828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.357853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.358012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.358179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.358204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.358324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.358455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.358480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.358644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.358830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.358888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.359059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.359170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.359211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.359347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.359479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.359505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.359605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.359714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.359751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.359887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.360057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.360085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.360221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.360373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.360401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.360557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.360665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.360690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.360821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.360977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.361003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.361128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.361294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.361321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.361458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.361607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.361633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.582 qpair failed and we were unable to recover it. 00:21:33.582 [2024-04-27 03:32:58.361807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.582 [2024-04-27 03:32:58.361956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.361981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.362091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.362254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.362280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.362433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.362540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.362569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.362735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.362921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.362981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.363123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.363306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.363332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.363461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.363623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.363649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.363799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.363915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.363945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.364125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.364286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.364313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.364474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.364602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.364628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.364789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.364966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.364994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.365118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.365268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.365297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.365460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.365588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.365613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.365768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.365925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.365950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.366069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.366191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.366216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.366390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.366498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.366523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.366644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.366770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.366812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.366985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.367137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.367162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.367293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.367422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.367447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.367619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.367759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.367787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.367958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.368064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.368090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.368226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.368372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.368398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.583 qpair failed and we were unable to recover it. 00:21:33.583 [2024-04-27 03:32:58.368535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.368667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.583 [2024-04-27 03:32:58.368694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.368841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.368984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.369012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.369140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.369268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.369299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.369410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.369515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.369552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.369667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.369804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.369832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.369974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.370096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.370121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.370264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.370395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.370421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.370555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.370686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.370712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.370847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.370941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.370966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.371101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.371233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.371269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.371407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.371511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.371561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.371739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.371860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.371885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.372039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.372212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.372240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.372411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.372569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.372594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.372790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.372923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.372948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.373074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.373225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.373263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.373402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.373575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.373604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.373759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.373891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.373916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.374074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.374213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.374238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.374383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.374537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.374569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.374726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.374877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.374905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.375057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.375179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.375207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.376139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.376299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.376330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.376482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.376591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.376618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.376774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.376931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.376957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.377092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.377219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.377255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.377401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.377514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.377548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.377672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.377822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.377854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.584 qpair failed and we were unable to recover it. 00:21:33.584 [2024-04-27 03:32:58.378026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.584 [2024-04-27 03:32:58.378199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.378227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.378391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.378534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.378570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.378756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.378924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.378953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.379096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.379231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.379266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.379421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.379577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.379618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.379787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.379925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.379955] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.380075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.380190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.380220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.380416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.380553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.380580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.380714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.380874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.380900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.381068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.381189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.381217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.381376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.381541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.381567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.381721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.381891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.381928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.382084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.382224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.382260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.382424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.382526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.382553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.382707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.382880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.382945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.383104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.383266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.383301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.383457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.383576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.383601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.383773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.383929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.383958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.384088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.384236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.384272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.384407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.384541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.384569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.384687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.384827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.384853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.385001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.385143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.385172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.385299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.385464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.385489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.385597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.385752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.385782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.385959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.386104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.386133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.386295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.386392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.386417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.386526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.386729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.386757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.386927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.387079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.387112] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.387272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.387420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.387445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.585 qpair failed and we were unable to recover it. 00:21:33.585 [2024-04-27 03:32:58.387565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.585 [2024-04-27 03:32:58.387687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.387717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.387867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.388014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.388041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.388146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.388276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.388311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.388420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.388563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.388605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.388768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.388930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.388958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.389104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.389258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.389284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.389441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.389593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.389622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.389777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.389893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.389929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.390060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.390192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.390218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.390383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.390551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.390580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.390747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.390897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.390926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.391105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.391238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.391271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.391388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.391567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.391596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.391750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.391901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.391927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.392060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.392192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.392217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.392320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.392491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.392522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.392687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.392819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.392846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.392949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.393115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.393141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.393346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.393475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.393501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.393631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.393774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.393802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.393977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.394084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.394110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.394298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.394443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.394471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.394617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.394794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.394821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.394987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.395122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.395147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.395285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.395442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.395471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.395625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.395783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.395809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.395936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.396038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.396064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.396193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.396346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.396372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.396526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.396713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.396739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.586 qpair failed and we were unable to recover it. 00:21:33.586 [2024-04-27 03:32:58.396894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.586 [2024-04-27 03:32:58.397011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.397037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.397167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.397302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.397330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.397482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.397671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.397697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.397834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.397965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.397998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.398121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.398259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.398298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.398416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.398550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.398578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.398725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.398855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.398881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.399040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.399196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.399224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.399392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.399550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.399577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.399703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.399809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.399835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.399959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.400083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.400124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.400305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.400423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.400452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.400612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.400770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.400796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.400898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.401044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.401072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.401239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.401389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.401418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.401572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.401708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.401734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.401867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.401965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.401993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.402149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.402298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.402334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.402463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.402575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.402601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.402733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.402896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.402922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.403074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.403215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.403256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.403444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.403575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.403601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.403759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.403899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.403927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.404074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.404217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.404254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.587 [2024-04-27 03:32:58.404390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.404518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.587 [2024-04-27 03:32:58.404544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.587 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.404721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.404887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.404913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.405068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.405214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.405242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.405416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.405523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.405548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.405692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.405828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.405856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.406010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.406162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.406190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.406343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.406473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.406500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.406634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.406780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.406810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.406964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.407143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.407171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.407280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.407465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.407490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.407656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.407792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.407820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.407957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.408126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.408155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.408308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.408465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.408491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.408602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.408732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.408758] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.408884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.409029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.409057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.409219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.409421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.409451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.409602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.409709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.409738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.409856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.410023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.410051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.410204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.410342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.410368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.410473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.410656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.410685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.410855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.411020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.411049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.411230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.411366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.411410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.411556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.411714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.411740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.411842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.412002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.412028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.412154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.412298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.412324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.412464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.412606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.412635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.412829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.412996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.413022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.413155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.413289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.413317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.413434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.413564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.413592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.588 [2024-04-27 03:32:58.413721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.413857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.588 [2024-04-27 03:32:58.413883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.588 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.414013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.414177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.414221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.414377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.414533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.414561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.414708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.414847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.414876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.415005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.415174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.415201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.415423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.415635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.415687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.415857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.415971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.416001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.416167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.416273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.416308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.416438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.416580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.416607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.416711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.416858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.416900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.417040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.417150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.417176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.417352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.417468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.417496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.417611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.417727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.417752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.417880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.418017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.418050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.418243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.418404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.418432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.418620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.418790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.418816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.418946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.419078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.419104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.419266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.419432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.419458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.419560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.419673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.419719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.419882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.419983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.420010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.420166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.420315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.420344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.420485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.420711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.420778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.420934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.421069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.421095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.421258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.421375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.421401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.421532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.421642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.421667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.421798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.421932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.421957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.422104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.422291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.422322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.422481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.422611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.422640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.422823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.422956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.422981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.589 qpair failed and we were unable to recover it. 00:21:33.589 [2024-04-27 03:32:58.423138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.589 [2024-04-27 03:32:58.423273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.423326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.423505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.423640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.423665] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.423781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.423916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.423942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.424114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.424264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.424294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.424430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.424534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.424560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.424697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.424800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.424826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.424941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.425114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.425142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.425295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.425429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.425471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.425613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.425745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.425770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.425966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.426098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.426124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.426293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.426460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.426488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.426642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.426775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.426803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.426933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.427055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.427080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.427182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.427380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.427406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.427544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.427675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.427701] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.427852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.428017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.428046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.428219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.428355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.428397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.428541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.428652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.428695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.428850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.428977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.429007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.429142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.429260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.429302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.429432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.429570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.429596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.429755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.429891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.429920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.430064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.430208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.430233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.430393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.430558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.430587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.430744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.430867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.430892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.431040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.431165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.431191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.431377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.431553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.431579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.431767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.431900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.431925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.432033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.432172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.432198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.590 qpair failed and we were unable to recover it. 00:21:33.590 [2024-04-27 03:32:58.432344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.590 [2024-04-27 03:32:58.432488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.432522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.432662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.432806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.432836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.432980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.433159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.433188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.433317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.433448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.433474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.433605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.433756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.433783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.433919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.434067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.434095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.434309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.434427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.434457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.434606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.434728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.434754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.434882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.434990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.435020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.435186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.435313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.435340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.435496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.435655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.435680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.435807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.435962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.435992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.436119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.436312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.436339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.436464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.436633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.436660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.436813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.436955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.436985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.437150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.437284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.437311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.437504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.437669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.437695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.437800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.437929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.437955] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.438107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.438298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.438327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.438505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.438683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.438711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.438897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.438994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.439019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.439152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.439298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.439331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.439470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.439659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.439685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.439851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.440005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.440031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.440140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.440296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.440322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.591 [2024-04-27 03:32:58.440464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.440610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.591 [2024-04-27 03:32:58.440638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.591 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.440780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.440962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.440987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.441117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.441256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.441283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.441439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.441567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.441597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.441814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.441981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.442010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.442177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.442323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.442352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.442526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.442655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.442697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.442846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.443014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.443043] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.443217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.443378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.443407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.443584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.443810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.443858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.443999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.444157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.444183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.444353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.444496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.444524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.444751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.444883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.444909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.445068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.445253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.445282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.445435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.445542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.445568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.445713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.445865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.445891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.446053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.446182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.446207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.446348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.446451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.446477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.446605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.446705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.446730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.446893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.447029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.447055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.447212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.447360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.447389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.447530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.447672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.447698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.447856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.447959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.447985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.448167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.448301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.448331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.448504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.448804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.448864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.449013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.449143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.449171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.449331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.449462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.449504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.449651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.449768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.449797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.449968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.450155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.450180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.450321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.450429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.450456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.450589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.450720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.450746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.592 qpair failed and we were unable to recover it. 00:21:33.592 [2024-04-27 03:32:58.450937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.451093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.592 [2024-04-27 03:32:58.451118] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.451277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.451425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.451456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.451635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.451791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.451817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.451927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.452059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.452085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.452262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.452443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.452469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.452598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.452766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.452794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.452940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.453084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.453113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.453266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.453396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.453422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.453576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.453719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.453748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.453899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.454078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.454107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.454262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.454410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.454439] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.454595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.454731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.454773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.454950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.455059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.455085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.455242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.455370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.455398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.455567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.455683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.455712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.455848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.455974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.456000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.456095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.456228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.456266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.456400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.456520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.456549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.456719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.456850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.456876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.457008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.457138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.457163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.457293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.457424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.457450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.457584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.457741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.457768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.457896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.458027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.458053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.458150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.458287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.458315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.458428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.458559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.458585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.458712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.458845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.458871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.459032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.459157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.459183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.459287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.459397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.459423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.459524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.459655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.459681] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.459818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.459922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.459948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.460074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.460179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.460205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.460316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.460473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.593 [2024-04-27 03:32:58.460499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.593 qpair failed and we were unable to recover it. 00:21:33.593 [2024-04-27 03:32:58.460627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.460753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.460779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.460917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.461047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.461073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.461206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.461324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.461350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.461457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.461594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.461620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.461752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.461856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.461881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.462041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.462166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.462191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.462300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.462453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.462479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.462590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.462698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.462724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.462864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.462998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.463024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.463133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.463272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.463298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.463430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.463553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.463579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.463708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.463864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.463889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.464024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.464161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.464187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.464298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.464399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.464425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.464560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.464691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.464717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.464874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.464999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.465025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.465154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.465285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.465311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.465419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.465521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.465547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.465670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.465796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.465822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.465957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.466056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.466083] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.466185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.466342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.466369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.466499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.466630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.466656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.466792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.466951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.466976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.467105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.467234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.467266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.467405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.467514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.467540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.467647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.467812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.467838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.467995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.468136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.468162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.468293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.468452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.468478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.468643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.468751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.468776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.468890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.468985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.469010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.469141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.469271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.469298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.594 qpair failed and we were unable to recover it. 00:21:33.594 [2024-04-27 03:32:58.469405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.594 [2024-04-27 03:32:58.469505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.469530] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.469628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.469758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.469784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.469894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.470025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.470051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.470177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.470320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.470347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.470477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.470611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.470642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.470804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.470919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.470945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.471075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.471182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.471209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.471366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.471474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.471499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.471598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.471705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.471730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.471862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.471993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.472018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.472123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.472257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.472284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.472415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.472548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.472573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.472707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.472835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.472861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.472962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.473088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.473114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.473240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.473357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.473383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.473487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.473617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.473643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.473774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.473878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.473904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.474038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.474166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.474192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.474384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.474493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.474518] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.474628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.474739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.474765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.474891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.475044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.475070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.475268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.475411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.475439] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.475578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.475731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.475757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.475909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.476081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.476106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.476212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.476356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.476382] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.476557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.476673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.476703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.476856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.477012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.477037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.477198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.477327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.477354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.477521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.477651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.477694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.477858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.478018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.478044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.478170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.478337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.478366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.478478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.478604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.595 [2024-04-27 03:32:58.478632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.595 qpair failed and we were unable to recover it. 00:21:33.595 [2024-04-27 03:32:58.478778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.478900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.478926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.479107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.479258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.479287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.479397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.479563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.479592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.479742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.479910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.479939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.480084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.480186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.480214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.480360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.480507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.480536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.480778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.480913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.480941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.481085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.481271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.481298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.481432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.481560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.481586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.481717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.481871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.481897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.482002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.482159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.482185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.482320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.482498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.482524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.482630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.482759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.482785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.482920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.483068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.483097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.483210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.483386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.483416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.483560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.483735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.483764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.483904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.484035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.484061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.484216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.484368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.484397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.484547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.484645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.484671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.484795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.484978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.485006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.485182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.485290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.485317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.485449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.485594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.485623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.485770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.485935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.485965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.486112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.486273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.486304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.486413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.486543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.486570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.486725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.486876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.486905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.596 [2024-04-27 03:32:58.487048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.487192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.596 [2024-04-27 03:32:58.487222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.596 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.487389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.487546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.487572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.487676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.487832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.487858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.488056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.488160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.488186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.488310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.488458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.488487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.488632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.488746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.488787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.488898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.489053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.489079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.489232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.489352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.489386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.489530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.489648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.489677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.489840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.489984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.490026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.490181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.490317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.490361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.490482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.490624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.490654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.490825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.490984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.491009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.491138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.491298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.491328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.491456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.491582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.491608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.491707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.491835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.491861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.491998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.492166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.492195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.492312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.492451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.492480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.492642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.492746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.492772] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.492895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.493051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.493077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.493206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.493360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.493404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.493507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.493652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.493680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.493839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.493990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.494016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.494208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.494348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.494374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.494540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.494689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.494715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.494866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.494983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.495012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.495139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.495298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.495325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.495521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.495651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.495677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.495836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.495945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.495975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.496118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.496269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.496296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.496430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.496585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.496627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.496773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.496884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.496913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.497058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.497199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.497227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.597 [2024-04-27 03:32:58.497349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.497457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.597 [2024-04-27 03:32:58.497485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.597 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.497629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.497755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.497781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.497966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.498096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.498122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.498274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.498392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.498420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.498534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.498705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.498731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.498861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.498998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.499024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.499157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.499311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.499341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.499484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.499590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.499617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.499748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.499869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.499899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.500079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.500187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.500212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.500354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.500468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.500498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.500645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.500785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.500813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.500954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.501094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.501141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.501270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.501373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.501399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.501547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.501713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.501742] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.501887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.502032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.502064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.502175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.502288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.502318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.502444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.502568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.502593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.502749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.502854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.502883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.503024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.503184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.503209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.503348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.503477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.503503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.503651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.503778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.503803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.503914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.504037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.504065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.504256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.504384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.504410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.504562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.504709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.504738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.504871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.504999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.505029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.505213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.505347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.505377] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.505502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.505638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.505664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.505799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.505979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.506008] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.506159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.506294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.506321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.506456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.506601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.506627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.506783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.506937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.506965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.507083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.507218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.507262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.507442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.507550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.507576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.598 qpair failed and we were unable to recover it. 00:21:33.598 [2024-04-27 03:32:58.507720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.598 [2024-04-27 03:32:58.507854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.507879] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.508008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.508159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.508186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.508327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.508458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.508483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.508642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.508748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.508774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.508935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.509086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.509115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.509234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.509378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.509407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.509531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.509678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.509703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.509834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.509942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.509967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.510102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.510263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.510289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.510447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.510576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.510602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.510775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.510926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.510951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.511083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.511210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.511235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.511420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.511553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.511579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.511746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.511889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.511917] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.512055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.512197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.512224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.512398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.512530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.512557] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.512700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.512879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.512923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.513079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.513263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.513308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.513417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.513598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.513642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.513837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.514063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.514092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.514282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.514409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.514453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.514629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.514790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.514834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.514986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.515138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.515167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.515408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.515566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.515596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.515713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.515858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.515886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.516012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.516184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.516209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.516346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.516527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.516556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.516670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.516786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.516815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.516943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.517090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.517118] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.517260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.517380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.517406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.517530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.517651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.517679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.517790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.517931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.517961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.518115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.518225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.518260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.518401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.518541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.518602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.518725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.518864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.518892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.519022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.519167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.519196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.599 qpair failed and we were unable to recover it. 00:21:33.599 [2024-04-27 03:32:58.519317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.599 [2024-04-27 03:32:58.519459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.519488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.519664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.519806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.519835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.519978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.520123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.520152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.520266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.520425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.520451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.520606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.520759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.520802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.520953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.521096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.521125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.521257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.521381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.521407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.521529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.521647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.521676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.521819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.521936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.521965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.522117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.522254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.522281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.522390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.522553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.522579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.522703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.522879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.522908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.523079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.523213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.523237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.523383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.523496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.523521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.523646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.523845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.523874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.524039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.524159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.524185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.524325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.524466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.524492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.524691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.524857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.524886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.525012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.525153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.525182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.525329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.525485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.525512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.525664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.525780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.600 [2024-04-27 03:32:58.525807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.600 qpair failed and we were unable to recover it. 00:21:33.600 [2024-04-27 03:32:58.525952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.526090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.526119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.526236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.526383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.526409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.526512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.526614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.526640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.526797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.526938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.526967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.527109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.527234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.527288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.527425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.527563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.527605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.527776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.527924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.527954] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.528087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.528243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.528277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.528382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.528511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.528537] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.528654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.528781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.528808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.528925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.529031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.529060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.529204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.529406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.529433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.529565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.529670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.529697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.873 qpair failed and we were unable to recover it. 00:21:33.873 [2024-04-27 03:32:58.529815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.873 [2024-04-27 03:32:58.529942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.529971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.530092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.530204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.530233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.530396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.530582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.530612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.530758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.530947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.530976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.531180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.531337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.531364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.531495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.531621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.531650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.531787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.531931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.531961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.532121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.532245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.532278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.532400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.532532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.532558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.532682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.532818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.532843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.532969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.533087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.533116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.533271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.533381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.533408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.533519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.533672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.533703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.533838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.534022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.534049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.534162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.534314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.534344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.534468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.534618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.534647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.534799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.534900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.534926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.535047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.535158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.535186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.535296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.535449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.535477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.535631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.535807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.535837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.535962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.536095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.536121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.536269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.536378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.536406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.536531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.536661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.536692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.536798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.536912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.536941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.537120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.537225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.874 [2024-04-27 03:32:58.537259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.874 qpair failed and we were unable to recover it. 00:21:33.874 [2024-04-27 03:32:58.537422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.537582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.537608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.537718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.537841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.537870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.537982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.538123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.538153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.538310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.538413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.538438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.538591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.538700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.538729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.538912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.539048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.539075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.539228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.539405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.539434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.539607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.539742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.539789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.539966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.540067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.540094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.540278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.540397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.540426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.540581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.540759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.540784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.540909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.541038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.541064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.541199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.541318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.541348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.541486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.541607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.541633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.541758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.541938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.541964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.542094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.542225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.542256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.542412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.542607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.542633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.542764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.542889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.542918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.543046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.543192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.543221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.543357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.543484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.543509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.543668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.543782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.543812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.543936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.544087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.544116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.544238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.544360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.544389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.544515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.544674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.544699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.875 [2024-04-27 03:32:58.544846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.545000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.875 [2024-04-27 03:32:58.545026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.875 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.545170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.545333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.545364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.545514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.545636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.545661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.545799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.545960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.546003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.546151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.546290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.546320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.546458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.546628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.546657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.546799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.546937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.546965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.547093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.547225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.547255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.547434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.547576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.547605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.547750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.547865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.547894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.548046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.548191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.548220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.548364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.548497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.548523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.548654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.548781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.548810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.548956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.549078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.549107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.549282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.549425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.549456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.549633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.549789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.549831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.549976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.550098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.550127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.550253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.550365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.550393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.550541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.550674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.550702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.550840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.550976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.551003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.551128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.551258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.551287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.551407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.551552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.551581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.551721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.551868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.551897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.552028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.552183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.552209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.552326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.552463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.552490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.552620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.552761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.552791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.552902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.553017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.553048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.553206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.553367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.553394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.553531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.553662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.553690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.876 qpair failed and we were unable to recover it. 00:21:33.876 [2024-04-27 03:32:58.553831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.876 [2024-04-27 03:32:58.553974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.554000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.554130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.554257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.554289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.554443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.554607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.554648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.554794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.554935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.554962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.555091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.555236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.555273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.555398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.555515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.555544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.555677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.555809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.555836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.555942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.556043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.556069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.556178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.556285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.556312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.556424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.556535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.556560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.556682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.556818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.556845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.556991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.557139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.557165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.557292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.557444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.557474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.557635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.557764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.557791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.557925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.558058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.558083] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.558263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.558393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.558420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.558528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.558623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.558651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.558763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.558909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.558938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.559082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.559180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.559208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.559343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.559474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.559501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.559632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.559738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.559763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.559895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.559996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.560022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.877 qpair failed and we were unable to recover it. 00:21:33.877 [2024-04-27 03:32:58.560153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.877 [2024-04-27 03:32:58.560285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.560312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.560421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.560567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.560594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.560713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.560856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.560884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.561012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.561148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.561178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.561321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.561452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.561478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.561631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.561773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.561801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.561946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.562119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.562148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.562296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.562464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.562492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.562646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.562756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.562781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.562908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.563054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.563082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.563231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.563359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.563389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.563542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.563697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.563724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.563856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.563971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.563997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.564129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.564265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.564293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.564426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.564604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.564630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.564756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.564881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.564910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.565035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.565166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.565193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.565301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.565399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.565427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.565558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.565731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.565759] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.565869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.566011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.566041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.566193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.566309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.566336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.566473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.566607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.566632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.566791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.566917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.878 [2024-04-27 03:32:58.566946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.878 qpair failed and we were unable to recover it. 00:21:33.878 [2024-04-27 03:32:58.567094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.567207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.567236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.567374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.567510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.567536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.567652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.567795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.567824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.567967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.568112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.568141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.568300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.568438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.568464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.568623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.568747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.568772] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.568933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.569053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.569079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.569192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.569312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.569339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.569442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.569549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.569575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.569707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.569845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.569872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.569977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.570108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.570137] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.570297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.570428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.570454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.570553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.570708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.570737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.570879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.571003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.571029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.571197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.571329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.571356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.571494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.571610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.571637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.571769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.571900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.571926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.572054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.572149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.572175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.572290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.572440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.572470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.572588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.572752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.572778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.572899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.573026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.573055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.573204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.573313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.573339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.573446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.573569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.573595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.573760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.573906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.573931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.574083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.574227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.574261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.574395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.574501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.574528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.574687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.574836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.574865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.879 [2024-04-27 03:32:58.574979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.575146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.879 [2024-04-27 03:32:58.575175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.879 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.575313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.575437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.575466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.575592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.575710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.575737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.575869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.576016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.576044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.576162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.576274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.576303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.576419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.576569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.576598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.576748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.576877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.576903] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.577070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.577241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.577276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.577394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.577537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.577566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.577773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.577961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.577990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.578110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.578219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.578261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.578440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.578603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.578630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.578737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.578864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.578890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.579006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.579131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.579163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.579310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.579420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.579448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.579598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.579722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.579750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.579864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.580014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.580039] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.580169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.580317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.580346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.580499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.580631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.580656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.580786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.580900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.580928] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.581098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.581231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.581263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.581396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.581565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.581608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.581774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.581881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.581906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.582060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.582216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.582274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.582416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.582695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.582725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.582931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.583112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.583138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.583241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.583391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.583418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.583578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.583732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.583757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.583889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.583993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.584020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.880 qpair failed and we were unable to recover it. 00:21:33.880 [2024-04-27 03:32:58.584197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.584377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.880 [2024-04-27 03:32:58.584407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.584555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.584660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.584687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.584795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.584964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.584993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.585138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.585294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.585321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.585473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.585629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.585662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.585796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.585903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.585929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.586052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.586202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.586230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.586377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.586496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.586524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.586700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.586834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.586859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.586963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.587094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.587120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.587256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.587375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.587405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.587546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.587660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.587703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.587833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.587959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.587988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.588134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.588243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.588273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.588425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.588557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.588591] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.588731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.588850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.588878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.589012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.589158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.589187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.589343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.589472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.589497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.589650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.589762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.589790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.589939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.590105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.590133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.590275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.590452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.590481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.590603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.590709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.590735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.590925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.591024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.591050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.591160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.591290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.591320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.591445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.591602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.591629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.591766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.591921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.591947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.592076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.592191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.592221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.592351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.592471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.592503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.592651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.592819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.592847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.881 qpair failed and we were unable to recover it. 00:21:33.881 [2024-04-27 03:32:58.592972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.881 [2024-04-27 03:32:58.593125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.593151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.593258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.593411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.593448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.593630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.593736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.593763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.593915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.594072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.594100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.594265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.594368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.594394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.594502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.594648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.594677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.594853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.594995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.595024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.595150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.595300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.595329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.595479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.595590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.595616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.595770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.595899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.595929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.596083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.596242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.596273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.596396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.596517] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.596545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.596693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.596800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.596825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.596952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.597090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.597119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.597259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.597399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.597429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.597579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.597725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.597754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.597925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.598089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.598116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.598267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.598390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.598419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.598602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.598732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.598759] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.598898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.599046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.599071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.599174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.599281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.599307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.599458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.599566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.599596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.599748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.599905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.599931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.600088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.600228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.600262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.600419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.600527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.600552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.600654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.600807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.600835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.601011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.601143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.601169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.601324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.601438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.601466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.601599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.601696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.601722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.882 qpair failed and we were unable to recover it. 00:21:33.882 [2024-04-27 03:32:58.601879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.882 [2024-04-27 03:32:58.602022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.602049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.602218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.602349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.602379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.602538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.602692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.602717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.602828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.602961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.602986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.603141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.603320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.603349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.603472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.603660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.603685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.603793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.603946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.603972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.604109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.604237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.604269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.604380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.604526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.604555] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.604726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.604871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.604899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.605047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.605195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.605238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.605403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.605529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.605573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.605714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.605857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.605887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.606032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.606147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.606178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.606363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.606521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.606547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.606688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.606824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.606852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.607001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.607149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.607178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.607347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.607455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.607481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.607605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.607726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.607755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.607879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.607990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.608016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.608172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.608326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.608355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.608531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.608691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.608717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.608870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.609039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.609067] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.609241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.609398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.609427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.883 qpair failed and we were unable to recover it. 00:21:33.883 [2024-04-27 03:32:58.609561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.883 [2024-04-27 03:32:58.609697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.609726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.609903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.610043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.610072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.610227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.610366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.610393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.610504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.610602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.610629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.610749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.610860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.610886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.611018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.611168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.611197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.611349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.611527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.611557] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.611699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.611854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.611881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.612015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.612193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.612222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.612372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.612535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.612564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.612730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.612893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.612923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.613068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.613220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.613270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.613440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.613583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.613613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.613781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.613921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.613950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.614089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.614262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.614293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.614427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.614556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.614582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.614702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.614846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.614875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.615022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.615168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.615198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.615353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.615475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.615504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.615630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.615755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.615781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.616010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.616159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.616188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.616347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.616492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.616521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.616669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.616800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.616826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.617035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.617225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.617257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.617417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.617547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.617576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.617747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.617896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.617926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.618074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.618224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.618261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.618422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.618575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.618617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.618799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.618951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.884 [2024-04-27 03:32:58.618977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.884 qpair failed and we were unable to recover it. 00:21:33.884 [2024-04-27 03:32:58.619113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.619291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.619322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.619465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.619609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.619641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.619796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.619922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.619948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.620137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.620293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.620320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.620509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.620683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.620712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.620872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.621030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.621056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.621192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.621327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.621354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.621512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.621697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.621727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.621852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.621989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.622018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.622154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.622326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.622356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.622510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.622616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.622644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.622759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.622919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.622946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.623119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.623226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.623266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.623487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.623627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.623669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.623849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.623987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.624014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.624150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.624303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.624330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.624487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.624603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.624632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.624779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.624922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.624966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.625101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.625235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.625284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.625435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.625602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.625631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.625785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.625942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.625968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.626094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.626211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.626240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.626436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.626542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.626569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.626778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.626924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.626953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.627126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.627286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.627314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.627447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.627581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.627608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.627764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.627929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.627958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.628094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.628230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.628263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.628395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.628549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.885 [2024-04-27 03:32:58.628578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.885 qpair failed and we were unable to recover it. 00:21:33.885 [2024-04-27 03:32:58.628756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.628890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.628915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.629045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.629200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.629226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.629366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.629522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.629551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.629727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.629878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.629915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.630085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.630257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.630297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.630463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.630571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.630608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.630766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.630911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.630940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.631055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.631170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.631199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.631317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.631467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.631493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.631623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.631778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.631820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.631981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.632116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.632142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.632301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.632448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.632477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.632649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.632795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.632823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.632981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.633109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.633135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.633235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.633338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.633366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.633474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.633569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.633595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.633736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.633922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.633951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.634076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.634230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.634267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.634407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.634563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.634594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.634812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.634944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.634972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.635098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.635268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.635298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.635452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.635574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.635600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.635718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.635873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.635901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.636051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.636176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.636202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.636360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.636504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.636530] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.636688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.636821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.636865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.636991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.637168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.637197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.637363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.637487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.637513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.886 [2024-04-27 03:32:58.637680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.637900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.886 [2024-04-27 03:32:58.637949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.886 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.638099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.638229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.638262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.638391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.638558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.638586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.638759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.638889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.638916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.639068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.639211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.639240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.639405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.639540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.639566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.639717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.639892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.639918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.640023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.640201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.640230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.640364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.640542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.640568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.640725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.640858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.640900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.641041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.641208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.641234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.641371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.641501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.641527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.641700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.641855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.641904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.642032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.642180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.642206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.642370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.642511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.642541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.642685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.642830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.642860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.643006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.643128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.643158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.643314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.643467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.643493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.643674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.643881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.643929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.644102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.644253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.644282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.644449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.644574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.644601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.644755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.644858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.644886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.645039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.645139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.645165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.645356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.645463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.645489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.645599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.645730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.645756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.887 [2024-04-27 03:32:58.645880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.645984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.887 [2024-04-27 03:32:58.646010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.887 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.646119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.646223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.646256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.646391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.646542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.646573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.646718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.646867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.646900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.647079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.647219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.647253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.647390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.647558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.647587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.647765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.647899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.647925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.648081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.648227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.648264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.648392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.648494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.648520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.648702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.648834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.648860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.648990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.649180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.649205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.649379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.649528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.649559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.649718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.649825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.649852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.650004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.650160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.650187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.650406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.650556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.650609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.650799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.650947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.650978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.651156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.651269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.651297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.651481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.651634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.651660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.651802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.651972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.652001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.652142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.652310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.652340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.652470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.652583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.652609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.652769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.652885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.652914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.653032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.653139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.653168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.653352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.653484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.653510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.653622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.653776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.653802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.653908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.654008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.654034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.654263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.654478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.654529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.654722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.654994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.655049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.655271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.655414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.655443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.888 qpair failed and we were unable to recover it. 00:21:33.888 [2024-04-27 03:32:58.655590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.888 [2024-04-27 03:32:58.655710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.655739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.655879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.656046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.656075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.656222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.656389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.656416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.656520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.656671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.656698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.656840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.657015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.657042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.657157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.657285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.657312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.657459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.657632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.657661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.657808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.657941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.657967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.658129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.658235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.658283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.658440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.658602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.658631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.658822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.658928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.658957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.659138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.659273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.659300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.659414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.659583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.659611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.659749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.659972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.660001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.660174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.660351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.660380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.660553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.660725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.660754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.660896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.661043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.661072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.661215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.661367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.661396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.661515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.661660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.661685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.661789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.661919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.661944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.662094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.662232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.662292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.662444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.662585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.662614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.662803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.662969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.662998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.663152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.663285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.663319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.663475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.663632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.663658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.663790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.663941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.663975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.664096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.664312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.664342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.664488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.664618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.664643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.664799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.664934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.664977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.889 qpair failed and we were unable to recover it. 00:21:33.889 [2024-04-27 03:32:58.665080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.889 [2024-04-27 03:32:58.665209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.665234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.665381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.665552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.665577] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.665712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.665864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.665906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.666061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.666214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.666240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.666429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.666585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.666614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.666792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.666924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.666950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.667078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.667199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.667225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.667365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.667461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.667487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.667644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.667835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.667862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.668001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.668149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.668178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.668339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.668475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.668502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.668602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.668696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.668738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.668864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.669011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.669040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.669209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.669454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.669497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.669677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.669798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.669824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.670005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.670147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.670176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.670344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.670499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.670525] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.670703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.670821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.670849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.671006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.671165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.671191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.671355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.671497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.671527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.671634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.671778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.671807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.671974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.672139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.672165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.672293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.672429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.672455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.672604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.672705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.672742] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.672856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.672984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.673017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.673195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.673352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.673378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.673510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.673642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.673668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.673828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.673967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.673997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.674128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.674256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.674283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.890 qpair failed and we were unable to recover it. 00:21:33.890 [2024-04-27 03:32:58.674420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.674560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.890 [2024-04-27 03:32:58.674590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.674766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.674920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.674963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.675138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.675277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.675306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.675474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.675587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.675617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.675791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.675922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.675951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.676120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.676257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.676284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.676434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.676601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.676630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.676735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.676877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.676905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.677073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.677223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.677259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.677434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.677590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.677632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.677784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.677935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.677964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.678108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.678281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.678311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.678458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.678619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.678647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.678822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.678925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.678952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.679055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.679202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.679231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.679378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.679523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.679549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.679682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.679867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.679896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.680048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.680184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.680227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.680393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.680525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.680558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.680713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.680853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.680883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.681064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.681222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.681255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.681387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.681485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.681511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.681666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.681845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.681874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.682026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.682185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.682212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.682399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.682562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.682630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.682765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.682898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.682924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.683033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.683136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.683162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.683272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.683421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.683448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.683571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.683720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.683753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.891 qpair failed and we were unable to recover it. 00:21:33.891 [2024-04-27 03:32:58.683881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.684018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.891 [2024-04-27 03:32:58.684044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.684182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.684340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.684369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.684492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.684629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.684658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.684836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.685018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.685045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.685174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.685318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.685345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.685495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.685616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.685655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.685790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.685938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.685967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.686119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.686237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.686272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.686405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.686556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.686582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.686711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.686860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.686886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.687020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.687192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.687221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.687375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.687520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.687549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.687708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.687840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.687868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.688015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.688157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.688186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.688331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.688446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.688475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.688625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.688738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.688766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.688932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.689062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.689088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.689254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.689407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.689437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.689586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.689730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.689759] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.689898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.690064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.690093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.690272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.690404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.690446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.690605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.690739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.690766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.690867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.690978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.691028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.691203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.691349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.691379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.691553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.691681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.691723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.892 qpair failed and we were unable to recover it. 00:21:33.892 [2024-04-27 03:32:58.691846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.892 [2024-04-27 03:32:58.692001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.692030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.692158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.692305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.692336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.692454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.692602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.692628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.692783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.692892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.692920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.693066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.693232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.693267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.693411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.693576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.693602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.693729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.693881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.693909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.694061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.694217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.694243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.694380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.694596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.694622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.694752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.694896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.694923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.695061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.695180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.695208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.695349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.695456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.695482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.695621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.695749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.695775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.695902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.696026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.696052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.696187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.696371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.696398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.696527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.696660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.696686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.696868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.697042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.697071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.697240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.697429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.697456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.697553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.697719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.697748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.697902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.698052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.698093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.698279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.698391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.698418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.698571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.698678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.698707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.698829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.698968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.698997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.699131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.699264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.699291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.699440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.699615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.699641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.699769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.699871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.699901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.700008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.700137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.700163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.700270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.700369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.700395] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.700533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.700712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.700741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.893 qpair failed and we were unable to recover it. 00:21:33.893 [2024-04-27 03:32:58.700886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.893 [2024-04-27 03:32:58.701049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.701077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.701213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.701359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.701388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.701536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.701670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.701696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.701880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.702035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.702061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.702191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.702345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.702372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.702520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.702625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.702654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.702830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.703001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.703030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.703170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.703331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.703360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.703505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.703683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.703709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.703845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.703992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.704019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.704150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.704273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.704300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.704428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.704603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.704632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.704755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.704896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.704926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.705070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.705256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.705283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.705420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.705554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.705580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.705685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.705791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.705817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.705913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.706066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.706092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.706269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.706452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.706479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.706639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.706796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.706823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.706990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.707138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.707165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.707269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.707395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.707421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.707632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.707828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.707877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.708033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.708184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.708210] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.708344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.708457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.708487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.708656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.708816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.708854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.709027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.709155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.709181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.709311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.709444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.709470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.709604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.709737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.709763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.709863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.709968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.709994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.894 qpair failed and we were unable to recover it. 00:21:33.894 [2024-04-27 03:32:58.710097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.894 [2024-04-27 03:32:58.710257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.710283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.710417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.710521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.710546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.710669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.710788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.710814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.710949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.711058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.711082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.711267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.711382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.711410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.711516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.711649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.711675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.711806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.711942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.711971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.712119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.712237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.712273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.712390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.712534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.712563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.712716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.712826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.712854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.713011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.713189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.713218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.713347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.713446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.713473] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.713570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.713702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.713728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.713837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.713968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.713994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.714153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.714333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.714362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.714507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.714649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.714677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.714861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.715018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.715044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.715145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.715278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.715304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.715451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.715638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.715669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.715816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.715919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.715945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.716078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.716236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.716268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.716397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.716493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.716519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.716694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.716823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.716851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.717022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.717162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.717191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.717372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.717481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.717507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.717653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.717783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.717827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.717949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.718065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.718094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.718232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.718359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.718388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.718527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.718636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.718666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.895 qpair failed and we were unable to recover it. 00:21:33.895 [2024-04-27 03:32:58.718841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.719059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.895 [2024-04-27 03:32:58.719088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.719199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.719379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.719409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.719554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.719657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.719683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.719859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.719974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.720003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.720164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.720290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.720317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.720444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.720604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.720633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.720865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.721032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.721061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.721200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.721352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.721383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.721537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.721640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.721666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.721787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.721933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.721962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.722085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.722241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.722273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.722379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.722474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.722500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.722634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.722761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.722786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.722908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.723072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.723101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.723210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.723333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.723362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.723509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.723621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.723649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.723806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.723934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.723960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.724096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.724223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.724260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.724388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.724534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.724563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.724704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.724847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.724876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.725033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.725166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.725192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.725319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.725469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.725498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.725637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.725739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.725768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.725913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.726040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.726065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.726222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.726355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.726382] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.726490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.726588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.896 [2024-04-27 03:32:58.726614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.896 qpair failed and we were unable to recover it. 00:21:33.896 [2024-04-27 03:32:58.726732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.726882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.726913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.727132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.727275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.727304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.727465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.727599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.727627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.727759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.727872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.727898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.728045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.728209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.728239] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.728399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.728568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.728634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.728805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.728913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.728941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.729127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.729270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.729300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.729420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.729595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.729623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.729779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.729969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.729995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.730127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.730252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.730279] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.730417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.730574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.730603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.730765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.730866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.730892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.731004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.731126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.731152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.731283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.731415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.731445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.731636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.731745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.731774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.731942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.732082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.732113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.732259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.732400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.732429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.732561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.732687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.732713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.732816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.732942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.732969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.733118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.733268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.733299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.733446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.733621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.733647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.733807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.733940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.733985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.734127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.734286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.734313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.734423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.734542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.734576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.734818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.734959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.734989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.735168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.735304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.735331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.735431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.735534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.735560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.897 qpair failed and we were unable to recover it. 00:21:33.897 [2024-04-27 03:32:58.735692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.897 [2024-04-27 03:32:58.735862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.735891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.736002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.736168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.736197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.736341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.736469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.736495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.736624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.736766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.736795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.736965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.737087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.737116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.737261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.737421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.737446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.737579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.737730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.737756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.737953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.738095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.738125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.738271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.738433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.738463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.738655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.738807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.738833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.738947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.739071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.739098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.739265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.739390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.739416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.739596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.739741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.739770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.739996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.740127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.740172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.740305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.740415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.740442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.740574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.740671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.740698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.740802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.740963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.740989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.741123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.741344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.741395] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.741546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.741700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.741727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.741884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.742036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.742065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.742213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.742338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.742368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.742513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.742653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.742682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.742826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.742929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.742956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.743137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.743283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.743313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.743455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.743592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.743620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.743839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.743983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.744009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.744162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.744336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.744366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.744510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.744637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.744668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.744815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.744975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.745001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.898 qpair failed and we were unable to recover it. 00:21:33.898 [2024-04-27 03:32:58.745129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.898 [2024-04-27 03:32:58.745232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.745284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.745436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.745546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.745572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.745678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.745829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.745858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.746023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.746267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.746294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.746472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.746691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.746720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.746851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.746978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.747005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.747126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.747345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.747375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.747494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.747652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.747678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.747779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.747932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.747961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.748141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.748292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.748319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.748448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.748547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.748574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.748681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.748848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.748878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.749026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.749196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.749222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.749341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.749445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.749472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.749643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.749754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.749780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.749924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.750093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.750122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.750241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.750472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.750502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.750677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.750802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.750828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.750964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.751082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.751115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.751261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.751381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.751410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.751535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.751684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.751714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.751898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.752066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.752095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.752237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.752364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.752393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.752564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.752695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.752724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.752865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.752990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.753019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.753194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.753345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.753374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.753554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.753663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.753689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.753799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.753905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.753948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.754063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.754205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.754235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.754440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.754573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.754600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.754726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.754874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.899 [2024-04-27 03:32:58.754903] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.899 qpair failed and we were unable to recover it. 00:21:33.899 [2024-04-27 03:32:58.755047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.755194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.755225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.755385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.755541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.755568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.755677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.755806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.755831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.755970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.756107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.756135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.756276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.756377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.756403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.756554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.756694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.756723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.756854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.756984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.757011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.757140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.757255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.757282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.757397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.757504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.757551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.757694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.757925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.757953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.758127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.758306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.758335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.758491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.758645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.758671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.758803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.758954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.758982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.759092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.759238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.759274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.759451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.759583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.759609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.759743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.759892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.759921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.760092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.760270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.760300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.760444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.760617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.760643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.760782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.760886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.760912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.761043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.761197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.761223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.761338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.761467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.761494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.761625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.761742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.761768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.761904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.762085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.762114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.762258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.762406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.762435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.762584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.762722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.762751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.762899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.763041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.763070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.763222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.763363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.763390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.763530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.763684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.763713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.763833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.764005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.764035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.764150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.764302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.764329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.764439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.764591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.764617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.900 qpair failed and we were unable to recover it. 00:21:33.900 [2024-04-27 03:32:58.764770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.900 [2024-04-27 03:32:58.764914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.764943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.901 qpair failed and we were unable to recover it. 00:21:33.901 [2024-04-27 03:32:58.765086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.765229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.765265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.901 qpair failed and we were unable to recover it. 00:21:33.901 [2024-04-27 03:32:58.765383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.765549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.765578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.901 qpair failed and we were unable to recover it. 00:21:33.901 [2024-04-27 03:32:58.765745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.765873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.765916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.901 qpair failed and we were unable to recover it. 00:21:33.901 [2024-04-27 03:32:58.766083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.766272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.766302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.901 qpair failed and we were unable to recover it. 00:21:33.901 [2024-04-27 03:32:58.766471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.766588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.766617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.901 qpair failed and we were unable to recover it. 00:21:33.901 [2024-04-27 03:32:58.766767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.766905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.766931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.901 qpair failed and we were unable to recover it. 00:21:33.901 [2024-04-27 03:32:58.767037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.767168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.767199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.901 qpair failed and we were unable to recover it. 00:21:33.901 [2024-04-27 03:32:58.767347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.767457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.767486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.901 qpair failed and we were unable to recover it. 00:21:33.901 [2024-04-27 03:32:58.767643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.767800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.901 [2024-04-27 03:32:58.767827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.767982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.768152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.768178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.768314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.768442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.768468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.768622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.768765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.768794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.768962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.769105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.769134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.769267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.769378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.769408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.769563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.769696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.769723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.769916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.770048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.770075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.770205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.770384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.770413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.770602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.770758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.770785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.770918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.771025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.771051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.771230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.771353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.771383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.771527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.771647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.771677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.771855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.772010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.772036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.772167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.772274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.772301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.772405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.772535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.772580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.772697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.772869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.772897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.773062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.773225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.773261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.773439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.773630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.773683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.773870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.774002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.774029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.774186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.774319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.774348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.902 qpair failed and we were unable to recover it. 00:21:33.902 [2024-04-27 03:32:58.774491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.774659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.902 [2024-04-27 03:32:58.774688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.774836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.774945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.774970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.775166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.775280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.775310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.775476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.775647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.775676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.775808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.775948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.775977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.776119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.776232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.776266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.776408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.776539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.776568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.776711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.776857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.776887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.777068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.777215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.777243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.777414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.777547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.777574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.777703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.777882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.777911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.778069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.778206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.778233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.778452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.778643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.778695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.778850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.778954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.778981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.779111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.779285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.779315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.779470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.779624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.779652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.779784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.779913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.779942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.780069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.780206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.780233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.780370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.780546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.780576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.780744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.780917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.780946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.781099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.781229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.781261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.781382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.781490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.781517] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.781660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.781793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.781819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.781968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.782096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.782122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.782273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.782386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.782412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.782514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.782667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.782693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.782818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.782983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.783012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.783158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.783282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.783313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.783455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.783567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.783600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.783716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.783811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.783837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.783970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.784112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.784138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.784285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.784404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.903 [2024-04-27 03:32:58.784434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.903 qpair failed and we were unable to recover it. 00:21:33.903 [2024-04-27 03:32:58.784614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.784782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.784811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.784942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.785072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.785098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.785258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.785397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.785426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.785568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.785712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.785741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.785877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.786026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.786055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.786197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.786308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.786334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.786534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.786638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.786666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.786808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.786927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.786958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.787123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.787237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.787333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.787470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.787602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.787628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.787784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.787922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.787950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.788071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.788174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.788202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.788359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.788496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.788525] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.788683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.788797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.788823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.788968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.789093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.789133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.789291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.789417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.789446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.789613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.789755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.789784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.789946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.790101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.790127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.790308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.790442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.790468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.790633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.790787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.790813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.790997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.791151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.791177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.791307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.791439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.791466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.791629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.791800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.791830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.791947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.792117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.792146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.792265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.792436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.792465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.792595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.792747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.792774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.792955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.793121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.793150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.793327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.793473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.793502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.793703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.793859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.793885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.794017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.794156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.794183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.794317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.794475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.794504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.794675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.794827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.794856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.795024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.795171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.904 [2024-04-27 03:32:58.795213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.904 qpair failed and we were unable to recover it. 00:21:33.904 [2024-04-27 03:32:58.795385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.795528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.795576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.795744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.795913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.795942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.796110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.796290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.796316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.796471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.796590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.796620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.796777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.796935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.796962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.797108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.797290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.797320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.797488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.797634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.797663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.797842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.797998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.798024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.798122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.798256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.798283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.798409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.798553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.798583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.798706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.798861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.798887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.799082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.799243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.799275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.799400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.799539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.799565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.799695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.799843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.799872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.800000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.800109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.800140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.800298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.800455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.800481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.800621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.800729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.800755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.800869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.801060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.801089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.801235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.801382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.801411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.801552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.801686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.801715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.801894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.802023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.802049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.802207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.802372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.802402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.802545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.802687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.802718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.802863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.803011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.803039] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.803202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.803337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.803384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.803526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.803667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.803696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.803805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.803922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.803965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.804090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.804241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.804279] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.804425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.804525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.804552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.804722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.804859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.804889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.805028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.805196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.805225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.805390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.805537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.805566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.805719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.805843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.805869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.905 qpair failed and we were unable to recover it. 00:21:33.905 [2024-04-27 03:32:58.806049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.806198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.905 [2024-04-27 03:32:58.806225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.806336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.806476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.806502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.806657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.806785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.806811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.806969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.807074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.807100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.807227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.807343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.807370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.807500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.807620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.807650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.807796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.807941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.807970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.808098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.808224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.808257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.808395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.808560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.808589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.808730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.808867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.808896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.809053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.809196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.809222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.809365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.809495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.809522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.809657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.809804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.809833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.809971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.810139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.810168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.810327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.810492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.810518] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.810648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.810806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.810832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.810968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.811076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.811102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.811259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.811396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.811426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.811566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.811754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.811780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.811882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.812009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.812035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.812187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.812353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.812380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.812531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.812730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.812756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.812889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.813010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.813040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.813173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.813320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.813347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.813493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.813640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.813669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.813780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.813928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.813954] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.814089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.814240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.814276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.814440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.814575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.814601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.814740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.814845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.814870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.906 [2024-04-27 03:32:58.815005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.815138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.906 [2024-04-27 03:32:58.815164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.906 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.815309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.815439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.815465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.815631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.815754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.815780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.815888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.816002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.816028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.816179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.816324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.816354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.816507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.816713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.816760] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.816937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.817050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.817076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.817230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.817383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.817414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.817558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.817699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.817728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.818003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.818196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.818225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.818368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.818502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.818528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.818739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.818880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.818909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.819122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.819234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.819269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.819406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.819505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.819535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.819668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.819829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.819872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.819991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.820161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.820187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.820358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.820495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.820525] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.820738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.820964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.820990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.821121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.821254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.821281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.821436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.821568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.821594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.821744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.821883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.821910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.822041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.822192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.822220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.822392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.822650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.822703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.822851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.823002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.823029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.823163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.823346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.823376] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.823520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.823684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.823709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.823820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.824027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.824053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.824208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.824395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.824422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.824580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.824735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.824763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.824878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.825026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.825054] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.825233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.825341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.825367] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.825544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.825750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.825794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.825962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.826092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.826135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.826294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.826430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.826456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.826565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.826658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.826683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.826908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.827069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.827097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.907 qpair failed and we were unable to recover it. 00:21:33.907 [2024-04-27 03:32:58.827238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.827416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.907 [2024-04-27 03:32:58.827445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.827635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.827851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.827877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.828006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.828141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.828167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.828311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.828453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.828482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.828649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.828864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.828892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.829037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.829185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.829213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.829377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.829511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.829553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.829699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.829846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.829874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.830046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.830194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.830222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.830384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.830527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.830556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.830727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.830877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.830920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.831076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.831208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.831234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.831428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.831582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.831652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.831776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.831959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.831988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.832165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.832320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.832364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.832541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.832712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.832739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.832965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.833106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.833136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.833327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.833476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.833504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.833615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.833776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.833801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.834032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.834165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.834194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.834349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.834462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.834488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.834588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.834745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.834776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:33.908 qpair failed and we were unable to recover it. 00:21:33.908 [2024-04-27 03:32:58.834963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:33.908 [2024-04-27 03:32:58.835101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.835144] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.835286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.835477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.835503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.835634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.835768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.835796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.835945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.836105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.836131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.836265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.836402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.836429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.836535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.836644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.836670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.836792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.836928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.836958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.837083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.837227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.837262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.837423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.837557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.837582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.837740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.837855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.837883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.838040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.838174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.838200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.838346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.838471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.838500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.838671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.838826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.838868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.839018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.839159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.839188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.839362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.839520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.839546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.839698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.839892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.839920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.840069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.840222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.840258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.840428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.840571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.840599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.840749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.840893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.840921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.841089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.841254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.841280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.841436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.841569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.841612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.841730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.841892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.841921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.842075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.842225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.842270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.842420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.842590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.842616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.842781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.842907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.842949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.843092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.843202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.843231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.843387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.843542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.843571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.843724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.843869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.843898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.186 qpair failed and we were unable to recover it. 00:21:34.186 [2024-04-27 03:32:58.844072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.186 [2024-04-27 03:32:58.844260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.844290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.844402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.844554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.844583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.844724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.844877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.844902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.845033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.845187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.845215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.845369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.845495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.845521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.845648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.845821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.845846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.845977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.846083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.846109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.846257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.846415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.846441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.846576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.846740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.846783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.846953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.847108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.847133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.847236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.847340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.847366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.847496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.847662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.847721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.847901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.848033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.848074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.848221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.848394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.848423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.848539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.848646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.848675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.848792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.848951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.848977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.849107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.849261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.849304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.849442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.849601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.849627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.849758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.849890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.849916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.850108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.850242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.850283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.850417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.850552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.850578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.850720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.850897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.850923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.851082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.851272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.851298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.851408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.851540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.851567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.851704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.851868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.851894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.852049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.852163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.852191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.852349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.852509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.852535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.852815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.852925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.852954] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.853110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.853265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.853293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.187 qpair failed and we were unable to recover it. 00:21:34.187 [2024-04-27 03:32:58.853436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.187 [2024-04-27 03:32:58.853579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.853612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.853729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.853895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.853923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.854062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.854213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.854239] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.854406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.854544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.854570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.854729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.854880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.854908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.855077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.855245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.855282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.855464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.855565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.855591] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.855694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.855830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.855856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.856020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.856160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.856189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.856356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.856532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.856562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.856793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.857025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.857058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.857205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.857343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.857370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.857533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.857657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.857682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.857814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.857950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.857976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.858075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.858211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.858237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.858360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.858490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.858524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.858661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.858822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.858848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.858978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.859121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.859148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.859290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.859394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.859421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.859583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.859717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.859743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.859859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.859985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.860017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.860152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.860282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.860309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.860443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.860610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.860636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.860744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.860844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.860870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.861041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.861171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.861197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.861306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.861449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.861474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.861608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.861739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.861766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.861862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.862021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.862047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.862184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.862354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.188 [2024-04-27 03:32:58.862380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.188 qpair failed and we were unable to recover it. 00:21:34.188 [2024-04-27 03:32:58.862536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.862657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.862683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.862814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.862940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.862966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.863129] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.863267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.863303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.863412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.863545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.863580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.863691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.863803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.863829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.863952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.864077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.864103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.864228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.864342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.864369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.864473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.864591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.864617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.864763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.864895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.864921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.865056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.865214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.865240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.865355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.865460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.865487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.865619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.865747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.865773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.865878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.865983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.866009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.866119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.866257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.866296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.866438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.866540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.866567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.866693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.866857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.866883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.867033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.867161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.867187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.867332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.867458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.867484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.867629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.867794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.867820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.867973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.868107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.868132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.868269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.868408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.868435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.868563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.868667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.868693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.868845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.868950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.868976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.869103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.869230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.869262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.869382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.869515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.869541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.869648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.869779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.869805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.869940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.870044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.870071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.870172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.870327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.870354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.189 [2024-04-27 03:32:58.870478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.870604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.189 [2024-04-27 03:32:58.870630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.189 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.870785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.870975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.871003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.871152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.871280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.871306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.871422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.871593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.871621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.871779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.871922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.871957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.872127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.872310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.872337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.872440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.872592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.872618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.872774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.872878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.872906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.873063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.873197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.873223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.873337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.873466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.873492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.873646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.873777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.873803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.873914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.874057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.874084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.874236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.874379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.874405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.874519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.874621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.874647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.874771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.874926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.874952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.875115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.875222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.875257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.875367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.875511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.875536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.875678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.875847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.875876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.876061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.876234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.876272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.876417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.876569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.876596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.876719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.876869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.876898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.877007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.877178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.877204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.877343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.877453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.877480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.877612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.877759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.877788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.190 qpair failed and we were unable to recover it. 00:21:34.190 [2024-04-27 03:32:58.877933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.190 [2024-04-27 03:32:58.878089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.878115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.878274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.878446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.878472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.878568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.878694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.878720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.878825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.878951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.878977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.879105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.879210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.879236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.879377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.879522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.879551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.879681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.879815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.879841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.879975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.880118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.880147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.880288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.880465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.880491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.880621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.880751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.880778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.880878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.881035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.881061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.881230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.881396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.881423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.881559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.881715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.881741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.881870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.882020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.882046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.882169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.882330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.882374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.882551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.882671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.882697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.882879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.883044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.883072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.883221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.883350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.883379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.883501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.883633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.883659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.883808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.883988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.884014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.884146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.884326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.884356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.884491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.884655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.884682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.884815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.884939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.884965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.885113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.885259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.885312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.885423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.885582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.885626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.885750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.885905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.885931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.886088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.886226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.886303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.886428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.886592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.886621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.886751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.886932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.886958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.191 qpair failed and we were unable to recover it. 00:21:34.191 [2024-04-27 03:32:58.887089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.191 [2024-04-27 03:32:58.887236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.887279] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.887462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.887595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.887621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.887812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.887973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.888014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.888114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.888275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.888307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.888464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.888711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.888740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.888893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.889063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.889092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.889237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.889366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.889395] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.889507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.889668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.889695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.889796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.889920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.889946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.890047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.890178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.890204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.890394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.890538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.890580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.890708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.890881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.890907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.891019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.891144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.891170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.891307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.891441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.891467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.891596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.891716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.891744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.891924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.892054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.892079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.892197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.892356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.892383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.892508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.892636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.892662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.892769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.892942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.892971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.893158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.893291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.893318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.893438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.893620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.893646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.893800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.893952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.893978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.894109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.894234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.894266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.894398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.894557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.894587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.894741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.894843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.894869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.895001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.895163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.895206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.895365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.895504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.895532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.895711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.895857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.895887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.896075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.896202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.192 [2024-04-27 03:32:58.896228] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.192 qpair failed and we were unable to recover it. 00:21:34.192 [2024-04-27 03:32:58.896370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.896477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.896503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.896629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.896774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.896800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.896952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.897077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.897106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.897271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.897407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.897433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.897567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.897725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.897768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.897915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.898033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.898063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.898207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.898389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.898419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.898570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.898694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.898720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.898847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.898949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.898975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.899109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.899244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.899277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.899437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.899553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.899582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.899730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.899844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.899874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.900035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.900162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.900188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.900367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.900534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.900562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.900711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.900834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.900864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.900999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.901176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.901202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.901341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.901477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.901504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.901634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.901781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.901810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.901982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.902116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.902141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.902323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.902479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.902506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.902662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.902792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.902833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.902980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.903149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.903178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.903350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.903491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.903519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.903653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.903798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.903826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.903982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.904108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.904138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.904327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.904473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.904502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.904658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.904789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.904815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.904968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.905110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.905151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.905262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.905393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.905420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.193 qpair failed and we were unable to recover it. 00:21:34.193 [2024-04-27 03:32:58.905576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.193 [2024-04-27 03:32:58.905729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.905757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.905938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.906070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.906096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.906233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.906394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.906424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.906604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.906707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.906733] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.906864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.906992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.907018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.907206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.907352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.907386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.907557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.907696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.907724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.907893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.908020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.908046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.908175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.908320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.908350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.908518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.908661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.908690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.908845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.909020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.909045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.909154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.909281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.909308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.909431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.909574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.909603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.909733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.909863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.909890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.910015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.910193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.910219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.910355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.910486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.910512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.910709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.910829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.910857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.910998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.911141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.911169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.911325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.911442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.911470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.911591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.911713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.911738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.911906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.912049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.912077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.912243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.912396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.912427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.912567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.912709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.912737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.912897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.913033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.913074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.913216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.913358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.913387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.913540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.913700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.913726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.913869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.914001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.914030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.914157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.914285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.914312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.914489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.914607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.194 [2024-04-27 03:32:58.914636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.194 qpair failed and we were unable to recover it. 00:21:34.194 [2024-04-27 03:32:58.914751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.914927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.914956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.915114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.915271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.915298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.915433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.915584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.915626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.915794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.915900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.915929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.916073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.916185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.916214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.916394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.916553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.916579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.916687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.916818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.916844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.916970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.917163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.917188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.917338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.917450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.917477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.917665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.917962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.918012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.918183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.918280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.918307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.918429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.918575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.918604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.918708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.918854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.918883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.919063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.919192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.919221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.919381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.919534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.919560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.919737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.919852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.919881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.920046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.920213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.920242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.920435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.920566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.920596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.920727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.920879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.920922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.921078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.921198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.921223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.921337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.921445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.921471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.921620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.921758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.921784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.921915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.922067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.922108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.195 [2024-04-27 03:32:58.922285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.922412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.195 [2024-04-27 03:32:58.922438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.195 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.922634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.922756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.922782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.922911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.923087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.923116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.923268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.923390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.923417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.923542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.923683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.923718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.923890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.924033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.924062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.924208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.924337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.924366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.924492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.924622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.924648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.924796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.924909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.924937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.925106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.925289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.925315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.925448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.925577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.925604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.925744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.925872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.925897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.926080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.926255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.926284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.926426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.926574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.926600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.926723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.926854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.926880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.927017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.927167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.927192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.927356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.927496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.927524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.927684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.927793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.927819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.928010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.928112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.928138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.928273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.928435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.928461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.928591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.928732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.928761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.928929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.929072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.929101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.929341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.929512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.929540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.929715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.929877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.929902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.930059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.930171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.930200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.930406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.930509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.930536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.930712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.930853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.930881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.931064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.931194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.931220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.931344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.931483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.931517] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.196 [2024-04-27 03:32:58.931627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.931757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.196 [2024-04-27 03:32:58.931783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.196 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.931883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.932034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.932061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.932157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.932292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.932319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.932477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.932619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.932645] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.932777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.932929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.932956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.933089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.933212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.933238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.933358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.933522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.933548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.933652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.933787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.933813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.933919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.934025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.934051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.934188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.934292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.934318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.934451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.934629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.934656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.934785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.934917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.934944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.935052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.935210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.935236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.935380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.935539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.935566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.935701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.935837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.935864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.936000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.936131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.936168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.936295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.936463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.936499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.936607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.936736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.936764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.936895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.936998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.937024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.937123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.937257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.937296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.937396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.937556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.937582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.937708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.937801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.937828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.937984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.938094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.938121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.938274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.938373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.938399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.938541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.938698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.938725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.938865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.938974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.939000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.939099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.939199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.939229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.939358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.939463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.939489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.939614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.939742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.939768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-27 03:32:58.939863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.940018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.197 [2024-04-27 03:32:58.940044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.940178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.940306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.940333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.940433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.940536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.940562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.940693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.940821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.940847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.941003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.941162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.941188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.941350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.941451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.941476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.941575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.941684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.941710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.941866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.941991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.942017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.942154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.942288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.942315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.942451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.942590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.942616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.942750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.942909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.942935] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.943077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.943222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.943258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.943396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.943497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.943523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.943679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.943855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.943884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.944049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.944211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.944240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.944386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.944508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.944537] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.944681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.944820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.944849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.945011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.945162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.945188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.945307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.945448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.945474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.945604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.945714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.945740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.945901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.946032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.946058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.946182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.946289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.946316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.946470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.946613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.946639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.946772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.946900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.946926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.947062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.947203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.947230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.947371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.947506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.947533] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.947632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.947741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.947778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.947916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.948069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.948106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.948263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.948411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.948440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.198 [2024-04-27 03:32:58.948593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.948712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.198 [2024-04-27 03:32:58.948738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.198 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.948873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.948984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.949009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.949125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.949256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.949297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.949494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.949628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.949655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.949811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.949937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.949978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.950145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.950289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.950319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.950461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.950596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.950623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.950754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.950888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.950914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.951047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.951148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.951174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.951356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.951501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.951530] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.951711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.951841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.951868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.952050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.952223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.952259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.952428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.952569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.952595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.952780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.952909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.952936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.953114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.953311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.953368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.953569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.953701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.953727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.953836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.953993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.954019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.954178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.954371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.954400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.954594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.954747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.954790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.954972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.955074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.955105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.955220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.955355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.955382] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.955558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.955670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.955699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.955816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.955984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.956013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.956159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.956276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.956315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.956447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.956584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.956611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.199 [2024-04-27 03:32:58.956733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.956884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.199 [2024-04-27 03:32:58.956913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.199 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.957029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.957146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.957172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.957319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.957491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.957527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.957658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.957810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.957837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.957988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.958123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.958151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.958310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.958442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.958468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.958637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.958764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.958790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.958919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.959024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.959050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.959155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.959313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.959342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.959476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.959630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.959655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.959794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.959941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.959969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.960116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.960253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.960290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.960447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.960556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.960585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.960759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.960918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.960944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.961079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.961229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.961264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.961395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.961526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.961552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.961701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.961855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.961885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.962031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.962179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.962207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.962325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.962469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.962513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.962642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.962777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.962803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.962960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.963109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.963138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.963290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.963409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.963437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.963589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.963850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.963906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.964033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.964175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.964202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.964392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.964495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.964523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.964659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.964795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.964824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.964996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.965146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.965172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.965346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.965456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.965484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.965666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.965807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.965836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.965948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.966099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.200 [2024-04-27 03:32:58.966128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.200 qpair failed and we were unable to recover it. 00:21:34.200 [2024-04-27 03:32:58.966286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.966449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.966476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.966617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.966779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.966823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.966973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.967082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.967112] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.967230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.967380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.967409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.967562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.967694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.967721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.967825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.967955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.967981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.968092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.968266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.968296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.968493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.968619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.968645] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.968823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.968955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.968984] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.969137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.969270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.969296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.969407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.969519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.969544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.969672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.969795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.969824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.969993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.970150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.970179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.970347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.970462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.970488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.970650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.970764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.970792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.970951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.971080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.971113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.971213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.971392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.971419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.971550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.971714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.971740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.971905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.972021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.972050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.972167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.972341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.972372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.972500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.972657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.972682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.972835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.972935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.972961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.973107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.973237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.973269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.973404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.973583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.973609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.973736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.973860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.973889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.974015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.974169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.974200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.974305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.974440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.974469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.974646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.974806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.974832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.974987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.975142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.201 [2024-04-27 03:32:58.975171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.201 qpair failed and we were unable to recover it. 00:21:34.201 [2024-04-27 03:32:58.975327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.975435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.975461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.975617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.975771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.975800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.975943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.976099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.976125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.976291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.976417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.976447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.976579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.976729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.976755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.976909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.977029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.977055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.977180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.977291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.977321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.977480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.977617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.977656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.977831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.977985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.978028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.978142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.978272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.978299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.978430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.978586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.978615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.978728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.978847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.978877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.979031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.979159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.979195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.979344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.979461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.979489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.979682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.979840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.979872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.980028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.980178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.980207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.980374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.980484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.980510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.980678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.980835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.980864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.980975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.981091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.981120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.981231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.981407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.981433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.981554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.981687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.981714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.981872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.981981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.982010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.982177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.982344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.982372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.982477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.982629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.982659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.982785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.982918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.982945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.983100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.983244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.983280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.983401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.983513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.983539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.983680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.983798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.983827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.983989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.984118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.202 [2024-04-27 03:32:58.984145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.202 qpair failed and we were unable to recover it. 00:21:34.202 [2024-04-27 03:32:58.984275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.984431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.984458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.984594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.984703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.984732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.984878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.985020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.985048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.985224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.985336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.985363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.985477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.985578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.985620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.985809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.985924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.985949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.986082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.986188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.986214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.986355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.986465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.986490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.986599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.986716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.986761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.986901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.987045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.987073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.987241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.987364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.987390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.987494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.987602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.987628] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.987775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.987913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.987942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.988064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.988206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.988235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.988417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.988580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.988606] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.988735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.988866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.988892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.989032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.989197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.989224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.989340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.989472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.989498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.989641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.989767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.989794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.989899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.990027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.990054] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.990152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.990282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.990312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.990423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.990554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.990581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.990714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.990849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.990877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.990976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.991073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.991099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.991232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.991344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.991370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.991474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.991603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.991629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.991787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.991893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.991918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.992022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.992157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.992183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.203 [2024-04-27 03:32:58.992332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.992441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.203 [2024-04-27 03:32:58.992467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.203 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.992576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.992706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.992736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.992852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.993020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.993049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.993192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.993303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.993330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.993464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.993575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.993600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.993733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.993886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.993911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.994016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.994138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.994168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.994304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.994440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.994466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.994633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.994757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.994787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.994900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.995048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.995077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.995200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.995392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.995418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.995525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.995631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.995657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.995812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.995953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.995981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.996127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.996299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.996325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.996455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.996592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.996618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.996727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.996834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.996859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.996966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.997067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.997093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.997206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.997315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.997343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.997477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.997644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.997671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.997814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.997943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.997969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.998123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.998259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.998314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.998453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.998586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.998612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.998776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.998944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.998973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.999168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.999327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.999357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.999475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.999627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.999657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.204 qpair failed and we were unable to recover it. 00:21:34.204 [2024-04-27 03:32:58.999774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.999919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.204 [2024-04-27 03:32:58.999949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.000087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.000230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.000264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.000432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.000554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.000580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.000726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.000838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.000865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.000999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.001132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.001160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.001315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.001454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.001485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.001640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.001782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.001810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.001969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.002138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.002182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.002332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.002472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.002499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.002655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.002834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.002881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.003039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.003149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.003177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.003331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.003530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.003572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.003726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.003886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.003929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.004087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.004219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.004252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.004391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.004544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.004570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.004671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.004821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.004870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.005016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.005142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.005168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.005278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.005460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.005504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.005654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.005800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.005827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.005941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.006068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.006100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.006230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.006389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.006433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.006598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.006750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.006776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.006919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.007051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.007077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.007177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.007329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.007375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.007501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.007720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.007748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.007883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.008014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.008045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.008155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.008314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.008342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.008473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.008626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.008670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.008811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.008945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.008970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.205 qpair failed and we were unable to recover it. 00:21:34.205 [2024-04-27 03:32:59.009082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.205 [2024-04-27 03:32:59.009213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.009239] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.009408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.009606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.009662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.009793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.009911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.009938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.010072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.010270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.010327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.010480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.010637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.010681] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.010900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.011060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.011086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.011188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.011312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.011348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.011469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.011632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.011676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.011787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.011920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.011945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.012074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.012202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.012227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.012381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.012500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.012547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.012678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.012846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.012872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.013033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.013169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.013196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.013314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.013423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.013449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.013566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.013667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.013694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.013848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.013984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.014011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.014148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.014263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.014300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.014466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.014615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.014659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.014783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.014933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.014959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.015069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.015173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.015199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.015312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.015419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.015445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.015602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.015708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.015734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.015867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.015998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.016025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.016135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.016238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.016270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.016378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.016510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.016535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.016668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.016804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.016830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.016952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.017071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.017098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.017234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.017359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.017385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.017484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.017596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.206 [2024-04-27 03:32:59.017622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.206 qpair failed and we were unable to recover it. 00:21:34.206 [2024-04-27 03:32:59.017751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.017877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.017903] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.018040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.018179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.018205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.018329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.018461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.018489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.018596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.018695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.018721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.018852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.018981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.019007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.019138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.019317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.019346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.019465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.019621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.019648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.019802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.019942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.019968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.020107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.020263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.020291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.020441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.020611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.020654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.020787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.020919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.020946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.021079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.021199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.021224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.021352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.021523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.021552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.021715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.021872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.021898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.022030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.022163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.022190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.022310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.022454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.022482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.022679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.022869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.022895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.023032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.023157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.023183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.023340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.023487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.023533] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.023685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.023839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.023865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.023998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.024165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.024191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.024360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.024515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.024559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.024714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.024846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.024890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.024996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.025121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.025148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.025286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.025420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.025448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.025580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.025687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.025713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.025870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.026013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.026039] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.026173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.026323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.026368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.026504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.026628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.207 [2024-04-27 03:32:59.026655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.207 qpair failed and we were unable to recover it. 00:21:34.207 [2024-04-27 03:32:59.026759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.026895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.026921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.027029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.027187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.027213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.027359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.027483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.027513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.027679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.027831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.027857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.027991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.028096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.028123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.028233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.028373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.028399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.028560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.028753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.028783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.028957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.029086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.029113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.029277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.029431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.029475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.029661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.029869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.029914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.030049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.030216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.030286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.030409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.030579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.030622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.030747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.030869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.030894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.031050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.031153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.031179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.031320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.031446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.031492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.031669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.031788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.031814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.031943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.032096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.032122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.032260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.032393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.032437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.032608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.032797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.032824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.032938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.033067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.033094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.033272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.033429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.033458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.033599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.033764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.033809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.033941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.034071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.034097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.034231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.034349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.034376] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.208 [2024-04-27 03:32:59.034505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.034609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.208 [2024-04-27 03:32:59.034636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.208 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.034788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.034889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.034916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.035048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.035178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.035205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.035357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.035571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.035631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.035785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.035913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.035939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.036049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.036157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.036184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.036314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.036440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.036467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.036573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.036702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.036729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.036864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.036998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.037024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.037156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.037291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.037318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.037437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.037562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.037588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.037721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.037824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.037851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.038014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.038121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.038146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.038298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.038467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.038511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.038683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.038820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.038846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.038987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.039124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.039150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.039256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.039411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.039455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.039579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.039703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.039729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.039833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.039964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.039991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.040097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.040228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.040262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.040371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.040506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.040532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.040669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.040768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.040794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.040948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.041081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.041108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.041260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.041391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.041418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.041554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.041685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.041712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.041845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.041965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.041992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.042130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.042264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.042291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.042418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.042569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.042612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.042777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.042885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.042911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.209 [2024-04-27 03:32:59.043039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.043193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.209 [2024-04-27 03:32:59.043219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.209 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.043348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.043514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.043559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.043688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.043797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.043822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.043955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.044078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.044103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.044234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.044372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.044398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.044543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.044776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.044805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.044953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.045111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.045137] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.045266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.045416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.045460] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.045639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.045810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.045840] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.045973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.046076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.046102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.046231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.046419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.046462] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.046617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.046790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.046817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.046947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.047076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.047111] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.047223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.047350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.047379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.047545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.047695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.047721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.047847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.047975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.048001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.048159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.048343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.048389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.048524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.048678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.048705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.048811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.048909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.048935] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.049068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.049171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.049197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.049357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.049494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.049519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.049650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.049815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.049841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.049950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.050109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.050135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.050262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.050392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.050419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.050573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.050730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.050775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.050916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.051015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.051041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.051146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.051273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.051305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.051442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.051625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.051654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.051828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.051931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.051956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.210 qpair failed and we were unable to recover it. 00:21:34.210 [2024-04-27 03:32:59.052085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.210 [2024-04-27 03:32:59.052219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.052245] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.052365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.052497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.052524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.052657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.052759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.052787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.052890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.053021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.053047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.053184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.053334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.053379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.053502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.053637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.053685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.053811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.053916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.053943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.054073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.054181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.054212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.054327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.054439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.054466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.054577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.054708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.054735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.054865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.054996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.055022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.055132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.055263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.055290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.055441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.055591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.055635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.055776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.055899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.055924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.056052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.056160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.056187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.056331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.056470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.056499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.056644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.056794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.056820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.056952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.057111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.057141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.057272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.057388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.057416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.057589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.057711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.057737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.057895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.058049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.058075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.058219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.058404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.058449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.058578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.058714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.058743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.058872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.058978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.059003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.059135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.059244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.059276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.059410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.059514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.059542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.059647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.059779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.059805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.059936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.060044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.060076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.060206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.060365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.060411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.211 qpair failed and we were unable to recover it. 00:21:34.211 [2024-04-27 03:32:59.060537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.211 [2024-04-27 03:32:59.060652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.060678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.060805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.060934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.060961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.061065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.061208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.061234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.061400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.061534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.061560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.061694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.061801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.061827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.061960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.062093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.062119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.062257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.062385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.062412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.062542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.062669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.062696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.062830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.062964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.062992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.063126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.063287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.063315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.063419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.063520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.063546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.063680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.063792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.063819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.063950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.064066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.064092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.064199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.064338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.064364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.064491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.064667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.064712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.064849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.064946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.064972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.065075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.065175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.065202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.065393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.065530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.065559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.065705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.065857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.065882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.065993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.066109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.066136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.066270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.066400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.066444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.066567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.066693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.066719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.066847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.066951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.066977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.067104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.067210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.067237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.067401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.067554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.067580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.067715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.067847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.067873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.067969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.068101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.068126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.068259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.068407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.068451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.068579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.068709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.212 [2024-04-27 03:32:59.068737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.212 qpair failed and we were unable to recover it. 00:21:34.212 [2024-04-27 03:32:59.068875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.069032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.069058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.069168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.069291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.069318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.069432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.069562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.069590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.069698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.069816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.069844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.069959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.070112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.070139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.070265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.070366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.070394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.070526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.070655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.070682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.070817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.070984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.071011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.071117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.071256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.071282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.071411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.071561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.071588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.071727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.071858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.071884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.072038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.072169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.072197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.072350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.072511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.072539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.072737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.072884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.072911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.073044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.073200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.073226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.073391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.073515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.073545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.073703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.073842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.073868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.074025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.074150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.074176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.074310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.074470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.074496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.074652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.074806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.074832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.074987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.075100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.075129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.075313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.075440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.075467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.075604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.075755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.075783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.075998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.076142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.076173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.213 [2024-04-27 03:32:59.076347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.076484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.213 [2024-04-27 03:32:59.076510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.213 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.076722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.076890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.076919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.077068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.077174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.077204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.077336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.077477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.077504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.077635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.077790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.077821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.077990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.078143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.078173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.078310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.078449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.078476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.078609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.078747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.078773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.078988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.079133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.079161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.079308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.079445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.079472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.079628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.079768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.079794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.079920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.080059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.080088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.080231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.080361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.080388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.080494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.080654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.080683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.080824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.080957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.080986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.081193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.081322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.081351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.081466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.081587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.081613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.081771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.081965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.081994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.082115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.082300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.082328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.082460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.082629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.082680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.082847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.082989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.083018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.083163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.083316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.083344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.083480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.083693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.083720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.083874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.084039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.084068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.084210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.084377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.084404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.084526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.084669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.084698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.084819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.084930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.084966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.085121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.085269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.085312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.085455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.085586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.085614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.214 qpair failed and we were unable to recover it. 00:21:34.214 [2024-04-27 03:32:59.085748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.085889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.214 [2024-04-27 03:32:59.085916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.086053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.086185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.086213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.086359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.086465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.086491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.086678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.086812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.086841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.087026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.087180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.087207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.087351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.087510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.087537] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.087696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.087804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.087830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.088013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.088141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.088171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.088351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.088460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.088486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.088595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.088754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.088780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.088879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.089029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.089055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.089229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.089351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.089380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.089507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.089698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.089724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.089865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.090059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.090084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.090189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.090297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.090324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.090460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.090572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.090598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.090734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.090890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.090920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.091086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.091230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.091269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.091394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.091502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.091528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.091656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.091794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.091823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.092004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.092131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.092157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.092332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.092502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.092531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.092709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.092840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.092883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.093054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.093208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.093235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.093430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.093574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.093603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.093785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.093893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.093921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.094078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.094257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.094287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.094424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.094596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.094626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.094746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.094925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.094951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.095107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.095227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.095278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.215 qpair failed and we were unable to recover it. 00:21:34.215 [2024-04-27 03:32:59.095417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.215 [2024-04-27 03:32:59.095572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.095615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.095757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.095890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.095919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.096035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.096173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.096203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.096360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.096531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.096561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.096744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.096881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.096907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.097074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.097238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.097277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.097423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.097568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.097597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.097781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.097970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.097997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.098130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.098285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.098330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.098472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.098615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.098646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.098831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.098986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.099013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.099167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.099301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.099330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.099479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.099637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.099681] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.099788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.099938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.099967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.100106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.100295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.100322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.100458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.100622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.100651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.100803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.100959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.100985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.101115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.101266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.101300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.101442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.101586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.101616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.101795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.101921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.101946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.102079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.102232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.102268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.102425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.102575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.102603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.102759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.102920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.102947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.103100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.103255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.103285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.103434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.103568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.103594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.103729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.103881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.103910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.104079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.104238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.104273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.104432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.104587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.104651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.104808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.104941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.104967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.105109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.105280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.105310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.105482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.105638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.105664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.216 qpair failed and we were unable to recover it. 00:21:34.216 [2024-04-27 03:32:59.105770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.105926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.216 [2024-04-27 03:32:59.105952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.106053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.106182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.106208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.106398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.106551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.106578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.106715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.106872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.106901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.107018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.107184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.107213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.107346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.107504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.107531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.107715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.107859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.107892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.108010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.108149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.108178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.108351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.108501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.108530] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.108714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.108873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.108900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.109096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.109277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.109307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.109460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.109593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.109619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.109774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.109932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.109961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.110083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.110218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.110244] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.110388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.110580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.110607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.110763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.110940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.110969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.111082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.111216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.111257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.111437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.111544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.111570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.111723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.111910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.111973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.112092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.112238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.112278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.112451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.112597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.112623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.112731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.112888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.112914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.113071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.113206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.113235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.113412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.113545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.113571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.113787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.113954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.113983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.114139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.114274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.114302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.217 qpair failed and we were unable to recover it. 00:21:34.217 [2024-04-27 03:32:59.114462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.217 [2024-04-27 03:32:59.114578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.114608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.114760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.114932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.114961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.115076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.115258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.115288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.115479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.115613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.115638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.115791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.115950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.115979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.116088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.116262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.116292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.116511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.116706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.116731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.116859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.116957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.116982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.117140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.117274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.117301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.117470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.117616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.117646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.117889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.118024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.118052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.118194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.118326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.118354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.118486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.118656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.118685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.118858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.118988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.119015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.119196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.119374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.119404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.119541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.119674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.119702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.119824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.119930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.119959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.120098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.120281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.120311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.120430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.120620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.120676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.120825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.120927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.120953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.121108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.121237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.121273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.121456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.121602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.121629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.121731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.121887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.121914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.122018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.122148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.122175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.122289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.122408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.122434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.122528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.122663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.122689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.122808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.122956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.122985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.123137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.123261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.123288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.123424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.123553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.123581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.123724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.123849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.123878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.124021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.124189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.124218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.218 qpair failed and we were unable to recover it. 00:21:34.218 [2024-04-27 03:32:59.124384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.124524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.218 [2024-04-27 03:32:59.124566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.124710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.124816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.124845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.124989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.125134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.125178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.125333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.125517] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.125544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.125651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.125784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.125811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.125915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.126041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.126069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.126204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.126347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.126375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.126524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.126750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.126812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.126967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.127101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.127128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.127261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.127447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.127477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.127653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.127797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.127826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.127965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.128117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.128158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.128313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.128447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.128475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.128634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.128789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.128818] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.128934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.129053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.129083] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.129258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.129378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.129408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.129545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.129647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.129674] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.129784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.129901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.129930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.130063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.130175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.130205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.130361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.130528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.130558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.130688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.130844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.130871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.131065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.131222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.131271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.131436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.131568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.131594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.131710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.131928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.131957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.132114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.132261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.132288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.132440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.132597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.132626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.132784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.132940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.132966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.133090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.133261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.133289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.133417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.133575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.133601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.133717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.133856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.133886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.134070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.134244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.134281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.134427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.134565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.134594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.219 [2024-04-27 03:32:59.134723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.134881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.219 [2024-04-27 03:32:59.134908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.219 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.135082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.135231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.135263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.135407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.135562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.135592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.135804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.135978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.136007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.136184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.136318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.136345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.136482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.136646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.136675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.136844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.136957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.136987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.137149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.137253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.137280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.137382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.137484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.137512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.137641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.137787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.137818] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.137961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.138104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.138133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.138302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.138503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.138532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.138707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.138867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.138912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.139060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.139207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.139238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.139392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.139541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.139568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.139725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.139867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.139896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.140056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.140191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.140217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.140372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.140487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.140516] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.140662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.140787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.140817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.140963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.141131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.141160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.141288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.141389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.141417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.141563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.141674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.141703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.141880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.142011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.142035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.142160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.142306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.142335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.142457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.142589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.142615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.142788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.142955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.142984] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.143109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.143298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.143325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.143438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.143578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.143607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.143767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.143903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.143930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.144063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.144217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.144242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.220 [2024-04-27 03:32:59.144385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.144502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.220 [2024-04-27 03:32:59.144531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.220 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.144676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.144813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.144842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.144995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.145094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.145120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.145262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.145404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.145433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.145546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.145684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.145713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.145862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.146019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.146045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.146156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.146261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.146288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.146399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.146527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.146572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.146688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.146870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.146900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.147053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.147214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.147241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.147380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.147491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.147517] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.147658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.147819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.147846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.147981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.148126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.148156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.148297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.148443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.148473] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.148619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.148753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.148780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.148883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.149036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.149065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.149212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.149371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.149398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.149527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.149641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.149667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.149824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.149980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.150011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.150166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.150301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.150332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.150499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.150664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.150694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.150862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.151009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.151037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.151186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.151285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.151313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.151469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.151614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.151643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.151803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.151937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.151964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.152116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.152266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.152297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.152425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.152559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.152585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.152699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.152825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.152851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.152972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.153117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.153152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.153338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.153487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.153525] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.153685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.153820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.153847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.154000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.154194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.154221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.154364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.154498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.154539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.154704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.154833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.154859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.154993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.155103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.155130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.155280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.155447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.155477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.155631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.155730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.155757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.500 qpair failed and we were unable to recover it. 00:21:34.500 [2024-04-27 03:32:59.155877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.500 [2024-04-27 03:32:59.156018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.156047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.156174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.156306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.156337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.156446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.156554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.156580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.156730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.156899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.156929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.157073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.157217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.157270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.157428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.157586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.157613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.157771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.157922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.157948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.158078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.158239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.158273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.158455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.158587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.158614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.158722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.158850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.158877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.159025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.159161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.159190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.159379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.159535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.159582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.159774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.159919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.159949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.160105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.160215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.160242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.160400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.160546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.160575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.160714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.160848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.160876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.160982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.161098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.161128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.161280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.161410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.161437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.161569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.161702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.161728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.161905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.162052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.162082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.162219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.162395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.162425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.162597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.162752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.162796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.162944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.163078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.163108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.163274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.163417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.163447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.163625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.163755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.163782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.163957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.164087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.164114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.164284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.164425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.164454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.164622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.164789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.164818] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.164958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.165105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.165134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.165315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.165444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.165485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.165669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.165802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.165828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.165953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.166057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.166100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.166275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.166445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.166474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.166632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.166787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.166829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.166982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.167109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.167136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.167261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.167439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.167469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.167615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.167767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.167796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.167931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.168069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.168095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.168230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.168405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.168432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.168588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.168736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.168765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.168908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.169047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.169076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.169207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.169374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.169419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.169567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.169700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.169729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.169884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.170027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.170056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.170229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.170360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.170387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.170495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.170594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.170621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.170750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.170906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.170933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.171087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.171266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.171293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.171400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.171629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.171684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.171861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.172019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.172046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.172229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.172379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.172409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.172576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.172759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.172824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.173044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.173231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.173271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.173407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.173517] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.173544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.501 [2024-04-27 03:32:59.173650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.173772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.501 [2024-04-27 03:32:59.173798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.501 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.173898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.174034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.174061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.174222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.174374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.174405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.174555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.174704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.174747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.174891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.174999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.175028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.175169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.175315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.175345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.175468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.175648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.175675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.175833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.175980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.176006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.176145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.176315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.176342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.176446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.176548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.176574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.176708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.176906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.176932] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.177086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.177270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.177300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.177435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.177596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.177622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.177781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.177947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.177976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.178110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.178223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.178258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.178440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.178599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.178625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.178751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.178905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.178934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.179113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.179288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.179318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.179472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.179742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.179792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.179968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.180103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.180150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.180330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.180469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.180496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.180653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.180794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.180824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.180959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.181098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.181126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.181274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.181437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.181464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.181626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.181743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.181774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.181917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.182064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.182095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.182218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.182371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.182400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.182552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.182688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.182715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.182852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.183008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.183034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.183225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.183335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.183362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.183529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.183737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.183788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.183947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.184052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.184078] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.184209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.184338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.184368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.184540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.184651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.184680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.184825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.184972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.185000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.185146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.185284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.185312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.185429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.185552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.185579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.185710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.185880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.185909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.186041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.186181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.186211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.186370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.186473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.186499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.186620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.186727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.186755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.186894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.187062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.187091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.187239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.187432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.187461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.187589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.187721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.187749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.187873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.188036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.188065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.188222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.188358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.188385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.188533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.188754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.188781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.188886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.188990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.189016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.189136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.189276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.189309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.502 qpair failed and we were unable to recover it. 00:21:34.502 [2024-04-27 03:32:59.189442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.189599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.502 [2024-04-27 03:32:59.189625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.189792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.189905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.189934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.190091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.190223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.190255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.190395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.190580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.190609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.190731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.190874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.190902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.191014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.191165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.191194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.191372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.191550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.191579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.191720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.191894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.191921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.192047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.192220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.192257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.192376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.192525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.192555] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.192722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.192875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.192917] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.193058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.193238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.193272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.193382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.193524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.193554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.193769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.193902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.193929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.194032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.194191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.194218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.194362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.194467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.194495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.194694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.194802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.194828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.194961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.195133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.195162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.195338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.195468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.195494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.195633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.195784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.195813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.195963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.196087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.196115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.196261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.196482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.196540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.196719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.196849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.196891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.197013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.197123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.197154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.197300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.197472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.197498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.197600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.197782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.197812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.197959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.198059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.198085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.198243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.198386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.198416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.198565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.198735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.198764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.198978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.199161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.199190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.199326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.199461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.199487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.199661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.199768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.199799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.199952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.200081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.200107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.200287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.200425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.200452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.200600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.200752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.200778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.200879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.201014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.201040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.201177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.201318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.201348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.201533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.201690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.201717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.201886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.202020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.202048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.202199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.202377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.202411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.202563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.202696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.202723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.202879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.203034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.203061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.203216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.203429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.203482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.203666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.203817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.203859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.204002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.204147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.204177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.204399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.204703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.204756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.204914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.205081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.205133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.205285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.205456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.205486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.205632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.205779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.205808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.205952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.206125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.206159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.206322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.206479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.206506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.206663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.206801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.206828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.206995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.207141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.207169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.207339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.207457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.207484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.207672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.207804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.207849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.207995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.208162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.503 [2024-04-27 03:32:59.208190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.503 qpair failed and we were unable to recover it. 00:21:34.503 [2024-04-27 03:32:59.208345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.208452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.208480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.208667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.208801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.208831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.208981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.209082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.209108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.209241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.209376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.209407] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.209556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.209717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.209744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.209851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.209997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.210028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.210166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.210330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.210356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.210513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.210652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.210682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.210841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.210972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.210998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.211121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.211259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.211286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.211420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.211620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.211649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.211817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.211940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.211971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.212083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.212195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.212237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.212358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.212461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.212492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.212600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.212750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.212776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.212904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.213053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.213082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.213191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.213342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.213373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.213519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.213663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.213691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.213850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.213976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.214002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.214181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.214342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.214371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.214496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.214641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.214670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.214780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.214947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.214976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.215139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.215270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.215303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.215472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.215586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.215613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.215763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.215897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.215926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.216045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.216155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.216184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.216320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.216426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.216452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.216598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.216706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.216736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.216896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.217000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.217026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.217203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.217364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.217391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.217548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.217649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.217675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.217826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.217952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.217981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.218133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.218233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.218268] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.218426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.218560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.218590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.218758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.218886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.218913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.219053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.219175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.219201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.219317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.219426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.219453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.219575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.219743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.219769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.219925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.220026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.220053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.220187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.220322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.220353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.220520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.220644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.220670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.220779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.220929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.220958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.221079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.221214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.221240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.221397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.221552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.221578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.221715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.221898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.221927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.222068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.222253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.222283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.222412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.222514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.222540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.222646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.222774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.222800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.222981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.223113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.223139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.223282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.223461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.223490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.223639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.223752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.223780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.223967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.224123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.224151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.224284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.224421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.224448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.224560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.224690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.224716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.224829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.224959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.224986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.504 qpair failed and we were unable to recover it. 00:21:34.504 [2024-04-27 03:32:59.225138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.504 [2024-04-27 03:32:59.225284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.505 [2024-04-27 03:32:59.225313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.505 qpair failed and we were unable to recover it. 00:21:34.505 [2024-04-27 03:32:59.225417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.505 [2024-04-27 03:32:59.225535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.505 [2024-04-27 03:32:59.225563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.505 qpair failed and we were unable to recover it. 00:21:34.505 [2024-04-27 03:32:59.225747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.505 [2024-04-27 03:32:59.225879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.505 [2024-04-27 03:32:59.225906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.505 qpair failed and we were unable to recover it. 00:21:34.505 [2024-04-27 03:32:59.226050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.505 [2024-04-27 03:32:59.226178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.505 [2024-04-27 03:32:59.226204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.505 qpair failed and we were unable to recover it. 00:21:34.505 [2024-04-27 03:32:59.226346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.505 [2024-04-27 03:32:59.226469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.505 [2024-04-27 03:32:59.226499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.226644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.226805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.226832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.226935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.227092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.227121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.227274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.227377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.227403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.227517] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.227634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.227663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.227818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.227961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.227991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.228133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.228313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.228341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.228444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.228547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.228575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.228686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.228817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.228843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.228990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.229157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.229185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.229308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.229448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.229478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.229640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.229796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.229823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.229961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.230118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.230148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.230291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.230410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.230441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.230565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.230694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.230720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.230859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.230962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.230990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.231114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.231267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.231294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.231406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.231578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.231608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.231720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.231835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.231864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.232021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.232157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.232184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.232354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.232502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.232528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.232659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.232781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.232825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.232935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.233083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.233113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.233296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.233429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.233473] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.233603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.233730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.233757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.233896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.234025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.234051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.234207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.234367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.234397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.234551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.234684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.234710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.234868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.235022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.235048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.235176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.235302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.235332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.235483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.235608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.235639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.235784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.235916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.235942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.236095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.236219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.236256] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.236400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.236550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.236579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.236737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.236892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.236918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.237053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.237182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.237208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.237343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.237513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.237542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.237694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.237845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.237872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.238022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.238198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.238226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.238359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.238463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.238490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.238644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.238783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.238812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.238972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.239104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.239130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.239292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.239434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.239461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.239590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.239720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.239746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.239905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.240055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.240081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.240214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.240406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.240436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.240707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.240868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.240899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.506 [2024-04-27 03:32:59.241050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.241150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.506 [2024-04-27 03:32:59.241177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.506 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.241313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.241432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.241464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.241577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.241713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.241742] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.241907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.242044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.242074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.242223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.242340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.242367] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.242464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.242563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.242588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.242692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.242824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.242850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.242967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.243118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.243147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.243304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.243432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.243459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.243633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.243736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.243763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.243920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.244069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.244099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.244317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.244468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.244498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.244669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.244779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.244806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.244975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.245103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.245129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.245259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.245427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.245457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.245573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.245755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.245780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.245914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.246020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.246046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.246176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.246313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.246343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.246487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.246634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.246664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.246808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.246970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.246996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.247097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.247227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.247260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.247417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.247529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.247560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.247730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.247847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.247876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.247988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.248119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.248148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.248299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.248405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.248431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.248559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.248679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.248708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.248822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.248987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.249017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.249181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.249300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.249330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.249463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.249568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.249595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.249731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.249901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.249927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.250084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.250222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.250258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.250404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.250532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.250559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.250715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.250847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.250873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.250969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.251071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.251097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.251270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.251420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.251449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.251594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.251742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.251773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.251923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.252055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.252081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.252230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.252375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.252405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.252544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.252693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.252727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.252871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.253026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.253054] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.253188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.253314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.253340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.253504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.253624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.253655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.253841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.253939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.253966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.254086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.254235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.254270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.254420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.254528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.254555] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.254709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.254845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.254874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.255046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.255159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.255189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.255321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.255458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.255485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.255613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.255740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.255770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.255915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.256048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.256075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.256223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.256373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.256416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.256574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.256751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.256780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.256903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.257016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.257046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.257172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.257315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.257342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.257474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.257579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.257605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.257706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.257856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.257885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.507 qpair failed and we were unable to recover it. 00:21:34.507 [2024-04-27 03:32:59.258025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.507 [2024-04-27 03:32:59.258139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.258168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.258322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.258434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.258461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.258634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.258754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.258788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.258957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.259128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.259157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.259334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.259485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.259511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.259644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.259743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.259769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.259896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.260050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.260079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.260226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.260362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.260389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.260525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.260661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.260704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.260838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.260937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.260964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.261095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.261277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.261304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.261440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.261574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.261602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.261718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.261861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.261891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.262029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.262160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.262187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.262320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.262430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.262461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.262584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.262752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.262781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.262964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.263083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.263109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.263261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.263385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.263411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.263514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.263640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.263666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.263796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.263938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.263964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.264076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.264221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.264257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.264382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.264521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.264547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.264657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.264799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.264828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.265003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.265125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.265153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.265303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.265437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.265463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.265599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.265731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.265758] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.265888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.266068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.266094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.266199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.266304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.266333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.266432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.266577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.266604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.266715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.266869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.266895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.267067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.267165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.267189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.267315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.267475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.267502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.267656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.267806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.267834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.267965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.268074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.268111] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.268260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.268359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.268386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.268542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.268664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.268693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.268837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.268989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.269017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.269142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.269275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.269302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.269497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.269626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.269652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.269797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.269939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.269968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.270102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.270263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.270320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.270450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.270562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.270588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.270691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.270812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.270856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.271013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.271178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.271207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.271335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.271441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.271466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.271595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.271717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.271743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.271865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.271980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.272009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.272175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.272294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.272324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.272497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.272651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.272679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.272835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.272969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.272994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.508 qpair failed and we were unable to recover it. 00:21:34.508 [2024-04-27 03:32:59.273175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.273314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.508 [2024-04-27 03:32:59.273343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.273458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.273626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.273655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.273812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.274009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.274038] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.274169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.274300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.274327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.274462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.274564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.274590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.274751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.274896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.274939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.275041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.275213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.275243] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.275391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.275523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.275552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.275681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.275816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.275842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.275955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.276053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.276079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.276222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.276371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.276401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.276554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.276678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.276705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.276825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.276949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.276980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.277133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.277307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.277335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.277500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.277664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.277693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.277839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.277938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.277965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.278081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.278257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.278295] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.278426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.278563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.278589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.278738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.278848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.278878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.279032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.279156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.279182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.279290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.279434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.279463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.279634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.279808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.279836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.279979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.280144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.280169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.280303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.280434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.280460] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.280619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.280741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.280770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.280911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.281061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.281090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.281273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.281389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.281419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.281589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.281721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.281766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.281910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.282071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.282096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.282223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.282361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.282390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.282552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.282661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.282686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.282816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.282925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.282951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.283060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.283164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.283190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.283304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.283401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.283427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.283538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.283652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.283694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.283817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.283949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.283975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.284122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.284292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.284319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.284477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.284661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.284690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.284871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.285028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.285054] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.285162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.285317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.285344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.285477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.285647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.285673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.285835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.285949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.285979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.286088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.286230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.286267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.286455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.286590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.286633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.286783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.286893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.286919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.287029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.287138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.287164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.287290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.287427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.287453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.287568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.287713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.287739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.287890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.288036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.288065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.288180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.288339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.288366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.288470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.288601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.288627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.288766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.288889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.288916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.289089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.289215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.289242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.289394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.289528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.289557] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.289715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.289865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.289894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.509 [2024-04-27 03:32:59.290050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.290183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.509 [2024-04-27 03:32:59.290209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.509 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.290390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.290508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.290542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.290646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.290768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.290798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.290970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.291088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.291118] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.291257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.291383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.291409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.291516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.291665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.291691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.291845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.291982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.292010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.292145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.292295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.292325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.292482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.292622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.292649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.292753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.292892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.292920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.293068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.293213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.293241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.293397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.293562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.293589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.293745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.293876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.293921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.294065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.294186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.294215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.294376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.294507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.294533] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.294650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.294814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.294840] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.294996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.295151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.295176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.295287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.295444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.295469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.295615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.295837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.295900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.296039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.296156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.296185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.296335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.296494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.296520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.296672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.296816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.296845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.297019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.297150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.297177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.297357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.297482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.297511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.297640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.297790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.297816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.297973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.298113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.298142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.298298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.298396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.298422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.298547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.298646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.298672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.298804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.298927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.298958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.299081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.299244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.299277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.299403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.299548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.299576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.299737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.299868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.299894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.300028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.300137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.300164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.300289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.300442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.300472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.300630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.300767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.300793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.300895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.301040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.301068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.301190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.301287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.301314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.301466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.301587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.301617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.301763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.301903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.301937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.302079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.302273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.302301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.302411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.302568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.302594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.302758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.302886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.302912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.303053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.303197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.303226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.303379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.303548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.303576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.303737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.303889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.303915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.304060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.304223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.304260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.304412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.304550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.304580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.304757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.304865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.510 [2024-04-27 03:32:59.304892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.510 qpair failed and we were unable to recover it. 00:21:34.510 [2024-04-27 03:32:59.305023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.305181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.305211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.305353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.305509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.305554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.305674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.305809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.305838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.305979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.306152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.306181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.306368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.306501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.306527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.306686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.306838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.306867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.307013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.307137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.307162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.307317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.307445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.307474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.307602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.307762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.307788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.307942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.308111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.308139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.308256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.308407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.308437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.308575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.308724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.308753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.308932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.309067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.309109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.309263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.309376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.309402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.309531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.309727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.309753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.309910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.310036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.310061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.310163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.310289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.310317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.310472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.310614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.310642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.310781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.310919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.310948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.311089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.311222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.311259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.311397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.311529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.311554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.311738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.311881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.311910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.312023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.312165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.312193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.312348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.312484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.312509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.312609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.312739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.312765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.312948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.313082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.313108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.313266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.313397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.313426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.313606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.313759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.313784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.313920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.314028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.314056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.314189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.314337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.314367] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.314550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.314662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.314688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.314847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.314990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.315020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.315226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.315362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.315389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.315518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.315647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.315673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.315819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.315939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.315968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.316111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.316259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.316289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.316445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.316583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.316608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.316770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.316954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.316980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.317110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.317237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.317274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.317451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.317570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.317600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.317767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.317896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.317921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.318059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.318171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.318199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.318373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.318510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.318536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.318664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.318839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.318867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.319053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.319180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.319205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.319319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.319451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.319479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.319608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.319786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.319812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.319948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.320142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.320167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.320302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.320413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.320440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.320572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.320675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.320717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.320878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.321028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.321058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.321207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.321331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.321360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.511 qpair failed and we were unable to recover it. 00:21:34.511 [2024-04-27 03:32:59.321488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.321623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.511 [2024-04-27 03:32:59.321649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.321822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.321951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.321976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.322137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.322322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.322352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.322493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.322670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.322698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.322873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.323048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.323076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.323258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.323393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.323418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.323529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.323642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.323669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.323837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.323973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.324001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.324158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.324287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.324314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.324472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.324634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.324660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.324795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.324926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.324951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.325102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.325219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.325254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.325402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.325511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.325536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.325646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.325774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.325801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.325922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.326088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.326116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.326284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.326393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.326422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.326583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.326717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.326743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.326895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.327059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.327085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.327242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.327401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.327427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.327588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.327730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.327759] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.327912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.328014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.328042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.328200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.328335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.328361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.328492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.328639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.328668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.328806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.328977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.329005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.329184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.329311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.329339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.329506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.329688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.329751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.329928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.330069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.330098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.330265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.330435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.330463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.330641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.330816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.330845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.330967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.331098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.331127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.331276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.331413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.331443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.331613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.331796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.331824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.331985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.332092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.332119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.332259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.332413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.332443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.332584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.332721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.332747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.332877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.333022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.333053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.333234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.333371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.333399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.333544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.333665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.333695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.333873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.334002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.334028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.334185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.334331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.334361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.334509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.334641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.334668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.334811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.334946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.334972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.335094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.335268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.335297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.335448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.335584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.335613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.335744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.335874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.335900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.336021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.336174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.336202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.336382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.336493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.336524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.336677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.336846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.336875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.337052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.337182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.337223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.337402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.337537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.337563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.337703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.337828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.337856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.338010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.338176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.338201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.338338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.338498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.512 [2024-04-27 03:32:59.338541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.512 qpair failed and we were unable to recover it. 00:21:34.512 [2024-04-27 03:32:59.338685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.338835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.338865] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.339006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.339147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.339176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.339290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.339436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.339465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.339586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.339720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.339746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.339867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.340024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.340050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.340178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.340360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.340389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.340529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.340652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.340682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.340842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.340994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.341020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.341172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.341342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.341371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.341484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.341594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.341623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.341770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.341921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.341949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.342078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.342207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.342233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.342398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.342506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.342536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.342683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.342853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.342881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.343027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.343138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.343167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.343295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.343412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.343439] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.343570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.343740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.343769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.343941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.344056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.344085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.344231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.344409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.344438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.344551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.344685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.344711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.344837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.345014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.345042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.345202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.345338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.345365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.345489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.345647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.345673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.345826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.345962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.345988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.346106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.346281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.346311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.346480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.346655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.346684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.346826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.346977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.347006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.347151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.347259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.347285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.347423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.347541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.347571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.347715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.347865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.347894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.348062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.348206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.348236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.348423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.348552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.348594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.348764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.348897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.348925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.349105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.349271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.349301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.349427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.349551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.349582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.349707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.349863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.349889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.350070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.350189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.350222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.350377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.350506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.350532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.350660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.350773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.350801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.350924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.351037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.351064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.351259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.351388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.351417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.351563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.351702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.351730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.351911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.352036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.352062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.352207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.352320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.352347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.352504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.352658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.352687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.352822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.352986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.353014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.353116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.353267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.353301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.353484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.353627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.353653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.353769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.353942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.353972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.354111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.354238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.513 [2024-04-27 03:32:59.354286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.513 qpair failed and we were unable to recover it. 00:21:34.513 [2024-04-27 03:32:59.354381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.354508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.354537] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.354686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.354795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.354822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.354983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.355114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.355140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.355284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.355440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.355469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.355604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.355720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.355748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.355900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.356038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.356064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.356259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.356367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.356398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.356507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.356665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.356691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.356844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.356990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.357019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.357193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.357350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.357377] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.357479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.357611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.357638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.357780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.357902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.357931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.358040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.358176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.358204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.358364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.358520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.358546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.358668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.358805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.358833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.359003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.359138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.359167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.359309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.359454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.359487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.359641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.359771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.359797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.359907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.360030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.360056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.360212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.360333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.360364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.360515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.360715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.360765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.360944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.361113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.361141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.361282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.361433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.361459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.361611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.361727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.361757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.361900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.362020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.362046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.362200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.362376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.362405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.362555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.362690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.362718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.362833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.362982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.363010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.363166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.363322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.363349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.363505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.363634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.363678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.363844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.363984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.364013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.364226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.364339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.364366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.364514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.364628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.364657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.364785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.364939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.364964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.365087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.365233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.365273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.365383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.365525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.365554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.365710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.365843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.365869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.366032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.366164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.366208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.366400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.366579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.366608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.366744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.366961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.366990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.367134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.367302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.367332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.367489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.367641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.367682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.367825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.367936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.367978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.368134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.368260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.368289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.368466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.368618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.368647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.368772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.368910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.368936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.369068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.369235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.369267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.369372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.369532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.369558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.369710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.369893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.369919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.370051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.370174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.370200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.514 qpair failed and we were unable to recover it. 00:21:34.514 [2024-04-27 03:32:59.370353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.514 [2024-04-27 03:32:59.370521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.370549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.370720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.370830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.370858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.370999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.371140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.371169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.371318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.371473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.371517] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.371667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.371838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.371866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.372004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.372123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.372152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.372296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.372417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.372445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.372604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.372757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.372783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.372900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.373014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.373042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.373209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.373345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.373372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.373506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.373656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.373684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.373840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.373946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.373973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.374110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.374241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.374289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.374435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.374631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.374683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.374874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.375005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.375030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.375192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.375352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.375380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.375522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.375696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.375725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.375839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.375963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.375992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.376157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.376299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.376328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.376479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.376617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.376644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.376772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.376952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.376978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.377133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.377285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.377312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.377489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.377622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.377649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.377785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.377914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.377941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.378096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.378281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.378308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.378462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.378597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.378623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.378780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.378968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.378994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.379126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.379277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.379320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.379458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.379580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.379605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.379758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.379906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.379937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.380093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.380204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.380234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.380387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.380541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.380567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.380733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.380866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.380895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.381007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.381220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.381252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.381362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.381524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.381553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.381709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.381844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.381870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.382026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.382190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.382219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.382367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.382513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.382541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.382685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.382831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.382860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.383004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.383113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.383139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.383266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.383415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.383441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.383576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.383701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.383727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.383977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.384169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.384195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.384321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.384425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.384451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.384579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.384727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.384756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.384906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.385007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.385032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.385173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.385315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.385342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.515 qpair failed and we were unable to recover it. 00:21:34.515 [2024-04-27 03:32:59.385472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.385632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.515 [2024-04-27 03:32:59.385675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.385846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.385989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.386017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.386158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.386344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.386371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.386542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.386723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.386750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.386860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.386988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.387015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.387132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.387287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.387313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.387440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.387610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.387638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.387805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.387942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.387971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.388102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.388230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.388262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.388389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.388488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.388531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.388674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.388810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.388856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.388988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.389166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.389194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.389350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.389452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.389478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.389610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.389731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.389761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.389905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.390021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.390051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.390165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.390308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.390335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.390434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.390561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.390587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.390739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.390891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.390920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.391097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.391231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.391265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.391383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.391514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.391539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.391643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.391773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.391804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.391932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.392077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.392121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.392261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.392421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.392447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.392592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.392734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.392763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.392876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.393008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.393036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.393177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.393311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.393338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.393467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.393627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.393653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.393893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.393995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.394020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.394142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.394238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.394269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.394403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.394503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.394544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.394695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.394824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.394850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.394980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.395130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.395158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.395285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.395410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.395436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.395542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.395723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.395750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.395915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.396079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.396107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.396255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.396405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.396430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.396544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.396677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.396703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.396808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.396954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.396979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.397132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.397273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.397318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.397449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.397554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.397579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.397678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.397804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.397830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.398009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.398142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.398170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.398333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.398464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.398490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.398669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.398834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.398863] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.398995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.399145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.399170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.399303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.399439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.399470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.399601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.399720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.399750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.399923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.400070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.400095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.400259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.400387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.400414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.400525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.400679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.400707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.400815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.400948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.400977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.401110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.401230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.401266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.401397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.401533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.401558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.516 qpair failed and we were unable to recover it. 00:21:34.516 [2024-04-27 03:32:59.401709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.516 [2024-04-27 03:32:59.401826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.401854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.401994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.402164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.402189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.402292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.402398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.402423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.402582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.402757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.402785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.402964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.403086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.403114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.403302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.403432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.403457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.403587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.403741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.403767] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.403896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.404051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.404077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.404239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.404386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.404415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.404583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.404815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.404869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.405043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.405171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.405196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.405323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.405478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.405504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.405643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.405793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.405821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.405956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.406072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.406102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.406255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.406427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.406456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.406579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.406735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.406760] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.406885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.407020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.407048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.407194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.407306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.407335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.407474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.407632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.407662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.407792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.407893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.407919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.408073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.408202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.408244] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.408376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.408507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.408533] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.408626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.408786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.408812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.408963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.409131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.409159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.409319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.409464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.409492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.409631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.409798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.409826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.410011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.410118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.410145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.410310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.410420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.410447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.410572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.410713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.410741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.410889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.411028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.411057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.411202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.411374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.411403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.411530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.411683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.411710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.411862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.412030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.412059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.412228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.412378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.412408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.412527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.412695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.412724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.412883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.413012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.413038] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.413138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.413310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.413337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.413462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.413608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.413636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.413791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.413942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.413968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.414104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.414265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.414308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.414431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.414591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.414616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.414774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.414932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.414960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.415130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.415291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.415317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.415415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.415542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.415569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.415722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.415874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.415902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.416017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.416161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.416190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.416360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.416475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.416504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.416627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.416750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.416775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.416909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.417039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.417064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.417258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.417398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.417428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.417563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.417709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.417737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.417910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.418015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.418042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.418173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.418349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.418378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.418519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.418686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.418715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.418909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.419108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.419137] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.419284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.419440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.419481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.517 qpair failed and we were unable to recover it. 00:21:34.517 [2024-04-27 03:32:59.419631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.517 [2024-04-27 03:32:59.419800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.419829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.419946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.420042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.420068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.420179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.420288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.420314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.420440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.420601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.420627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.420781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.420937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.420963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.421115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.421215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.421241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.421365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.421483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.421509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.421664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.421773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.421799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.421952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.422143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.422172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.422329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.422463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.422489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.422659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.422843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.422869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.422997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.423152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.423194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.423364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.423478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.423507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.423645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.423761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.423796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.423973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.424126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.424152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.424310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.424415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.424441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.424601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.424778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.424806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.424975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.425126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.425154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.425307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.425428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.425458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.425588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.425723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.425748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.425897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.426041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.426085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.426241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.426351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.426378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.426499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.426627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.426653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.426815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.426937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.426980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.427137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.427271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.427298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.427452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.427581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.427607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.427732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.427909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.427937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.428072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.428217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.428242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.428388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.428515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.428541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.428674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.428822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.428850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.429026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.429180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.429206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.429359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.429504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.429546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.429715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.429872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.429898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.430034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.430167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.430196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.430348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.430460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.430486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.430584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.430709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.430753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.430898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.431037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.431066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.431201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.431371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.431398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.431507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.431663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.431689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.431811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.431956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.431986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.432133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.432282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.432308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.432408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.432522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.432547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.432687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.432838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.432864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.433041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.433180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.433208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.433352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.433496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.433540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.433711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.433851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.433880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.434046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.434187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.434216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.434349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.434505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.434548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.435767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.435946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.435977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.436102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.436283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.436311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.518 [2024-04-27 03:32:59.436463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.436593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.518 [2024-04-27 03:32:59.436619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.518 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.436800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.436966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.436994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.437172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.437291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.437318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.437455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.437590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.437616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.437827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.438023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.438052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.438219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.438402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.438428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.438605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.438793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.438855] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.439022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.439160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.439189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.439316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.439425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.439451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.439560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.439676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.439704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.439852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.440045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.440071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.440226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.440351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.440379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.440487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.440592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.440618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.440744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.440865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.440893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.441063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.441820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.441857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.442031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.442218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.442244] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.442397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.442549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.442593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.442746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.442955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.443026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.443171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.443354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.443381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.443487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.444191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.444223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.444363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.444498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.444526] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.444697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.444887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.444915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.445036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.445191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.445220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.445386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.445520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.445547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.445674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.445819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.445847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.445974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.446140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.446168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.446294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.446405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.446431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.446578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.446772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.446800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.446997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.447117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.447145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.447266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.447415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.447440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.447573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.447684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.447712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.447855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.448026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.448054] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.448175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.448329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.448356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.448477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.448589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.448626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.448782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.448938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.448966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.449130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.449326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.449352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.449483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.449601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.449626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.449811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.449962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.449990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.450155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.450299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.450326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.450426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.450524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.450560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.450714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.450814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.450839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.450973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.451115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.451142] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.451324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.451449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.451475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.451604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.451747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.451776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.451972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.452135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.452163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.452336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.452437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.452464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.452635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.452813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.452841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.453003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.453145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.453173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.453309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.453414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.453440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.453540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.453680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.453710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.453890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.454035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.454063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.454207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.454351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.454380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.454508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.454674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.454719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.454828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.454996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.455026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.455138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.455263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.455299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.455420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.455586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.455638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.519 qpair failed and we were unable to recover it. 00:21:34.519 [2024-04-27 03:32:59.455786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.455911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.519 [2024-04-27 03:32:59.455936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.520 qpair failed and we were unable to recover it. 00:21:34.520 [2024-04-27 03:32:59.456049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.520 [2024-04-27 03:32:59.456171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.520 [2024-04-27 03:32:59.456199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.520 qpair failed and we were unable to recover it. 00:21:34.520 [2024-04-27 03:32:59.456343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.520 [2024-04-27 03:32:59.456451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.520 [2024-04-27 03:32:59.456478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.520 qpair failed and we were unable to recover it. 00:21:34.520 [2024-04-27 03:32:59.456581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.520 [2024-04-27 03:32:59.456705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.520 [2024-04-27 03:32:59.456738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.520 qpair failed and we were unable to recover it. 00:21:34.520 [2024-04-27 03:32:59.456882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.520 [2024-04-27 03:32:59.457013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.520 [2024-04-27 03:32:59.457049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.520 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.457207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.457352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.457381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.457495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.457620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.457646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.457793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.457906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.457939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.458106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.458258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.458285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.458390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.458492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.458523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.458660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.458843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.458869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.459014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.459140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.459169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.459315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.459425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.459451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.459579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.459760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.459801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.459978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.460128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.460157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.460289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.460418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.460449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.460571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.460683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.460708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.460835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.460959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.460988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.461107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.461220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.461255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.461372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.461527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.461565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.461674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.461813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.461841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.461976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.462148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.462176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.462290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.462410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.462438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.462550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.462702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.462730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.462858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.462961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.462988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.463132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.463252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.463282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.463403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.463569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.463594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.463695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.463795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.463821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.463953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.464061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.464087] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.464220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.464394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.464420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.464553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.464699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.464728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.464873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.465018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.465047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.465168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.465287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.824 [2024-04-27 03:32:59.465313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.824 qpair failed and we were unable to recover it. 00:21:34.824 [2024-04-27 03:32:59.465431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.465534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.465560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.465665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.465763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.465788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.465911] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.466036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.466065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.466224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.466378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.466406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.466510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.466698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.466724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.466854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.466981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.467010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.467122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.467292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.467321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.467454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.467597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.467623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.467758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.467897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.467926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.468074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.468203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.468229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.468363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.468461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.468486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.468599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.468705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.468730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.468903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.469008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.469034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.469153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.469300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.469335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.469464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.469609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.469637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.469790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.469901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.469926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.470057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.470201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.470231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.470397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.470512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.470548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.470677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.470840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.470873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.471002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.471131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.471156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.471281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.471390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.471416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.471523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.471692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.471721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.471877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.472030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.472055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.472162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.472302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.472329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.472436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.472540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.472566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.472697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.472855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.472883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.473012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.473158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.473186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.473334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.473457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.473483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.473636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.473748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.825 [2024-04-27 03:32:59.473776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.825 qpair failed and we were unable to recover it. 00:21:34.825 [2024-04-27 03:32:59.473961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.474127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.474155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.474304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.474410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.474436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.474545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.474647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.474677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.474835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.474978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.475008] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.475156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.475277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.475303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.475410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.475527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.475552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.475664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.475819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.475845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.476010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.476125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.476153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.476312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.476420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.476449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.476553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.476703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.476731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.476868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.476971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.476997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.477152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.477273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.477299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.477414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.477518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.477564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.477739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.477847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.477874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.477979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.478113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.478138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.478281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.478395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.478421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.478524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.478634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.478660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.478768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.478917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.478945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.479072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.479200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.479228] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.479346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.479445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.479470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.479571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.479727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.479755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.479929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.480060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.480085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.480217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.480340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.480365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.480468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.480586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.480614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.480793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.480948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.480973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.481102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.481232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.481266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.481419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.481530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.481555] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.481683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.481823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.481851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.826 qpair failed and we were unable to recover it. 00:21:34.826 [2024-04-27 03:32:59.482001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.482146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.826 [2024-04-27 03:32:59.482188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.482320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.482429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.482454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.482605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.482707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.482732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.482893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.483030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.483057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.483184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.483329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.483355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.483464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.483565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.483589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.483715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.483821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.483845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.483973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.484110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.484139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.484285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.484406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.484434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.484555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.484667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.484694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.484825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.484932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.484957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.485099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.485208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.485232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.485374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.485501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.485528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.485673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.485845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.485870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.486003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.486107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.486131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.486259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.486379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.486404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.486513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.486649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.486677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.486861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.486973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.486998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.487125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.487227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.487266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.487381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.487487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.487512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.487648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.487792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.487820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.487950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.488065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.488090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.488219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.488325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.488350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.488454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.488566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.488591] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.488716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.488848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.488872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.489052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.489154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.489178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.489309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.489413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.489438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.489600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.489720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.489748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.827 [2024-04-27 03:32:59.489893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.490004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.827 [2024-04-27 03:32:59.490032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.827 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.490153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.490311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.490340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.490493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.490605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.490631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.490763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.490900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.490934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.491083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.491200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.491227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.491362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.491472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.491497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.491629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.491728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.491762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.491877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.492026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.492053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.492201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.492366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.492391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.492503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.492634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.492663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.492809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.492940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.492971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.493090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.493200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.493229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.493370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.493500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.493525] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.493706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.493826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.493853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.494021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.494157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.494199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.494346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.494447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.494472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.494643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.494817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.494847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.494989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.495155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.495182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.495315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.495420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.495445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.495548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.495681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.495706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.495833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.495981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.496008] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.496123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.496267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.496296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.496419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.496527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.496551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.496689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.496821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.496862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.828 qpair failed and we were unable to recover it. 00:21:34.828 [2024-04-27 03:32:59.497002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.828 [2024-04-27 03:32:59.497122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.497151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.497315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.497428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.497453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.497561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.497715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.497740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.497896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.498023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.498050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.498161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.498317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.498344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.498451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.498597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.498623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.498729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.498880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.498906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.499094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.499255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.499280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.499391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.499492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.499517] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.499655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.499797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.499825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.500012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.500106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.500130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.500279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.500443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.500471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.500606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.500707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.500732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.500858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.500995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.501020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.501148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.501256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.501281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.501457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.501623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.501648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.501780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.501929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.501957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.502096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.502207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.502234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.502399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.502526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.502551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.502710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.502863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.502890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.503024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.503154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.503179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.503289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.503394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.503419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.503527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.503659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.503683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.503810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.503940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.503967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.504109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.504254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.504297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.504406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.504533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.504558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.504695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.504808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.504834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.505013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.505164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.505189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.505332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.505455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.505483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.829 qpair failed and we were unable to recover it. 00:21:34.829 [2024-04-27 03:32:59.505638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.829 [2024-04-27 03:32:59.505785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.505812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.505965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.506094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.506138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.506310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.506454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.506481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.506662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.506795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.506820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.506957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.507127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.507155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.507297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.507413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.507437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.507585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.507738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.507765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.507892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.508045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.508070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.508169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.508294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.508320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.508450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.508553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.508584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.508747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.508896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.508921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.509026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.509174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.509206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.509372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.509507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.509532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.509650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.509752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.509777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.509903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.510056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.510091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.510219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.510353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.510378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.510493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.510616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.510640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.510743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.510880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.510906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.511042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.511162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.511190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.511322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.511451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.511477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.511650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.511818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.511845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.511982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.512084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.512108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.512221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.512329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.512354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.512462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.512589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.512613] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.512791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.512936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.512964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.513110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.513254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.513280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.513382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.513478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.513502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.513661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.513802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.513829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.830 [2024-04-27 03:32:59.514001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.514111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.830 [2024-04-27 03:32:59.514138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.830 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.514303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.514431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.514456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.514640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.514783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.514814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.514969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.515086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.515113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.515230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.515387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.515414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.515532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.515664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.515689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.515840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.515982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.516009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.516158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.516274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.516302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.516423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.516541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.516581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.516693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.516819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.516843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.516958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.517078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.517107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.517225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.517360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.517385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.517515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.517702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.517730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.517906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.518010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.518035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.518165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.518306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.518334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.518478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.518628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.518655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.518796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.518906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.518933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.519057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.519176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.519200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.519353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.519464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.519489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.519632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.519741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.519765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.519906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.520026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.520055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.520199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.520353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.520379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.520491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.520626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.520650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.520798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.520937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.520964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.521112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.521264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.521292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.521442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.521576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.521600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.521757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.521917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.521941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.522046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.522157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.522181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.522318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.522426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.522451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.831 qpair failed and we were unable to recover it. 00:21:34.831 [2024-04-27 03:32:59.522590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.522715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.831 [2024-04-27 03:32:59.522739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.522895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.523072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.523096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.523215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.523328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.523353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.523483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.523611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.523635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.523744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.523897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.523921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.524074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.524224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.524282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.524435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.524604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.524632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.524742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.524847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.524874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.524995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.525101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.525125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.525255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.525403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.525431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.525587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.525697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.525724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.525865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.526000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.526024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.526181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.526312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.526354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.526472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.526605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.526632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.526799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.526940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.526969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.527116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.527259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.527287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.527420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.527520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.527546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.527651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.527815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.527842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.527997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.528136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.528163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.528320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.528447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.528472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.528579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.528711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.528735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.528837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.528967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.528991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.529170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.529308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.529334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.529441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.529592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.529634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.529759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.529861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.529886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.530021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.530192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.530220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.530359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.530494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.530519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.832 qpair failed and we were unable to recover it. 00:21:34.832 [2024-04-27 03:32:59.530627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.832 [2024-04-27 03:32:59.530755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.530779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.530910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.531041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.531065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.531226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.531377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.531406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.531519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.531635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.531660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.531799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.531898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.531922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.532050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.532154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.532178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.532320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.532422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.532447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.532563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.532708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.532735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.532852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.533032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.533057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.533215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.533379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.533405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.533539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.533667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.533694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.533873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.533987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.534011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.534161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.534277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.534318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.534444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.534596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.534639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.534804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.534909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.534933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.535063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.535157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.535187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.535306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.535434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.535459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.535565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.535683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.535707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.535880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.536017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.536044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.536153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.536338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.536364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.536479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.536626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.536654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.536788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.536897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.536923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.537030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.537146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.537170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.833 qpair failed and we were unable to recover it. 00:21:34.833 [2024-04-27 03:32:59.537304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.537431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.833 [2024-04-27 03:32:59.537455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.537594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.537713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.537752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.537878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.538037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.538062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.538182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.538324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.538349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.538483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.538609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.538636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.538753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.538869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.538896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.539027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.539133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.539163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.539298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.539443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.539471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.539630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.539782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.539807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.539958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.540112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.540136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.540277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.540379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.540404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.540558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.540693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.540718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.540845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.541007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.541032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.541134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.541258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.541283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.541433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.541560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.541585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.541763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.541865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.541891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.542006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.542210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.542242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.542401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.542503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.542527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.542638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.542740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.542764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.542868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.543000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.543027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.543212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.543378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.543404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.543535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.543670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.543695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.543825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.543947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.543972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.544102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.544265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.544291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.544437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.544634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.544659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.544789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.544915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.544944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.545123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.545231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.545262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.545396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.545544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.545571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.834 qpair failed and we were unable to recover it. 00:21:34.834 [2024-04-27 03:32:59.545683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.834 [2024-04-27 03:32:59.545832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.545859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.546045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.546172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.546197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.546308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.546424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.546449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.546602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.546717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.546744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.546915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.547064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.547089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.547196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.547364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.547389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.547496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.547608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.547633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.547738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.547868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.547892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.547996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.548124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.548164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.548324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.548481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.548506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.548678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.548814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.548839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.548969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.549112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.549139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.549322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.549467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.549495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.549613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.549763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.549789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.549918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.550023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.550048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.550191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.550347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.550372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.550504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.550631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.550656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.550793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.550923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.550948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.551074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.551196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.551221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.551376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.551508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.551533] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.551665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.551794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.551821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.551966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.552076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.552109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.552273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.552381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.552406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.552534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.552642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.552667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.552786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.552937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.552964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.835 qpair failed and we were unable to recover it. 00:21:34.835 [2024-04-27 03:32:59.553074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.553198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.835 [2024-04-27 03:32:59.553225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.553409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.553518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.553542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.553697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.553872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.553896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.554027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.554146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.554173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.554356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.554461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.554490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.554599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.554729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.554754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.554873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.554987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.555015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.555133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.555258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.555286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.555426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.555559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.555586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.555741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.555895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.555935] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.556056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.556206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.556233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.556408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.556510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.556535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.556706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.556863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.556888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.556994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.557126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.557151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.557296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.557459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.557484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.557700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.557828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.557853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.557999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.558120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.558145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.558252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.558383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.558408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.558532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.558663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.558687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.558860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.558995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.559022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.836 [2024-04-27 03:32:59.559160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.559319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.836 [2024-04-27 03:32:59.559344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.836 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.559444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.559572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.559596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.559718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.559863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.559888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.560042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.560161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.560188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.560331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.560428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.560452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.560636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.560786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.560813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.560931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.561080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.561108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.561252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.561419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.561447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.561558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.561723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.561751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.561930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.562061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.562102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.562211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.562372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.562398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.562502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.562656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.562684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.562851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.562966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.562993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.563120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.563277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.563302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.563434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.563555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.563582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.563760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.563926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.563953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.564090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.564209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.564237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.564408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.564542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.564566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.564718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.564871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.564900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.837 [2024-04-27 03:32:59.565071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.565237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.837 [2024-04-27 03:32:59.565271] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.837 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.565420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.565560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.565584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.565692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.565790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.565815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.565964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.566073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.566101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.566238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.566390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.566415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.566542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.566687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.566715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.566862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.566991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.567016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.567166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.567308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.567336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.567459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.567592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.567620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.567764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.567899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.567926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.568043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.568140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.568164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.568284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.568425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.568452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.568620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.568746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.568770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.568900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.569024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.569049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.569177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.569283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.569309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.569427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.569593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.569620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.569763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.569935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.569967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.570083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.570226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.570259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.570402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.570535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.570559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.570685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.570812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.570836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.838 qpair failed and we were unable to recover it. 00:21:34.838 [2024-04-27 03:32:59.570982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.838 [2024-04-27 03:32:59.571153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.571181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.571291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.571413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.571437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.571546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.571672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.571696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.571847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.571954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.571981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.572134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.572281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.572309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.572475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.572627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.572654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.572835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.572943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.572973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.573127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.573287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.573316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.573460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.573604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.573631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.573771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.573939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.573967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.574123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.574257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.574282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.574386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.574483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.574507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.574690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.574817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.574842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.574948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.575074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.839 [2024-04-27 03:32:59.575102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.839 qpair failed and we were unable to recover it. 00:21:34.839 [2024-04-27 03:32:59.575261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.575413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.575438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.575562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.575686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.575710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.575842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.575992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.576019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.576177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.576331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.576357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.576487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.576615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.576640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.576769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.576868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.576893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.577023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.577183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.577208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.577360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.577493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.577519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.577630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.577792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.577817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.577968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.578108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.578135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.578262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.578429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.578457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.578595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.578757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.578782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.578912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.579064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.579089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.579227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.579411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.579440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.579593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.579739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.579763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.579887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.580016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.580041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.580195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.580331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.580356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.580453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.580639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.580667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.580816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.580943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.580969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.840 qpair failed and we were unable to recover it. 00:21:34.840 [2024-04-27 03:32:59.581086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.840 [2024-04-27 03:32:59.581222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.581255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.581411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.581510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.581534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.581669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.581795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.581822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.581957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.582121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.582149] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.582293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.582406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.582433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.582561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.582659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.582685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.582828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.582992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.583019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.583165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.583326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.583351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.583475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.583619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.583646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.583774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.583907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.583931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.584044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.584163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.584187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.584294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.584395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.584420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.584534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.584687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.584714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.584846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.584969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.584993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.585182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.585291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.585317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.585450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.585602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.585627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.585780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.585937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.585964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.586132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.586275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.586300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.586432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.586588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.586615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.841 qpair failed and we were unable to recover it. 00:21:34.841 [2024-04-27 03:32:59.586762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.841 [2024-04-27 03:32:59.586900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.586941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.587071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.587178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.587202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.587353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.587478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.587503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.587662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.587802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.587829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.587997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.588140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.588168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.588317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.588427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.588457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.588616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.588712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.588737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.588890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.589061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.589089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.589193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.589376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.589401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.589531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.589660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.589700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.589831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.589930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.589956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.590088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.590261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.590289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.590431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.590606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.590633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.590779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.590928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.590956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.591077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.591228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.591258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.591363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.591464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.591488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.591628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.591749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.591776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.591921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.592060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.592089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.592311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.592432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.592457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.592583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.592755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.842 [2024-04-27 03:32:59.592782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.842 qpair failed and we were unable to recover it. 00:21:34.842 [2024-04-27 03:32:59.592941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.593094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.593119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.593219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.593334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.593360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.593494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.593596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.593621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.593799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.593912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.593940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.594093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.594217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.594242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.594381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.594506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.594531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.594636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.594788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.594812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.594975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.595110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.595135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.595313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.595452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.595480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.595633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.595745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.595773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.595919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.596044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.596068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.596214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.596368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.596393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.596527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.596693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.596719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.596852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.596995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.597022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.597197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.597332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.597357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.597468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.597598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.597623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.597750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.597924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.597952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.598094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.598240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.598274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.598415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.598542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.598567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.598692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.598836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.598863] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.843 qpair failed and we were unable to recover it. 00:21:34.843 [2024-04-27 03:32:59.599019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.843 [2024-04-27 03:32:59.599160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.599187] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.599324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.599490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.599515] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.599649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.599777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.599803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.599994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.600143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.600167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.600302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.600400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.600425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.600564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.600679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.600706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.600822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.600979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.601004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.601153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.601289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.601317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.601483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.601619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.601647] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.601824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.601986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.602011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.602144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.602275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.602300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.602459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.602600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.602627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.602786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.602916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.602941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.603101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.603210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.603236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.603369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.603520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.603545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.603645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.603754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.603778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.603908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.604036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.604065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.604215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.604399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.604424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.604554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.604681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.604706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.604875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.605006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.605031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.605164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.605311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.844 [2024-04-27 03:32:59.605338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.844 qpair failed and we were unable to recover it. 00:21:34.844 [2024-04-27 03:32:59.605435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.605584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.605611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.605728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.605841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.605864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.605974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.606126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.606150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.606284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.606418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.606441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.606577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.606747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.606774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.606882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.607049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.607075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.607245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.607393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.607417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.607570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.607718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.607745] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.607907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.608080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.608104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.608236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.608368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.608393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.608501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.608662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.608690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.608839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.608948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.608973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.609076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.609199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.609227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.609369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.609479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.609504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.609656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.609823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.609850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.610003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.610108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.610133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.610251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.610406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.610430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.610540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.610663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.610690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.610806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.610952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.610976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.845 qpair failed and we were unable to recover it. 00:21:34.845 [2024-04-27 03:32:59.611135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.845 [2024-04-27 03:32:59.611273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.611299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.611403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.611547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.611575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.611734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.611865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.611890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.612033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.612179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.612207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.612348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.612474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.612498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.612626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.612766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.612792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.612949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.613049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.613073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.613209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.613347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.613372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.613473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.613602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.613626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.613765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.613886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.613913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.614057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.614164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.614192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.614345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.614448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.614475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.614581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.614711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.614737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.614895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.615061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.615088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.615250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.615376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.615401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.615505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.615606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.615630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.615730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.615882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.615907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.616057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.616181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.616206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.616374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.616503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.616528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.616666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.616778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.616805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.616932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.617041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.617065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.617217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.617373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.617398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.617528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.617680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.617708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.617888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.618018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.618043] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.618139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.618263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.618288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.618394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.618541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.618570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.618726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.618828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.846 [2024-04-27 03:32:59.618853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.846 qpair failed and we were unable to recover it. 00:21:34.846 [2024-04-27 03:32:59.618959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.619109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.619143] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.619274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.619430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.619454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.619592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.619711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.619738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.619882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.620060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.620085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.620184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.620337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.620362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.620464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.620600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.620625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.620754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.620904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.620932] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.621077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.621229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.621259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.621366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.621472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.621497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.621631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.621758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.621782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.621921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.622037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.622069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.622184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.622303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.622346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.622456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.622585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.622610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.622742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.622845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.622870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.622991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.623126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.623153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.623319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.623425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.623452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.623592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.623729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.623756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.623910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.624036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.624061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.624204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.624369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.624395] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.624547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.624714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.624741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.624881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.624993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.625020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.625144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.625300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.625325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.625460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.625593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.625619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.625747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.625900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.625925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.626055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.626205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.626234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.626365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.626475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.626499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.626696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.626826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.626850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.627006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.627153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.627180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.847 [2024-04-27 03:32:59.627341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.627471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.847 [2024-04-27 03:32:59.627495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.847 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.627649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.627749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.627774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.627939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.628075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.628102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.628260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.628371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.628399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.628543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.628689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.628717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.628848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.628977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.629002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.629177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.629302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.629327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.629456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.629568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.629595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.629777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.629886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.629910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.630033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.630133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.630157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.630308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.630417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.630443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.630621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.630735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.630762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.630900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.631040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.631069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.631258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.631433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.631461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.631585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.631727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.631754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.631925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.632082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.632106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.632235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.632364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.632391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.632545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.632681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.632706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.632814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.632962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.632990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.633137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.633257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.633284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.633448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.633589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.633616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.633766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.633865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.633890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.634011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.634164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.634191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.634372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.634480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.634505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.634679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.634810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.634835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.634941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.635053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.635077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.635205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.635352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.635379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.635508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.635610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.635635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.635781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.635908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.635932] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.848 [2024-04-27 03:32:59.636097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.636198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.848 [2024-04-27 03:32:59.636222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.848 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.636391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.636490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.636514] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.636624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.636782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.636807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.636989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.637117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.637141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.637339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.637492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.637521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.637624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.637746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.637787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.637943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.638088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.638115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.638225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.638377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.638404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.638528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.638651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.638676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.638799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.638906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.638933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.639076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.639192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.639219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.639355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.639486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.639510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.639641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.639767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.639791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.639944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.640059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.640086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.640228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.640388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.640416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.640602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.640732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.640757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.640884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.641010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.641034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.641216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.641320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.641346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.641449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.641558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.641585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.641717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.641845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.641871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.642025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.642146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.642170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.642368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.642504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.642529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.642658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.642800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.642828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.642947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.643093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.643120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.643276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.643404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.643428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.643570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.643685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.643712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.643866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.644001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.644028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.644142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.644284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.644312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.644446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.644574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.644599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.849 [2024-04-27 03:32:59.644725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.644823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.849 [2024-04-27 03:32:59.644848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.849 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.644979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.645105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.645130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.645287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.645415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.645440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.645564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.645720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.645744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.645842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.645983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.646010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.646186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.646286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.646312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.646426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.646553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.646578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.646703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.646833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.646857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.647025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.647213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.647237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.647427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.647527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.647552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.647687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.647865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.647892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.648094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.648233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.648267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.648416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.648540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.648564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.648731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.648882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.648907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.649057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.649191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.649215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.649348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.649480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.649505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.649622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.649750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.649778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.649892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.650019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.650044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.650167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.650303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.650328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.650455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.650584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.650608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.650760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.650930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.650957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.651126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.651271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.651299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.651413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.651580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.651607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.651783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.651945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.651987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.652125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.652264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.850 [2024-04-27 03:32:59.652292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.850 qpair failed and we were unable to recover it. 00:21:34.850 [2024-04-27 03:32:59.652468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.652564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.652589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.652720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.652870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.652902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.653030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.653184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.653209] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.653385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.653488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.653513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.653668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.653806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.653835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.653982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.654126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.654154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.654336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.654439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.654464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.654571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.654703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.654728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.654858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.654997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.655024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.655163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.655320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.655349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.655475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.655628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.655653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.655789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.655934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.655961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.656083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.656226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.656259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.656387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.656515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.656540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.656677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.656805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.656829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.656976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.657117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.657144] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.657313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.657443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.657467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.657602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.657752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.657776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.657883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.658038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.658062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.658182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.658311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.658338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.658502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.658660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.658687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.658807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.658969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.658994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.659126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.659272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.659297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.659453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.659569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.659596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.659765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.659893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.659918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.660041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.660214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.660241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.660391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.660494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.660520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.660640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.660772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.660799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.660943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.661106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.851 [2024-04-27 03:32:59.661133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.851 qpair failed and we were unable to recover it. 00:21:34.851 [2024-04-27 03:32:59.661256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.661396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.661424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.661556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.661690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.661714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.661819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.661945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.661970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.662100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.662239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.662273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.662387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.662525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.662552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.662704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.662802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.662827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.662968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.663076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.663116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.663273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.663462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.663487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.663591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.663718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.663743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.663844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.663992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.664016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.664169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.664283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.664311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.664452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.664619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.664646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.664800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.664949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.664973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.665075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.665175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.665200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.665325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.665431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.665455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.665620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.665785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.665812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.665919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.666056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.666096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.666193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.666309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.666334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.666437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.666533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.666575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.666739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.666865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.666891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.667035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.667215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.667239] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.667347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.667497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.667522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.667627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.667748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.667772] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.667930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.668109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.668140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.668324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.668449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.668473] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.668575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.668727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.668751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.668920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.669087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.669114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.669284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.669451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.669478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.852 [2024-04-27 03:32:59.669599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.669741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.852 [2024-04-27 03:32:59.669768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.852 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.669915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.670045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.670069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.670193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.670344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.670371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.670509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.670670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.670694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.670851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.671021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.671048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.671187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.671326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.671352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.671459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.671603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.671631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.671768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.671908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.671936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.672110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.672260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.672286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.672432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.672585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.672610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.672721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.672887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.672915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.673078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.673206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.673231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.673341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.673469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.673495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.673595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.673749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.673774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.673929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.674073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.674100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.674285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.674386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.674411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.674541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.674678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.674706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.674831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.674953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.674977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.675107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.675257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.675300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.675439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.675619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.675646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.675762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.675865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.675892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.676042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.676170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.676197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.676371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.676504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.676528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.676713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.676884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.676911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.677089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.677238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.677269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.677473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.677602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.677626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.677743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.677893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.677933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.678064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.678171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.678195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.678302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.678403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.678428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.853 [2024-04-27 03:32:59.678583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.678675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.853 [2024-04-27 03:32:59.678700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.853 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.678848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.678986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.679014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.679135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.679303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.679331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.679472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.679658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.679683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.679786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.679894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.679919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.680034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.680223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.680253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.680412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.680555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.680582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.680725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.680899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.680927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.681080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.681213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.681237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.681351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.681461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.681486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.681679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.681808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.681832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.681961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.682113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.682141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.682286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.682419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.682444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.682543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.682650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.682674] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.682842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.682943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.682970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.683110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.683260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.683285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.683409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.683538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.683562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.683691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.683836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.683868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.684017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.684132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.684159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.684301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.684467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.684495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.684647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.684775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.684800] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.684959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.685101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.685127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.685241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.685426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.685450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.685613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.685761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.685788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.685937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.686043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.686068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.686169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.686315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.686341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.686453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.686558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.686583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.686751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.686887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.686921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.687073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.687199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.687224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.854 [2024-04-27 03:32:59.687416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.687559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.854 [2024-04-27 03:32:59.687587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.854 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.687754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.687919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.687949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.688121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.688263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.688292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.688425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.688528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.688553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.688687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.688861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.688888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.689033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.689205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.689230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.689368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.689467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.689492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.689639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.689792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.689817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.689971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.690118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.690146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.690322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.690452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.690477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.690632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.690801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.690829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.691006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.691134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.691174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.691306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.691418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.691445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.691576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.691703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.691731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.691850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.691975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.691999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.692101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.692232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.692265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.692385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.692572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.692597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.692733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.692865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.692889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.693067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.693202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.693227] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.693407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.693541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.693566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.693701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.693859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.693884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.694016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.694147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.694171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.694277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.694387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.694412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.694511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.694614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.694640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.694771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.694903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.694932] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.855 qpair failed and we were unable to recover it. 00:21:34.855 [2024-04-27 03:32:59.695056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.855 [2024-04-27 03:32:59.695229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.695264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.695401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.695541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.695570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.695718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.695853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.695879] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.696064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.696206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.696235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.696403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.696536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.696562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.696670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.696799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.696825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.696929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.697037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.697062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.697220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.697332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.697358] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.697467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.697597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.697622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.697775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.697920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.697948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.698119] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.698226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.698264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.698393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.698520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.698545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.698650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.698780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.698824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.698971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.699130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.699155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.699284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.699419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.699446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.699603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.699724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.699751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.699895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.700038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.700068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.700240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.700426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.700451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.700579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.700681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.700706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.700821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.700968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.700993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.701125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.701311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.701340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.701465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.701633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.701658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.701785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.701912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.701938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.702120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.702304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.702330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.702444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.702578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.702605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.702754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.702873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.702900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.703059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.703161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.703188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.703315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.703446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.703470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.703660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.703788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.856 [2024-04-27 03:32:59.703814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.856 qpair failed and we were unable to recover it. 00:21:34.856 [2024-04-27 03:32:59.703962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.704110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.704138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.704274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.704435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.704477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.704590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.704700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.704728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.704903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.705083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.705109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.705264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.705398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.705423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.705536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.705659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.705684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.705783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.705889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.705915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.706066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.706177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.706205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.706379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.706532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.706560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.706709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.706842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.706867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.706995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.707101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.707126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.707287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.707455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.707480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.707611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.707772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.707799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.707974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.708083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.708108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.708321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.708452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.708477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.708660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.708775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.708805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.708945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.709099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.709126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.709265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.709401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.709426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.709534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.709639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.709664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.709818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.709944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.709972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.710093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.710259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.710288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.710406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.710504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.710529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.710659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.710783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.710811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.710934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.711074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.711104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.711244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.711380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.711408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.711587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.711739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.711768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.711933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.712048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.712075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.712221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.712409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.712434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.857 [2024-04-27 03:32:59.712660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.712789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.857 [2024-04-27 03:32:59.712817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.857 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.712964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.713097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.713122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.713259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.713412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.713441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.713614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.713731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.713772] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.713877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.714056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.714084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.714207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.714346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.714372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.714476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.714578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.714604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.714730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.714882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.714911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.715052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.715201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.715229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.715386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.715506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.715531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.715658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.715812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.715839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.715947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.716073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.716098] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.716254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.716393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.716421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.716571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.716702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.716727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.716883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.717037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.717064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.717190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.717360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.717389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.717547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.717701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.717731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.717905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.718123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.718151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.718275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.718433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.718458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.718566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.718697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.718722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.718833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.718982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.719010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.719153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.719370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.719397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.719528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.719658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.719688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.719814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.719957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.719985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.720132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.720290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.720319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.720446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.720604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.720630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.720751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.720887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.720914] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.721049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.721208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.721234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.721364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.721516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.721543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.858 qpair failed and we were unable to recover it. 00:21:34.858 [2024-04-27 03:32:59.721675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.858 [2024-04-27 03:32:59.721782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.721808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.721942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.722064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.722089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.722199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.722376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.722405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.722518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.722636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.722664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.722840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.722946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.722973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.723081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.723205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.723230] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.723383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.723520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.723548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.723692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.723809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.723837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.723962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.724080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.724106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.724222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.724343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.724371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.724542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.724660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.724688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.724805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.724951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.724979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.725103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.725215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.725241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.725350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.725496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.725523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.725676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.725786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.725811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.725912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.726011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.726036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.726190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.726330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.726376] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.726520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.726662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.726690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.726849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.727006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.727036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.727177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.727359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.727385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.727491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.727592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.727618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.727725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.727867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.727895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.728077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.728175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.728200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.728333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.728472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.728501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.728655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.728760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.859 [2024-04-27 03:32:59.728785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.859 qpair failed and we were unable to recover it. 00:21:34.859 [2024-04-27 03:32:59.728939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.729089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.729117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.729254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.729388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.729414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.729540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.729681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.729709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.729857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.729964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.729993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.730130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.730255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.730284] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.730433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.730598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.730625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.730756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.730855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.730880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.731006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.731113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.731139] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.731243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.731408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.731437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.731588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.731706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.731734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.731851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.732002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.732027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.732151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.732259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.732285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.732395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.732504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.732546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.732692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.732809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.732844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.732959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.733102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.733131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.733266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.733403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.733428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.733558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.733712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.733755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.733891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.734041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.734069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.734179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.734328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.734354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.734486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.734609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.734634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.734821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.734963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.734992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.735114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.735237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.735285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.735425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.735570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.735598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.735748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.735857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.735888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.736026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.736178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.736206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.736343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.736515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.736542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.736665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.736778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.736805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.736961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.737065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.737091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.860 [2024-04-27 03:32:59.737221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.737393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.860 [2024-04-27 03:32:59.737422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.860 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.737584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.737737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.737766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.737882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.738020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.738050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.738176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.738307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.738334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.738488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.738619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.738646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.738783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.738915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.738944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.739100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.739318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.739344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.739476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.739604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.739629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.739777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.739929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.739957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.740108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.740323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.740349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.740452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.740550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.740575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.740740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.740848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.740890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.741033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.741149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.741177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.741318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.741474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.741500] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.741631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.741784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.741809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.741932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.742054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.742084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.742323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.742428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.742454] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.742637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.742764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.742792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.742942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.743056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.743086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.743215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.743382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.743426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.743573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.743710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.743738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.743859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.744002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.744031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.744148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.744297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.744326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.744450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.744579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.744604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.744709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.744841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.744866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.744994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.745148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.745174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.745314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.745467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.745495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.745709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.745860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.745890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.746031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.746258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.746288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.861 qpair failed and we were unable to recover it. 00:21:34.861 [2024-04-27 03:32:59.746407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.861 [2024-04-27 03:32:59.746552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.746580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.746696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.746849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.746875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.747083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.747264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.747293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.747456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.747560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.747587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.747748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.747898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.747927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.748045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.748167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.748192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.748331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.748457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.748483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.748594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.748698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.748724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.748859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.748981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.749011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.749160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.749320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.749346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.749558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.749662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.749689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.749846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.749989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.750017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.750165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.750285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.750315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.750501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.750630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.750656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.750786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.750896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.750923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.751050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.751201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.751229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.751424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.751556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.751581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.751693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.751828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.751854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.751986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.752113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.752138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.752283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.752424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.752451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.752590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.752719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.752744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.752908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.753034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.753061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.753218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.753332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.753360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.753545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.753701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.753726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.753835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.754048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.754076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.754256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.754402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.754430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.754595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.754701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.754728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.754865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.754974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.755004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.755175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.755346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.862 [2024-04-27 03:32:59.755375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.862 qpair failed and we were unable to recover it. 00:21:34.862 [2024-04-27 03:32:59.755519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.755685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.755714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.755861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.755961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.755988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.756114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.756261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.756290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.756407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.756587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.756612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.756747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.756880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.756906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.757035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.757191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.757216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.757383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.757511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.757536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.757676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.757853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.757878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.758013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.758251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.758280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.758437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.758580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.758607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.758714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.758822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.758849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.759066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.759176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.759204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.759398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.759545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.759575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.759732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.759858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.759883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.759986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.760156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.760181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.760293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.760398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.760425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.760639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.760821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.760846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.760952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.761083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.761110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.761270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.761403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.761429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.761548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.761690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.761718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.761852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.761994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.762024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.762177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.762304] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.762330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.762459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.762571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.762598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.762768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.762924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.762948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.763109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.763264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.763292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.763440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.763533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.763557] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.763676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.763779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.763806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.763954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.764105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.764131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.863 [2024-04-27 03:32:59.764232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.764371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.863 [2024-04-27 03:32:59.764397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.863 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.764524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.764627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.764652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.764805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.764949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.764976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.765137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.765271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.765297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.765451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.765560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.765587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.765747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.765900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.765924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.766071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.766186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.766213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.766342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.766478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.766503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.766657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.766802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.766830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.766983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.767082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.767106] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.767233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.767350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.767381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.767514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.767670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.767708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.767841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.767976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.768001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.768154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.768339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.768364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.768469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.768656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.768680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.768814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.768947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.768973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.769124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.769295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.769321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.769474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.769605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.769629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.769736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.769876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.769904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.770040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.770176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.770203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.770337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.770467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.770492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.770642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.770798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.770822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.770971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.771116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.771140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.771298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.771413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.771440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.771595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.771714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.771739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.864 qpair failed and we were unable to recover it. 00:21:34.864 [2024-04-27 03:32:59.771864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.771991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.864 [2024-04-27 03:32:59.772015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.772192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.772371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.772396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.772510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.772652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.772676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.772872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.773017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.773056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.773183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.773307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.773332] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.773464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.773639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.773663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.773826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.773987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.774015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.774159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.774317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.774342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.774484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.774618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.774643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.774766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.774905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.774933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.775079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.775231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.775262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.775368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.775523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.775548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.775655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.775751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.775775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.775928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.776080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.776114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.776282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.776417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.776442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.776575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.776699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.776724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.776884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.776983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.777009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.777116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.777244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.777275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.777431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.777588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.777616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.777762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.777904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.777941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.778123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.778257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.778282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.778415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.778521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.778547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.778711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.778889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.778916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.779072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.779208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.779234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:34.865 [2024-04-27 03:32:59.779377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.779569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:34.865 [2024-04-27 03:32:59.779598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:34.865 qpair failed and we were unable to recover it. 00:21:35.150 [2024-04-27 03:32:59.779741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.150 [2024-04-27 03:32:59.779887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.150 [2024-04-27 03:32:59.779916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.150 qpair failed and we were unable to recover it. 00:21:35.150 [2024-04-27 03:32:59.780062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.150 [2024-04-27 03:32:59.780216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.150 [2024-04-27 03:32:59.780258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.150 qpair failed and we were unable to recover it. 00:21:35.150 [2024-04-27 03:32:59.780405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.780538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.780563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.780693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.780825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.780860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.781022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.781171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.781200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.781373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.781476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.781501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.781659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.781786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.781811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.781940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.782069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.782094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.782229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.782367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.782392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.782527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.782655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.782684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.782827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.782956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.782980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.783085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.783213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.783242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.783354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.783460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.783484] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.783582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.783709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.783736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.783887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.784038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.784065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.784212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.784355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.784380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.784508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.784630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.784658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.784798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.784965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.784993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.785116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.785221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.785266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.785402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.785562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.785605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.785713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.785856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.785883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.786052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.786192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.786221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.786362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.786528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.786553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.786686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.786787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.786811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.786937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.787105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.787131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.787279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.787445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.787469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.787573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.787719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.787746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.787887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.788040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.788065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.788199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.788360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.788385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.788516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.788672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.788696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.788834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.788974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.789001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.789151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.789282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.789307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.789449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.789624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.789651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.789820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.789982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.790010] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.790147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.790268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.790297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.790446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.790550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.790575] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.790728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.790846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.790873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.791013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.791124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.791152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.791289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.791425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.791452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.791580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.791683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.791709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.791816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.791970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.791998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.792141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.792276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.792318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.792450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.792598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.792625] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.792746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.792866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.792891] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.792992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.793138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.151 [2024-04-27 03:32:59.793166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.151 qpair failed and we were unable to recover it. 00:21:35.151 [2024-04-27 03:32:59.793311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.793483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.793508] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.793635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.793764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.793788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.793916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.794069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.794094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.794230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.794415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.794440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.794568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.794725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.794753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.794890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.795034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.795061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.795216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.795349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.795374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.795511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.795690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.795718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.795879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.796031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.796055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.796254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.796383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.796408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.796536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.796661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.796686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.796797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.796948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.796977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.797118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.797308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.797334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.797444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.797567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.797592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.797721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.797848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.797872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.798023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.798162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.798189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.798371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.798467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.798492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.798630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.798786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.798814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.798946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.799076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.799102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.799231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.799339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.799364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.799518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.799616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.799641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.799793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.799941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.799968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.800095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.800203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.800229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.800340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.800492] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.800516] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.800675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.800845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.800872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.800985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.801115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.801143] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.801292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.801414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.801438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.801612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.801782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.801813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.801932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.802097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.802122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.802273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.802429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.802458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.802608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.802737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.802762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.802934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.803074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.803101] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.803288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.803413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.803438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.803597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.803776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.803801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.803932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.804057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.804081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.804207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.804346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.804371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.804524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.804679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.804703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.804856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.805023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.805050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.805183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.805388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.805413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.805537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.805680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.805707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.805877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.806015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.806042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.806209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.806381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.806409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.806576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.806673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.806697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.152 qpair failed and we were unable to recover it. 00:21:35.152 [2024-04-27 03:32:59.806843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.152 [2024-04-27 03:32:59.807013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.807037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.807171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.807268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.807293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.807465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.807574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.807601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.807775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.807878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.807902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.808043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.808183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.808210] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.808374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.808507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.808532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.808680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.808857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.808884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.809028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.809180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.809205] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.809372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.809499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.809525] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.809670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.809814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.809843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.809947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.810109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.810136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.810264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.810412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.810437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.810567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.810739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.810763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.810893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.811083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.811107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.811253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.811402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.811429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.811588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.811730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.811755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.811913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.812076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.812102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.812240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.812396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.812421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.812601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.812733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.812761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.812883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.813039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.813063] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.813166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.813292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.813317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.813422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.813572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.813600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.813770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.813927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.813952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.814181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.814335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.814360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.814518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.814664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.814691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.814840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.815013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.815040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.815178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.815291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.815320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.815467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.815598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.815622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.815745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.815886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.815913] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.816056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.816225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.816257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.816413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.816523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.816548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.816701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.816856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.816880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.817012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.817127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.817154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.817329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.817435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.817463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.817604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.817748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.817776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.817900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.818032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.818061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.818167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.818290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.818333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.818479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.818655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.818679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.818780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.818929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.818956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.819105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.819250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.819275] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.153 qpair failed and we were unable to recover it. 00:21:35.153 [2024-04-27 03:32:59.819410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.819506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.153 [2024-04-27 03:32:59.819531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.819706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.819856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.819883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.820024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.820153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.820179] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.820321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.820446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.820471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.820625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.820761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.820789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.820907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.821051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.821080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.821268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.821397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.821421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.821526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.821652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.821677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.821825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.821966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.821993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.822104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.822252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.822281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.822394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.822553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.822578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.822750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.822892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.822917] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.823039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.823209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.823236] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.823423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.823557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.823582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.823711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.823856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.823883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.824000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.824127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.824155] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.824320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.824416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.824441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.824548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.824667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.824695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.824869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.825004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.825031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.825189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.825321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.825347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.825491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.825666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.825694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.825866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.826005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.826032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.826207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.826373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.826398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.826519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.826643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.826667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.826815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.826960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.826989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.827107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.827250] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.827280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.827442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.827543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.827568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.827720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.827888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.827915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.828031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.828167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.828194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.828355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.828467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.828493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.828646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.828776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.828801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.828928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.829056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.829082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.829243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.829403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.829430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.829566] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.829741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.829768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.829908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.830016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.830043] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.830216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.830328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.830355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.830485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.830676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.830704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.830846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.830971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.830999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.831143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.831285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.831327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.831456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.831561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.831586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.831704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.831821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.831846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.832007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.832172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.832199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.154 [2024-04-27 03:32:59.832355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.832483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.154 [2024-04-27 03:32:59.832507] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.154 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.832636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.832762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.832786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.832925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.833043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.833072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.833218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.833376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.833401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.833499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.833592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.833621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.833733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.833884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.833909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.834031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.834180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.834208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.834370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.834503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.834528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.834687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.834794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.834820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.834918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.835043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.835068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.835257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.835378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.835402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.835578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.835688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.835715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.835855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.836021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.836048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.836179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.836325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.836352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.836480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.836616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.836655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.836794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.836971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.836999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.837142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.837292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.837322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.837462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.837612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.837637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.837780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.837931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.837956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.838088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.838224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.838258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.838384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.838480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.838505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.838661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.838790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.838814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.838969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.839106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.839134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.839287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.839401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.839429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.839604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.839737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.839764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.839942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.840076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.840115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.840259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.840376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.840404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.840547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.840687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.840716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.840883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.841024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.841052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.841176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.841332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.841358] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.841548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.841679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.841704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.841830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.841973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.842001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.842145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.842292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.842322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.842475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.842574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.842599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.842745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.842882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.842910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.843099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.843232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.843261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.843422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.843573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.843598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.843724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.843832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.843857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.844015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.844146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.844174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.844330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.844434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.844459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.844622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.844771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.844806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.844969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.845095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.845119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.845298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.845411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.845440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.845594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.845730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.845755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.155 qpair failed and we were unable to recover it. 00:21:35.155 [2024-04-27 03:32:59.845931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.155 [2024-04-27 03:32:59.846092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.846119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.846276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.846434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.846459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.846605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.846746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.846774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.846946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.847113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.847140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.847286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.847455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.847482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.847610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.847765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.847790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.847974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.848114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.848141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.848287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.848437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.848461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.848615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.848808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.848832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.848957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.849067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.849093] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.849274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.849407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.849434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.849579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.849688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.849720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.849863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.849998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.850025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.850154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.850288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.850314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.850422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.850534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.850561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.850701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.850839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.850867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.850988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.851134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.851159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.851268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.851424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.851449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.851624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.851768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.851795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.851903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.852041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.852068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.852177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.852347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.852376] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.852498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.852598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.852626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.852780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.852920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.852949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.853128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.853273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.853316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.853446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.853577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.853602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.853699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.853800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.853824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.853952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.854096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.854123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.854268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.854451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.854475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.854578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.854734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.854758] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.854861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.854966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.854991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.855117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.855328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.855354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.855457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.855587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.855612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.855746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.855872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.855897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.856055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.856152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.856176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.856317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.856425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.856450] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.856621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.856781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.856809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.856933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.857060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.857084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.857215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.857372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.857398] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.857570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.857744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.857771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.857895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.858039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.858068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.858212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.858343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.858369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.858523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.858616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.858640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.858806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.858918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.156 [2024-04-27 03:32:59.858946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.156 qpair failed and we were unable to recover it. 00:21:35.156 [2024-04-27 03:32:59.859087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.859199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.859226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.859397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.859524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.859549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.859684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.859815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.859840] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.859976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.860145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.860173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.860337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.860472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.860497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.860695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.860847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.860872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.860998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.861124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.861148] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.861289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.861447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.861472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.861576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.861727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.861752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.861929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.862048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.862076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.862244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.862366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.862392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.862539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.862678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.862718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.862876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.863040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.863068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.863212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.863379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.863404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.863530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.863656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.863680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.863809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.863988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.864012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.864172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.864329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.864355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.864482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.864619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.864644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.864745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.864873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.864897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.865060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.865155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.865180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.865314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.865436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.865461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.865586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.865714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.865738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.865841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.865942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.865966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.866096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.866210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.866238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.866418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.866525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.866549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.866652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.866797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.866824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.866982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.867105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.867129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.867306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.867461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.867485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.867593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.867715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.867739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.867838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.867997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.868029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.868186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.868296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.868323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.868453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.868571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.868599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.868712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.868854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.868881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.868988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.869132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.869161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.869303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.869458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.869482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.869657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.869821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.869848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.869993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.870120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.870147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.870257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.870411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.870436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.870594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.870722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.870763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.870870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.870986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.871013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.157 [2024-04-27 03:32:59.871156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.871295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.157 [2024-04-27 03:32:59.871323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.157 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.871430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.871570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.871597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.871757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.871883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.871907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.872071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.872170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.872195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.872337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.872468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.872494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.872612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.872790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.872815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.872946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.873066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.873091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.873257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.873431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.873456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.873587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.873710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.873738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.873855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.874000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.874024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.874154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.874283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.874308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.874459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.874599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.874627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.874777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.874883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.874909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.875084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.875221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.875253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.875381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.875512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.875536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.875656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.875804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.875831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.876010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.876142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.876168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.876338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.876464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.876489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.876617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.876745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.876771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.876879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.877038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.877064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.877237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.877380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.877405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.877532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.877661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.877688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.877844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.878009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.878034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.878191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.878349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.878374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.878527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.878691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.878716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.878871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.879022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.879049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.879230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.879340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.879366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.879517] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.879638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.879666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.879844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.879946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.879970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.880123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.880276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.880304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.880435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.880567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.880592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.880764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.880920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.880945] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.881102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.881212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.881240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.881424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.881574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.881599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.881729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.881859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.881883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.881985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.882128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.882153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.882287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.882454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.882482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.882597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.882726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.882751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.882882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.883000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.883028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.883165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.883342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.883368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.883481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.883632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.883664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.883833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.883939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.883967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.884116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.884266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.884291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.884427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.884534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.884562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.158 qpair failed and we were unable to recover it. 00:21:35.158 [2024-04-27 03:32:59.884709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.158 [2024-04-27 03:32:59.884847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.884875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.885011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.885147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.885174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.885300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.885427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.885452] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.885602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.885752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.885777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.885931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.886079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.886107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.886256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.886368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.886395] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.886573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.886677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.886702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.886815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.886958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.886986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.887133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.887240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.887272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.887420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.887552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.887576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.887676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.887773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.887798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.887988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.888111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.888135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.888274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.888439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.888464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.888610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.888776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.888803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.888952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.889064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.889089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.889226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.889399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.889425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.889567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.889723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.889748] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.889860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.889988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.890012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.890165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.890271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.890296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.890427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.890534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.890558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.890715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.890867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.890894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.891032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.891184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.891211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.891337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.891470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.891495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.891600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.891750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.891777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.891941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.892070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.892097] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.892244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.892378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.892403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.892533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.892689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.892714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.892870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.893038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.893066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.893221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.893408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.893434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.893579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.893685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.893712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.893833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.893957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.893982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.894106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.894216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.894253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.894400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.894563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.894588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.894719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.894844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.894868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.894987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.895132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.895160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.895318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.895416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.895441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.895588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.895724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.895751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.895858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.896027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.896055] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.896205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.896316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.896341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.896449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.896547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.896572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.896680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.896821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.896849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.897004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.897109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.897134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.897271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.897400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.897425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.159 [2024-04-27 03:32:59.897545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.897713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.159 [2024-04-27 03:32:59.897738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.159 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.897872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.897989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.898030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.898182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.898341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.898365] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.898494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.898627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.898652] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.898839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.898970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.898998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.899144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.899260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.899288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.899426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.899560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.899588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.899710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.899806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.899830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.899947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.900080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.900105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.900258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.900376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.900401] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.900533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.900667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.900692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.900800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.900893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.900918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.901064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.901240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.901286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.901422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.901530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.901556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.901683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.901811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.901836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.901948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.902050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.902075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.902222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.902362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.902388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.902526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.902653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.902678] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.902811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.902910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.902934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.903071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.903194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.903219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.903372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.903496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.903521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.903627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.903752] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.903777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.903882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.903981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.904006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.904163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.904265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.904291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.904402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.904532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.904556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.904671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.904822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.904849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.905017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.905202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.905226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.905335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.905484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.905509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.905656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.905821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.905845] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.905982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.906164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.906191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.906353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.906456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.906481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.906609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.906760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.906785] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.906933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.907072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.907099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.907273] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.907407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.907432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.907591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.907748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.907773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.907898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.908025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.908050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.908174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.908311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.908340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.908500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.908629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.908654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.908807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.908932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.908959] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.909111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.909260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.909286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.160 qpair failed and we were unable to recover it. 00:21:35.160 [2024-04-27 03:32:59.909478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.160 [2024-04-27 03:32:59.909636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.909660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.909794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.909936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.909975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.910105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.910303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.910329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.910460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.910593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.910617] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.910745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.910889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.910918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.911054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.911197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.911224] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.911385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f4c910 is same with the state(5) to be set 00:21:35.161 [2024-04-27 03:32:59.911567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.911720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.911749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.911928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.912125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.912167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.912302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.912417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.912441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.912568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.912721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.912745] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.912899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.913049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.913092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.913252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.913422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.913463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.913620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.913818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.913862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.913967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.914094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.914120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.914229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.914386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.914430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.914582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.914721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.914749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.914890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.915037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.915064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.915203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.915358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.915384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.915555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.915687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.915711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.915871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.916001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.916027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.916132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.916282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.916308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.916441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.916581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.916609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.916761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.916926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.916953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.917098] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.917205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.917232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.917363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.917472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.917497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.917622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.917736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.917765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.917908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.918046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.918073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.918252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.918383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.918408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.918589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.918731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.918760] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.918940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.919107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.919134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.919283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.919387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.919413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.919541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.919680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.919707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.919852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.919986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.920013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.920158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.920309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.920334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.920466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.920594] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.920623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.920740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.920887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.920915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.921105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.921242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.921291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.921444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.921595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.921623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.921742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.921881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.921909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.922040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.922168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.922195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.922373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.922542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.922570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.922711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.922866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.922890] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.923107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.923251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.923294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.161 [2024-04-27 03:32:59.923425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.923568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.161 [2024-04-27 03:32:59.923595] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.161 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.923770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.923925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.923968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.924112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.924262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.924291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.924389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.924515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.924540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.924689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.924857] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.924884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.925031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.925171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.925198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.925367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.925477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.925501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.925657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.925794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.925822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.925960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.926094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.926121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.926270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.926394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.926421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.926551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.926667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.926695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.926844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.926951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.926976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.927109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.927234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.927263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.927433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.927536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.927561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.927695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.927824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.927850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.928011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.928156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.928185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.928368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.928525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.928550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.928751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.928858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.928882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.929009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.929135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.929163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.929296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.929403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.929427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.929581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.929706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.929730] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.929828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.929926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.929950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.930057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.930181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.930206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.930359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.930491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.930515] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.930699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.930868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.930895] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.931051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.931206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.931231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.931367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.931520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.931562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.931704] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.931824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.931852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.932001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.932142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.932171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.932297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.932426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.932453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.932578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.932736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.932761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.932893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.933023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.933047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.933205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.933341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.933366] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.933466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.933644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.933672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.933818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.933933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.933960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.934083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.934208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.934233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.934400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.934507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.934531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.934641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.934768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.934793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.934922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.935019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.935044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.935198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.935362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.935388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.935521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.935677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.935705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.935862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.935989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.936013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.936113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.936307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.936333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.936464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.936563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.936588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.162 [2024-04-27 03:32:59.936720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.936840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.162 [2024-04-27 03:32:59.936864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.162 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.937022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.937162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.937189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.937372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.937498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.937522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.937651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.937784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.937808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.937947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.938070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.938095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.938280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.938422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.938451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.938581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.938707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.938731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.938883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.939048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.939073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.939200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.939335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.939361] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.939486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.939611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.939640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.939769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.939899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.939923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.940054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.940179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.940219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.940360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.940461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.940485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.940634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.940779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.940806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.940974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.941084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.941112] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.941271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.941380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.941404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.941502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.941604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.941629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.941763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.941918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.941943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.942057] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.942220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.942264] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.942387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.942510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.942539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.942685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.942843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.942871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.943043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.943143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.943167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.943297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.943445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.943472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.943614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.943760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.943784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.943939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.944070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.944111] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.944259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.944392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.944419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.944565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.944722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.944746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.944848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.944972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.944996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.945156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.945274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.945300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.945443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.945609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.945636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.945791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.945923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.945947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.946083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.946219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.946253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.946436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.946537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.946562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.946718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.946823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.946848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.947027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.947147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.947175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.947292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.947412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.947438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.947573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.947698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.947724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.947821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.947976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.948000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.948159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.948291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.948316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.163 [2024-04-27 03:32:59.948470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.948576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.163 [2024-04-27 03:32:59.948600] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.163 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.948735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.948854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.948882] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.949062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.949244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.949307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.949401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.949541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.949565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.949664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.949789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.949816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.949990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.950142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.950170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.950309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.950410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.950435] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.950611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.950759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.950786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.950964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.951102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.951129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.951278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.951409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.951434] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.951559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.951717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.951744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.951889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.952035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.952062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.952189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.952318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.952343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.952478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.952596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.952624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.952769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.952923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.952948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.953051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.953181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.953206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.953378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.953507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.953532] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.953666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.953771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.953796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.953895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.954047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.954072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.954232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.954389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.954416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.954548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.954697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.954724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.954856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.954989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.955014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.955163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.955285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.955310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.955437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.955569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.955594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.955694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.955821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.955846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.955994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.956111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.956138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.956324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.956430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.956455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.956578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.956681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.956707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.956836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.957002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.957030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.957174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.957289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.957317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.957470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.957569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.957594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.957730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.957835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.957867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.958016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.958142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.958167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.958301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.958400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.958424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.958550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.958692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.958719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.958875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.959016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.959044] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.959195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.959328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.959355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.959457] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.959577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.959604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.959797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.959924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.959949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.960053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.960178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.960203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.960339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.960469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.960494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.960626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.960741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.960784] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.960889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.961043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.961068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.961197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.961344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.961369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.164 qpair failed and we were unable to recover it. 00:21:35.164 [2024-04-27 03:32:59.961505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.164 [2024-04-27 03:32:59.961689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.961716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.961870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.962000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.962026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.962176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.962330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.962355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.962489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.962632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.962659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.962796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.962929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.962953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.963084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.963227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.963270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.963421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.963544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.963572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.963712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.963841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.963866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.963977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.964115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.964140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.964253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.964364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.964389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.964518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.964634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.964659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.964789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.964905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.964931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.965036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.965166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.965190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.965300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.965430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.965455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.965562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.965719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.965746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.965915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.966070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.966095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.966226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.966389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.966414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.966524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.966630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.966655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.966772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.966926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.966954] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.967104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.967242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.967300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.967410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.967563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.967591] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.967780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.967908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.967933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.968038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.968168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.968192] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.968370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.968503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.968529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.968680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.968781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.968806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.968938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.969066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.969091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.969243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.969415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.969440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.969608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.969778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.969803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.969934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.970079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.970120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.970261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.970402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.970431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.970587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.970719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.970744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.970847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.970974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.970999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.971152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.971314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.971343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.971458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.971609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.971637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.971786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.971918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.971943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.972049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.972165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.972190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.972306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.972461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.972486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.972604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.972740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.972765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.972871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.972975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.973019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.973168] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.973301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.973327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.973434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.973544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.973570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.973696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.973838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.973866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.973979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.974131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.974158] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.974294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.974451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.974476] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.165 qpair failed and we were unable to recover it. 00:21:35.165 [2024-04-27 03:32:59.974599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.165 [2024-04-27 03:32:59.974716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.974743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.974897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.975001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.975026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.975155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.975307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.975333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.975435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.975563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.975590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.975759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.975905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.975930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.976066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.976197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.976239] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.976377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.976475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.976499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.976649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.976793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.976820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.976975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.977083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.977108] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.977208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.977381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.977406] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.977528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.977663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.977688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.977799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.977901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.977925] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.978069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.978190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.978218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.978356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.978514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.978539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.978682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.978800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.978825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.978975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.979082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.979109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.979265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.979415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.979440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.979577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.979707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.979731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.979859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.979987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.980012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.980169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.980281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.980309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.980440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.980580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.980604] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.980776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.980888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.980918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.981044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.981189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.981216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.981347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.981478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.981503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.981680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.981811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.981836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.981966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.982105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.982134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.982268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.982378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.982403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.982512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.982623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.982649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.982792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.982903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.982929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.983051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.983198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.983237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.983365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.983479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.983505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.983625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.983732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.983758] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.983896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.984008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.984033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.984143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.984334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.984360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.984458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.984567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.984592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.984707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.984813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.984838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.984972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.985130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.985166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.985288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.985435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.985461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.985591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.985749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.985775] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.985888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.986026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.986053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.166 qpair failed and we were unable to recover it. 00:21:35.166 [2024-04-27 03:32:59.986156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.166 [2024-04-27 03:32:59.986299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.986325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.986428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.986558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.986583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.986719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.986855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.986880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.987006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.987158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.987186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.987316] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.987429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.987456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.987602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.987738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.987764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.987881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.987979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.988005] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.988108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.988264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.988290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.988429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.988563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.988588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.988720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.988822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.988848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.988964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.989095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.989120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.989261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.989400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.989425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.989535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.989638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.989662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.989812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.989923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.989948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.990052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.990204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.990229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.990356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.990571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.990597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.990707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.990808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.990833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.990941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.991070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.991095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.991207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.991323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.991349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.991485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.991602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.991629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.991764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.991862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.991887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.991994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.992158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.992183] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.992391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.992520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.992546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.992683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.992819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.992844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.992951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.993054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.993080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.993226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.993430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.993456] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.993596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.993729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.993756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.993861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.993967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.993994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.994203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.994369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.994394] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.994505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.994715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.994741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.994879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.994991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.995018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.995142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.995281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.995307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.995444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.995605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.995630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.995733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.995861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.995886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.996028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.996189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.996217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.996353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.996460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.996490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.996625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.996754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.996780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.996882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.996982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.997007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.997219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.997345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.997371] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.997480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.997588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.997614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.997759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.997859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.997885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.998013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.998132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.998161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.998309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.998419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.998444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.167 [2024-04-27 03:32:59.998559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.998767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.167 [2024-04-27 03:32:59.998792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.167 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:32:59.998949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:32:59.999045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:32:59.999070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:32:59.999176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:32:59.999284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:32:59.999315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:32:59.999420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:32:59.999555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:32:59.999581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:32:59.999705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:32:59.999804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:32:59.999829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:32:59.999961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.000074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.000099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.000198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.000344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.000370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.000473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.000609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.000633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.000735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.000838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.000863] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.002964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.003137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.003166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.003322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.003452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.003478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.003623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.003736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.003764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.003977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.004096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.004126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.004296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.004465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.004491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.004622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.004762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.004787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.004918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.005050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.005074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.005241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.005371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.005397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.005529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.005664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.005690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.005809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.005902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.005927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.006039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.006151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.006177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.006288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.006403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.006429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.006562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.006691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.006716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.006865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.006999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.007028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.007135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.007242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.007278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.007410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.007542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.007567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.007715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.007836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.007861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.008017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.008147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.008172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.008288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.008400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.008426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.008544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.008664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.008689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.008797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.008918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.008944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.009082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.009222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.009254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.009426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.009530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.009556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.009669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.009767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.009797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.009941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.010071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.010096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.010228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.010363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.010389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.010523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.010631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.010656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.010783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.010912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.010937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.011055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.011189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.011214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.011323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.011426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.011451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.011585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.011692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.011719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.011822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.011925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.011952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.012051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.012157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.012182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.012300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.012403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.012428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.012544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.012700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.168 [2024-04-27 03:33:00.012726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.168 qpair failed and we were unable to recover it. 00:21:35.168 [2024-04-27 03:33:00.012863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.012994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.013020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.013131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.013277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.013303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.013460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.013573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.013598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.013697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.013848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.013873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.013973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.014076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.014102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.014221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.014360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.014386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.014531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.014685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.014710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.014841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.014964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.014989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.015144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.015265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.015291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.015411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.015519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.015544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.015672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.015814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.015839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.015976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.016107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.016132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.016235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.016365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.016390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.016524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.016638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.016662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.018242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.018396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.018425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.018543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.018656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.018682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.018784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.018902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.018927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.019039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.019147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.019173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.019307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.019416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.019443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.019555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.019673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.019706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.019811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.019942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.019967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.020084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.020192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.020218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.020329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.020441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.020466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.020574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.020679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.020705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.020839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.020960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.020984] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.021117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.021264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.021305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.021422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.021526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.021551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.021722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.021854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.021880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.022093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.022196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.022222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.022365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.022478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.022504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.022650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.022781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.022806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.022914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.023061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.023086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.023302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.023441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.023466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.023588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.023701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.023726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.023835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.023940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.023965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.024071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.024219] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.024253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.024399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.024530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.024563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.024670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.024783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.024808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.024906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.025015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.169 [2024-04-27 03:33:00.025041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.169 qpair failed and we were unable to recover it. 00:21:35.169 [2024-04-27 03:33:00.025173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.025277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.025315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.025455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.025560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.025586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.025723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.025827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.025854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.025957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.026087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.026113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.026225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.026338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.026363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.026471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.026578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.026603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.026710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.026921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.026946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.027074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.027176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.027202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.027322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.027428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.027455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.027575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.027734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.027760] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.027888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.027993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.028018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.028131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.028231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.028262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.028385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.028494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.028520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.028660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.028764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.028789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.028999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.029100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.029125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.029238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.029353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.029380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.029494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.029606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.029631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.029732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.029837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.029862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.029975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.030092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.030128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.030264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.030387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.030412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.030550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.030697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.030725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.030888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.030998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.031024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.031134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.031238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.031273] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.031406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.031518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.031544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.031663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.031767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.031792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.031928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.032045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.032070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.032209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.032321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.032347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.032452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.032557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.032582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.032710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.032845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.032871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.032974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.033077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.033103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.033211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.033335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.033362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.033495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.033609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.033634] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.033747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.033855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.033880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.034003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.034103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.034128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.034263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.034378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.034403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.034535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.034637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.034662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.034767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.034897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.034923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.035028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.035343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.035374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.035486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.035617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.035643] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.035746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.035901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.035926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.036058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.036160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.036190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.036348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.036460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.036485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.036611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.036718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.036743] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.170 qpair failed and we were unable to recover it. 00:21:35.170 [2024-04-27 03:33:00.036853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.036965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.170 [2024-04-27 03:33:00.036990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.037148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.037259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.037294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.037423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.037526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.037553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.037686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.037814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.037838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.037963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.038067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.038092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.038191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.038302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.038328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.038428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.038531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.038558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.038703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.038801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.038827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.038937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.039064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.039105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.039266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.039399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.039425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.039540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.039679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.039704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.039839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.039966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.039993] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.040123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.040232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.040269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.040432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.040564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.040588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.040687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.040808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.040833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.040942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.041045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.041070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.041228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.041385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.041411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.041516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.041636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.041663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.041799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.041940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.041964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.042074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.042232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.042265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.042374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.042486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.042513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.042656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.042782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.042807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.042940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.043048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.043073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.043202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.043357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.043383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.043477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.043591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.043616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.043720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.043847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.043872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.043999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.044094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.044119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.044269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.044376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.044402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.044513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.044644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.044669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.044827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.044936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.044962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.045092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.045222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.045253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.045380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.045486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.045511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.045612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.045720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.045745] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.045871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.045971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.045996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.046104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.046233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.046263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.046368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.046479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.046504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.046642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.046772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.046797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.046932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.047079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.047105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.047233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.047374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.047400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.047504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.047636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.047662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.047779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.047907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.047933] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.048042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.048171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.048198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.048305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.048445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.048470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.048575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.048707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.048733] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.171 qpair failed and we were unable to recover it. 00:21:35.171 [2024-04-27 03:33:00.048842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.171 [2024-04-27 03:33:00.048966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.048991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.049093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.049189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.049213] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.049345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.049505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.049530] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.049661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.049790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.049815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.049946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.050073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.050102] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.050208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.050323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.050349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.050466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.050607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.050632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.050749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.050843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.050868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.050983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.051107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.051134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.051284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.051393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.051419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.051524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.051638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.051663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.051792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.051892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.051918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.052024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.052175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.052200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.052333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.052464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.052490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.052599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.052703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.052728] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.052835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.052941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.052966] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.053077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.053232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.053280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.053388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.053490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.053515] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.053637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.053783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.053808] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.053931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.054062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.054088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.054245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.054359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.054384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.054514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.054613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.054639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.054741] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.054870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.054896] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.055012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.055146] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.055171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.055287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.055396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.055421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.055532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.055661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.055686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.055794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.055925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.055950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.056050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.056157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.056182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.056299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.056401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.056426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.056583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.056712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.056738] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.056838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.056964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.056989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.057090] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.057198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.057223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.057375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.057477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.057503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.057615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.057749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.057776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.057909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.058054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.058080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.058210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.058381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.058408] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.058519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.058686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.058711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.058825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.058954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.058980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.059110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.059221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.059267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.059375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.059480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.059505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.172 qpair failed and we were unable to recover it. 00:21:35.172 [2024-04-27 03:33:00.059629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.172 [2024-04-27 03:33:00.059743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.059768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.059886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.060046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.060088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.060259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.060396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.060431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.060575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.060713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.060749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.060910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.061091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.061120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.061236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.061354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.061389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.061520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.061631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.061656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.061798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.061904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.061929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.062376] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.062493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.062530] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.062672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.062806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.062831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.062948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.063054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.063080] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.063179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.063290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.063316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.063426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.063526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.063551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.063659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.063777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.063803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.063959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.064086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.064110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.064251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.064363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.064392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.064524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.064644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.064669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.064800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.064910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.064936] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.065040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.065164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.065188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.065330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.065486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.065512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.065615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.065723] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.065750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.065892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.065997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.066022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.066163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.066371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.066397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.066521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.066646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.066671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.066767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.066916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.066940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.067046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.067167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.067197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.067332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.067442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.067467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.067580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.067682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.067707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.067814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.067941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.067967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.068076] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.068192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.068217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.068327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.068428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.068453] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.068609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.068739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.068764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.068894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.068993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.069018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.069140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.069245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.069276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.069382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.069489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.069514] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.069630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.069737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.069762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.069867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.069971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.069996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.070125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.070274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.070302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.070414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.070523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.070548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.070686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.070790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.070814] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.070973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.071099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.071124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.071237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.071368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.071393] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.071528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.071630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.071655] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.071800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.071926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.071950] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.072060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.072193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.173 [2024-04-27 03:33:00.072218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.173 qpair failed and we were unable to recover it. 00:21:35.173 [2024-04-27 03:33:00.072362] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.072529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.072556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.072756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.072913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.072939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.073067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.073174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.073199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.073357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.073520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.073548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.073725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.073888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.073912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.074048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.074176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.074201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.074357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.074498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.074526] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.074655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.074839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.074867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.075016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.075145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.075169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.075280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.075387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.075412] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.075512] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.075625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.075650] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.075809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.075938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.075963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.076077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.076194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.076222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.076381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.076511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.076536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.076668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.076800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.076826] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.077048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.077201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.077229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.077374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.077516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.077543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.077676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.077873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.077899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.078055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.078268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.078294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.078437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.078548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.078573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.078740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.078849] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.078874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.078989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.079159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.079186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.079289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.079445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.079470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.079593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.079728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.079755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.079914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.080033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.080060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.080197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.080318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.080345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.080479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.080604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.080629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.080765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.080874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.080919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.081066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.081312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.081338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.081468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.081583] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.081608] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.081743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.081896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.081921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.082063] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.082200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.082225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.082367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.082466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.082491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.082629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.082758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.082783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.082889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.083018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.083045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.083173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.083329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.083355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.083462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.083671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.083697] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.083822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.083955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.083981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.084085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.084210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.084235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.084347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.084502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.084528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.084662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.084765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.084790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.084892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.085023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.085052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.085182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.085319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.085345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.085453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.085586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.085611] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.085746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.085955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.085981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.174 [2024-04-27 03:33:00.086096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.086281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.174 [2024-04-27 03:33:00.086308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.174 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.086459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.086614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.086639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.086775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.086908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.086934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.087042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.087139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.087164] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.087294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.087429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.087455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.087586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.087690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.087715] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.087843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.087973] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.088003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.088110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.088215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.088240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.088354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.088484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.088509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.088664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.088767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.088794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.088908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.089078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.089107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.089233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.089370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.089396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.089498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.089632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.089657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.089768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.089896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.089921] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.090058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.090163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.090188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.090343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.090445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.090471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.090604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.090760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.090790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.090922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.091031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.091059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.091293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.091418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.091444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.091560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.091714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.091740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.091880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.092088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.092113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.092266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.092379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.092405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.092513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.092646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.092673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.092777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.092905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.092930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.093091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.093193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.093218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.093397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.093501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.093527] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.093639] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.093769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.093799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.093935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.094065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.094091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.094204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.094366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.094392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.094521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.094644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.094672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.094809] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.094930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.094955] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.095105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.095259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.095286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.095390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.095520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.095545] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.095642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.095749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.095774] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.095931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.096059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.096085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.096239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.096349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.096374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.096504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.096614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.096639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.096779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.096892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.096919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.097051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.097269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.097295] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.097432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.097563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.097590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.097728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.097851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.097877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.097989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.098094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.098120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.098259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.098415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.098440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.175 qpair failed and we were unable to recover it. 00:21:35.175 [2024-04-27 03:33:00.098552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.098652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.175 [2024-04-27 03:33:00.098677] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.098782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.098890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.098915] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.099029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.099134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.099161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.099275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.099416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.099442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.099551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.099682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.099707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.099815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.099952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.099977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.100112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.100216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.100241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.100383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.100514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.100542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.100673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.100774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.100799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.100908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.101033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.101058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.101160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.101302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.176 [2024-04-27 03:33:00.101329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.176 qpair failed and we were unable to recover it. 00:21:35.176 [2024-04-27 03:33:00.101458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.101596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.101622] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.101837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.101936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.101962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.102054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.102203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.102228] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.102404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.102549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.102574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.102705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.102835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.102862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.103089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.103289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.103315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.103427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.103541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.103567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.103728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.103883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.103908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.104055] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.104257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.104287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.104408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.104576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.104601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.104716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.104852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.104877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.105088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.105240] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.105270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.105373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.105470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.105496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.105647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.105803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.105828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.105928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.106095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.106120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.106338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.106494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.106519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.106629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.106739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.106764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.106897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.107003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.107028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.107155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.107283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.107309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.107475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.107613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.107639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.107751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.107879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.107906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.108044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.108173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.108198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.108420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.108577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.108603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.108712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.108881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.108906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.109065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.109217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.109242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.109389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.109531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.109557] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.109692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.109798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.459 [2024-04-27 03:33:00.109823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.459 qpair failed and we were unable to recover it. 00:21:35.459 [2024-04-27 03:33:00.109952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.110106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.110132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.110237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.110371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.110397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.110528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.110660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.110687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.110845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.110970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.110995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.111142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.111283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.111309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.111416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.111547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.111572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.111708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.111839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.111867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.111980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.112103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.112133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.112306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.112437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.112463] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.112603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.112710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.112735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.112946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.113050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.113075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.113203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.113323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.113349] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.113478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.113586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.113612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.113742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.113898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.113923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.114101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.114235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.114267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.114397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.114552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.114576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.114747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.114881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.114906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.115026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.115160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.115185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.115342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.115472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.115497] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.115676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.115808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.115835] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.115977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.116083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.116110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.116243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.116413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.116439] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.116555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.116689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.116713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.116875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.117009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.117034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.117143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.117239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.117272] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.117417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.117526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.117552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.117696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.117828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.117854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.117984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.118116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.118141] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.118303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.118461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.460 [2024-04-27 03:33:00.118487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.460 qpair failed and we were unable to recover it. 00:21:35.460 [2024-04-27 03:33:00.118630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.118767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.118792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.118955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.119089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.119114] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.119269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.119411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.119436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.119586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.119721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.119747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.119858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.119986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.120013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.120176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.120317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.120344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.120455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.120644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.120669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.120775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.120933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.120960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.121096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.121225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.121257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.121405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.121514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.121538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.121676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.121806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.121830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.121966] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.122103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.122127] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.122287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.122398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.122423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.122558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.122693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.122719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.122853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.123035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.123061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.123197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.123330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.123357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.123468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.123600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.123626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.123781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.123915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.123940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.124089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.124263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.124289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.124460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.124589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.124614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.124751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.124880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.124905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.125041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.125170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.125195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.125327] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.125461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.125486] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.125595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.125722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.125747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.125901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.126032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.126057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.126164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.126276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.126302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.126439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.126568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.126593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.126720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.126824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.126850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.461 [2024-04-27 03:33:00.126982] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.127112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.461 [2024-04-27 03:33:00.127136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.461 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.127258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.127389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.127415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.127520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.127648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.127672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.127824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.127954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.127979] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.128114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.128237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.128270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.128381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.128540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.128566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.128697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.128802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.128827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.128956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.129060] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.129088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.129194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.129291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.129318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.129421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.129529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.129556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.129666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.129804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.129828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.129960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.130064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.130091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.130293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.130424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.130449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.130560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.130657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.130683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.130817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.130950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.130976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.131135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.131271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.131297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.131432] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.131561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.131586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.131690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.131805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.131829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.131962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.132094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.132119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.132256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.132413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.132442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.132575] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.132680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.132706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.132838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.132942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.132967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.133108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.133208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.133233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.133375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.133472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.133496] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.133593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.133696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.133722] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.133830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.133937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.133961] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.134095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.134226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.134258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.134428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.134536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.134561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.134706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.134812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.134838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.462 [2024-04-27 03:33:00.134941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.135052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.462 [2024-04-27 03:33:00.135081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.462 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.135236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.135433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.135459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.135597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.135754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.135779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.135916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.136050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.136074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.136182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.136290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.136317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.136479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.136612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.136638] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.136793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.136921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.136946] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.137104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.137233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.137265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.137403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.137555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.137580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.137742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.137891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.137916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.138043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.138185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.138219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.138386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.138514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.138539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.138679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.138783] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.138809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.138910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.139067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.139092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.139232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.139405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.139431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.139564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.139668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.139693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.139821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.139974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.139998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.140153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.140292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.140319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.140427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.140555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.140580] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.140684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.140838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.140863] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.140976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.141103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.141133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.141267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.141396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.141422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.141558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.141665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.141691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.141836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.141988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.142014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.463 qpair failed and we were unable to recover it. 00:21:35.463 [2024-04-27 03:33:00.142111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.142243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.463 [2024-04-27 03:33:00.142277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.142408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.142563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.142587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.142759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.142891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.142916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.143080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.143188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.143215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.143330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.143459] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.143485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.143622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.143731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.143756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.143859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.143960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.143986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.144096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.144196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.144222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.144390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.144499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.144524] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.144624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.144737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.144763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.144895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.145028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.145053] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.145226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.145377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.145403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.145560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.145663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.145687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.145817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.145972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.145996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.146133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.146275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.146301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.146416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.146541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.146567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.146700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.146903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.146929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.147071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.147200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.147225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.147368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.147477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.147503] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.147657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.147786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.147813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.147952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.148107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.148132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.148288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.148419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.148446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.148582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.148708] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.148734] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.148876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.149023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.149049] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.149204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.149349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.149375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.149514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.149645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.149671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.149803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.149907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.149932] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.150042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.150177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.150204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.150361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.150493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.150519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.464 qpair failed and we were unable to recover it. 00:21:35.464 [2024-04-27 03:33:00.150674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.150872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.464 [2024-04-27 03:33:00.150900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.151066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.151204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.151233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfe4000b90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.151460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.151600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.151627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.151784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.151954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.151982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.152128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.152279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.152306] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.152437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.152572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.152596] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.152695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.152792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.152817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.152925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.153032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.153058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.153198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.153315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.153341] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.153499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.153629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.153654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.153782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.153893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.153917] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.154054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.154182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.154206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.154330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.154468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.154493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.154625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.154754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.154779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.154922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.155054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.155085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.155199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.155346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.155372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.155467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.155602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.155627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.155787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.155884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.155909] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.156021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.156155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.156181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.156311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.156413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.156440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.156596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.156720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.156744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.156881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.157006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.157031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.157132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.157237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.157269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.157368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.157470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.157495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.157605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.157711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.157737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.157863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.157996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.158021] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.158148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.158282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.158310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.158439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.158568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.158592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.158696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.158859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.158884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.465 [2024-04-27 03:33:00.159042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.159169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.465 [2024-04-27 03:33:00.159193] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.465 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.159302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.159437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.159462] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.159615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.159774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.159799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.159903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.160004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.160029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.160155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.160290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.160316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.160448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.160549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.160574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.160698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.160827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.160852] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.160968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.161099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.161124] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.161239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.161375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.161400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.161533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.161658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.161688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.161799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.161926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.161951] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.162083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.162265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.162291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.162450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.162558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.162583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.162717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.162821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.162847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.162990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.163107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.163135] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.163286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.163416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.163441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.163581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.163735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.163760] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.163915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.164045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.164070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.164203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.164309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.164335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.164443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.164573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.164598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.164724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.164882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.164907] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.165041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.165196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.165226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.165413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.165522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.165547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.165706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.165815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.165840] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.165967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.166135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.166160] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.166307] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.166415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.166440] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.166569] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.166703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.166727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.166851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.166960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.166987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.167160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.167257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.167283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.466 [2024-04-27 03:33:00.167418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.167525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.466 [2024-04-27 03:33:00.167550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.466 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.167686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.167791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.167816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.167923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.168027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.168052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.168197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.168328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.168353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.168464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.168563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.168587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.168695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.168803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.168828] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.168926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.169054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.169079] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.169213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.169321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.169347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.169482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.169606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.169630] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.169763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.169897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.169922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.170020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.170115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.170140] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.170279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.170389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.170415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.170520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.170632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.170656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.170788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.170913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.170938] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.171101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.171224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.171257] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.171390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.171543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.171568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.171706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.171835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.171859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.171993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.172096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.172122] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.172256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.172394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.172419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.172527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.172660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.172685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.172816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.172935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.172960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.173084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.173220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.173252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.173384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.173487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.173513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.173650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.173755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.173781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.173912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.174071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.174095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.174199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.174332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.174358] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.174462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.174630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.174656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.174759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.174859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.174899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.175068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.175242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.175286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.175465] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.175573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.467 [2024-04-27 03:33:00.175598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.467 qpair failed and we were unable to recover it. 00:21:35.467 [2024-04-27 03:33:00.175753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.175884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.175908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.176014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.176115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.176144] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.176282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.176411] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.176436] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.176570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.176669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.176694] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.176850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.176981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.177006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.177134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.177241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.177270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.177367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.177494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.177519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.177683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.177814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.177838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.177938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.178059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.178084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.178211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.178364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.178390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.178537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.178687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.178714] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.178861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.178993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.179020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.179222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.179351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.179379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.179551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.179717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.179744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.179887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.180023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.180048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.180162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.180320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.180346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.180493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.180676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.180701] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.180858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.180984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.181026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.181197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.181363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.181388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.181502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.181661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.181688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.181836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.181963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.181987] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.182112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.182244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.182276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.182443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.182610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.182637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.182779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.182877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.182902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.183028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.183135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.468 [2024-04-27 03:33:00.183163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.468 qpair failed and we were unable to recover it. 00:21:35.468 [2024-04-27 03:33:00.183326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.183430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.183455] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.183586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.183714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.183739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.183914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.184022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.184047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.184183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.184344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.184370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.184540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.184656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.184683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.184820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.185000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.185027] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.185204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.185361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.185390] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.185554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.185683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.185708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.185842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.185996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.186023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.186172] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.186305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.186331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.186469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.186631] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.186656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.186843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.186963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.186991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.187131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.187290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.187318] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.187475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.187610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.187635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.187750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.187895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.187923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.188044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.188178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.188206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.188368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.188474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.188499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.188644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.188766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.188795] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.188914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.189022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.189050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.189220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.189363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.189389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.189494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.189627] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.189654] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.189846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.189984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.190012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.190214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.190378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.190404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.190546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.190689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.190716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.190895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.191024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.191048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.191200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.191342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.191368] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.191508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.191634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.191663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.191808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.191951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.191983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.469 [2024-04-27 03:33:00.192192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.192348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.469 [2024-04-27 03:33:00.192373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.469 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.192503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.192632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.192660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.192803] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.192955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.192982] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.193145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.193322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.193347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.193477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.193644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.193671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.193820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.193963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.193991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.194195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.194353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.194379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.194555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.194725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.194753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.194898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.195017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.195045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.195217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.195333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.195362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.195470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.195628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.195672] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1531233 Killed "${NVMF_APP[@]}" "$@" 00:21:35.470 [2024-04-27 03:33:00.195825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.196001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.196029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 03:33:00 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:21:35.470 [2024-04-27 03:33:00.196183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 03:33:00 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:21:35.470 [2024-04-27 03:33:00.196290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.196316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 03:33:00 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:35.470 [2024-04-27 03:33:00.196442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 03:33:00 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:35.470 [2024-04-27 03:33:00.196551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.196576] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:35.470 [2024-04-27 03:33:00.196693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.196839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.196867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.197029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.197182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.197223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.197350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.197481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.197506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.197673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.197829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.197854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.197965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.198062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.198091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.198203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.198339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.198364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.198556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.198686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.198711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.198837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.198944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.198968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.199105] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.199258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.199286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.199397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.199545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.199588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 [2024-04-27 03:33:00.199716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.199856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.199881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 03:33:00 -- nvmf/common.sh@470 -- # nvmfpid=1531815 00:21:35.470 [2024-04-27 03:33:00.200015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 03:33:00 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:21:35.470 03:33:00 -- nvmf/common.sh@471 -- # waitforlisten 1531815 00:21:35.470 [2024-04-27 03:33:00.200161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.200186] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 03:33:00 -- common/autotest_common.sh@817 -- # '[' -z 1531815 ']' 00:21:35.470 [2024-04-27 03:33:00.200323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 03:33:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:35.470 [2024-04-27 03:33:00.200458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 [2024-04-27 03:33:00.200483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.470 qpair failed and we were unable to recover it. 00:21:35.470 03:33:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:35.470 [2024-04-27 03:33:00.200625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.470 03:33:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:35.470 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:35.471 [2024-04-27 03:33:00.200770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 03:33:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:35.471 [2024-04-27 03:33:00.200798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:35.471 [2024-04-27 03:33:00.200986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.201095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.201121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.201279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.201440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.201465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.201603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.201743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.201771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.201889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.202013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.202038] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.202145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.202276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.202305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.202427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.202592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.202620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.202778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.202900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.202929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.203103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.203232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.203281] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.203418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.203548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.203573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.203743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.203896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.203923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.204070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.204194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.204221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.204396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.204516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.204552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.204714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.204861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.204889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.205023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.205156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.205181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.205351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.205505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.205535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.205673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.205852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.205878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.206011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.206145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.206170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.206299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.206423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.206451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.206574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.206748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.206773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.206938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.207042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.207067] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.207197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.207381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.207411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.207535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.207665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.207693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.207818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.207927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.207952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.208097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.208244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.208290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.208438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.208559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.208587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.208730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.208861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.208886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.471 [2024-04-27 03:33:00.209061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.209173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.471 [2024-04-27 03:33:00.209201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.471 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.209342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.209461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.209504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.209622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.209744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.209769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.209893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.210036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.210064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.210186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.210322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.210350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.210482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.210589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.210614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.210720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.210826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.210851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.210989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.211157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.211185] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.211323] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.211463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.211489] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.211653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.211773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.211801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.211919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.212029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.212071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.212198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.212310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.212336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.212470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.212593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.212621] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.212768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.212890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.212924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.213053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.213155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.213180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.213303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.213405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.213430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.213535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.213665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.213690] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.213800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.213905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.213930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.214061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.214182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.214211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.214342] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.214445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.214470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.214600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.214726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.214754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.214899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.215009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.215034] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.215142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.215257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.215282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.215393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.215494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.215540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.215688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.215806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.215831] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.215950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.216089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.216117] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.472 qpair failed and we were unable to recover it. 00:21:35.472 [2024-04-27 03:33:00.216271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.472 [2024-04-27 03:33:00.216396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.216422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.216532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.216666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.216691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.216888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.217023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.217048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.217175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.217299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.217325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.217430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.217538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.217563] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.217667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.217811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.217838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.217955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.218064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.218091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.218242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.218348] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.218373] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.218508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.218621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.218662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.218777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.218885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.218911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.219031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.219145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.219169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.219318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.219434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.219461] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.219614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.219728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.219755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.219903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.220035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.220060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.220211] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.220382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.220409] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.220540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.220718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.220745] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.220868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.220995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.221019] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.221136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.221243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.221292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.221401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.221509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.221534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.221646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.221769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.221794] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.221910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.222016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.222042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.222189] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.222311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.222337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.222441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.222545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.222570] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.222690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.222795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.222823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.222948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.223053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.223078] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.223207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.223329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.223355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.223488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.223637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.223663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.223801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.223942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.223968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.224118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.224260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.224302] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.473 qpair failed and we were unable to recover it. 00:21:35.473 [2024-04-27 03:33:00.224409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.224542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.473 [2024-04-27 03:33:00.224566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.224679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.224805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.224830] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.224930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.225033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.225058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.225231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.225378] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.225404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.225506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.225644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.225670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.225785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.225907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.225932] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.226035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.226166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.226190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.226306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.226401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.226426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.226558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.226698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.226723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.226825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.226928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.226953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.227052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.227164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.227189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.227308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.227440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.227466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.227601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.227710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.227735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.227859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.227972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.227997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.228103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.228212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.228237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.228388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.228493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.228519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.228650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.228754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.228779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.228908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.229020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.229045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.229150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.229256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.229282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.229416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.229519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.229550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.229670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.229792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.229817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.229921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.230021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.230045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.230158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.230298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.230324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.230426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.230567] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.230592] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.230696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.230799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.230824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.230926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.231030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.231054] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.231186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.231302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.231327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.231427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.231531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.231556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.231657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.231786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.231811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.474 [2024-04-27 03:33:00.231913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.232021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.474 [2024-04-27 03:33:00.232046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.474 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.232187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.232305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.232330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.232438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.232542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.232568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.232672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.232775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.232801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.232909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.233015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.233040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.233167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.233284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.233309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.233410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.233519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.233544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.233671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.233775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.233799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.233927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.234030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.234054] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.234159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.234259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.234285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.234392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.234523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.234547] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.234659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.234790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.234815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.234943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.235069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.235094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.235256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.235363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.235389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.235497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.235601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.235627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.235738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.235862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.235887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.236000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.236112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.236138] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.236242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.236358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.236384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.236487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.236614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.236640] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.236746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.236852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.236876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.236985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.237084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.237109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.237253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.237358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.237383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.237498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.237599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.237624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.237732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.237839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.237864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.237995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.238100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.238125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.238235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.238351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.238376] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.238518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.238620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.238644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.238775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.238877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.238902] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.239001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.239151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.239176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.239337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.239456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.475 [2024-04-27 03:33:00.239481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.475 qpair failed and we were unable to recover it. 00:21:35.475 [2024-04-27 03:33:00.239592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.239747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.239772] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.239896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.240000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.240025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.240128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.240261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.240286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.240402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.240503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.240528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.240638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.240738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.240762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.240870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.240975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.241000] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.241101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.241229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.241260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.241361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.241458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.241483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.241608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.241742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.241766] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.241869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.241978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.241978] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:21:35.476 [2024-04-27 03:33:00.242004] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.242051] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:35.476 [2024-04-27 03:33:00.242128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.242261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.242290] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.242400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.242520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.242553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.242659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.242763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.242787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.242890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.242994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.243021] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.243133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.243241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.243300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.243404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.243515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.243540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.243646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.243746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.243771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.243890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.243990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.244016] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.244127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.244253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.244278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.244385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.244509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.244534] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.244643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.244775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.244802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.244949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.245081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.245105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.245208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.245315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.245340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.245450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.245560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.245586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.245693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.245817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.245842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.245975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.246087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.246112] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.246223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.246343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.246369] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.246475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.246589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.246614] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.476 qpair failed and we were unable to recover it. 00:21:35.476 [2024-04-27 03:33:00.246718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.476 [2024-04-27 03:33:00.246846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.246871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.246997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.247126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.247151] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.247258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.247365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.247391] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.247503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.247616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.247641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.247767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.247927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.247952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.248056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.248153] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.248178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.248318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.248424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.248449] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.248570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.248673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.248699] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.248808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.248939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.248964] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.249082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.249220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.249251] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.249361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.249467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.249493] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.249603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.249715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.249740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.249859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.249958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.249983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.250094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.250198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.250223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.250331] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.250458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.250483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.250597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.250705] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.250731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.250846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.250952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.250977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.251093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.251203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.251228] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.251387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.251500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.251525] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.251635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.251761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.251786] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.251940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.252046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.252071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.252215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.252321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.252347] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.252453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.252596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.252620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.252747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.252859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.252892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.252992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.253097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.253121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.477 [2024-04-27 03:33:00.253242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.253364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.477 [2024-04-27 03:33:00.253388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.477 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.253501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.253629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.253653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.253756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.253861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.253897] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.253995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.254127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.254152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.254283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.254395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.254420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.254526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.254633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.254658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.254800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.254917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.254942] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.255046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.255142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.255167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.255282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.255416] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.255445] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.255551] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.255684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.255709] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.255845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.255949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.255974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.256074] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.256177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.256203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.256309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.256426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.256451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.256589] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.256691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.256716] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.256832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.256932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.256956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.257072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.257176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.257201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.257310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.257418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.257443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.257546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.257701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.257726] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.257839] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.257942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.257969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.258113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.258223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.258265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.258370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.258483] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.258508] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.258654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.258782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.258807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.258935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.259037] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.259062] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.259162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.259285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.259312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.259419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.259521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.259546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.259654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.259785] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.259810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.259919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.260020] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.260045] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.260145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.260244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.260274] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.260386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.260508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.260533] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.478 [2024-04-27 03:33:00.260647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.260744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.478 [2024-04-27 03:33:00.260769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.478 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.260877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.260979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.261003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.261118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.261218] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.261258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.261368] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.261477] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.261502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.261641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.261773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.261798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.261901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.262056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.262081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.262193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.262332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.262358] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.262460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.262581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.262607] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.262759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.262895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.262920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.263025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.263155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.263181] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.263322] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.263426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.263451] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.263561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.263662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.263687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.263822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.263964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.263989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.264092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.264204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.264229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.264345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.264460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.264485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.264596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.264702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.264727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.264865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.264970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.264995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.265100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.265200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.265225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.265351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.265503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.265529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.265640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.265743] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.265768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.265869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.265971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.265996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.266104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.266212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.266237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.266353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.266485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.266512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.266649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.266747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.266772] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.266882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.266986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.267013] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.267121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.267287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.267313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.267419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.267527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.267553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.267665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.267765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.267791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.267928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.268056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.268081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.268187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.268308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.479 [2024-04-27 03:33:00.268334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.479 qpair failed and we were unable to recover it. 00:21:35.479 [2024-04-27 03:33:00.268442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.268547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.268581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.268718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.268822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.268847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.268950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.269064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.269089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.269197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.269311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.269337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.269443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.269584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.269610] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.269715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.269869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.269894] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.270024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.270128] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.270153] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.270262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.270364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.270389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.270503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.270636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.270661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.270767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.270898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.270923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.271035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.271137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.271162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.271290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.271392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.271417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.271545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.271651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.271676] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.271812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.271965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.271990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.272104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.272209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.272235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.272361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.272463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.272488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.272600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.272718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.272744] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.272848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.272957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.272983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.273097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.273210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.273235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.273357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.273461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.273485] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.273619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.273724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.273749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.273853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.273954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.273981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.274085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.274213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.274238] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.274373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.274479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.274505] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.274611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.274765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.274790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.274896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.275010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.275036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.275157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.275260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.275285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.275397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.275491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.275515] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.275629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.275765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.480 [2024-04-27 03:33:00.275791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.480 qpair failed and we were unable to recover it. 00:21:35.480 [2024-04-27 03:33:00.275904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.276005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.276029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.276159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.276258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.276283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.276398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.276504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.276529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.276635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.276769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.276793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 EAL: No free 2048 kB hugepages reported on node 1 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.276901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.277003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.277028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.277163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.277271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.277297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.277428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.277535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.277561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.277684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.277782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.277807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.277940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.278043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.278068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.278173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.278291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.278317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.278427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.278532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.278564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.278671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.278773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.278798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.278977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.279127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.279156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.279264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.279384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.279411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.279526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.279668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.279695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.279835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.279971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.279997] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.280110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.280255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.280282] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.280395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.280503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.280528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.280650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.280777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.280802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.280915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.281025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.281052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.281160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.281285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.281310] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.281444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.281548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.281573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.281698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.281838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.281862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.281993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.282097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.282121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.282239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.282351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.282376] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.481 qpair failed and we were unable to recover it. 00:21:35.481 [2024-04-27 03:33:00.282517] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.481 [2024-04-27 03:33:00.282623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.282648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.282779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.282910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.282935] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.283071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.283183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.283208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.283324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.283423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.283448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.283565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.283706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.283731] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.283833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.283967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.283992] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.284103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.284214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.284240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.284383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.284501] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.284528] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.284671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.284775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.284801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.284900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.285007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.285033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.285150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.285262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.285289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.285403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.285510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.285536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.285646] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.285781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.285807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.285941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.286066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.286092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.286196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.286310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.286336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.286439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.286560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.286586] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.286719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.286829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.286855] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.286969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.287085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.287111] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.287216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.287326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.287352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.287466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.287604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.287629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.287742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.287847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.287872] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.287980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.288086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.288110] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.288209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.288334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.288360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.288466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.288568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.288593] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.288697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.288817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.288842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.288951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.289066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.289091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.289216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.289333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.289357] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.289508] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.289630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.289659] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.289761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.289859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.289883] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.482 qpair failed and we were unable to recover it. 00:21:35.482 [2024-04-27 03:33:00.290045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.482 [2024-04-27 03:33:00.290151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.290177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.290289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.290402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.290428] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.290530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.290634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.290660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.290767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.290897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.290922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.291025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.291154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.291178] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.291311] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.291446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.291470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.291573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.291712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.291736] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.291862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.292006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.292031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.292136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.292306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.292335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.292466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.292578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.292603] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.292737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.292846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.292871] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.293000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.293106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.293130] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.293265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.293422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.293447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.293542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.293660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.293685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.293801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.293906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.293931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.294041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.294170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.294201] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.294308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.294423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.294448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.294547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.294644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.294669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.294776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.294890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.294924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.295030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.295159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.295184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.295288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.295400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.295425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.295550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.295666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.295691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.295802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.295913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.295937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.296036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.296141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.296167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.296297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.296448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.296472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.296629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.296736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.296761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.296907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.297008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.297033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.297162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.297267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.297292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.297395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.297498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.483 [2024-04-27 03:33:00.297529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.483 qpair failed and we were unable to recover it. 00:21:35.483 [2024-04-27 03:33:00.297633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.297748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.297773] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.297882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.297984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.298009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.298144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.298242] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.298286] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.298388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.298495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.298520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.298626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.298736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.298762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.298868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.298974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.298998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.299130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.299263] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.299289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.299396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.299527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.299551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.299669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.299767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.299792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.299915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.300045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.300069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.300180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.300321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.300348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.300458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.300558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.300585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.300727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.300833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.300859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.300991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.301097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.301123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.301253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.301365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.301392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.301505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.301635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.301661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.301768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.301898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.301923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.302027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.302158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.302184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.302315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.302456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.302481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.302585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.302702] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.302727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.302836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.302949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.302976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.303110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.303305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.303331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.303429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.303541] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.303566] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.303706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.303834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.303858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.303989] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.304092] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.304118] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.304236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.304355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.304381] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.304488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.304596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.304620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.304728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.304836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.304861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.484 [2024-04-27 03:33:00.304968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.305062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.484 [2024-04-27 03:33:00.305088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.484 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.305214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.305318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.305346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.305458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.305598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.305623] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.305729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.305838] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.305864] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.306008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.306104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.306129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.306229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.306359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.306384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.306520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.306651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.306675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.306787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.306888] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.306912] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.307047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.307175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.307200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.307314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.307447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.307472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.307574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.307703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.307727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.307830] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.307946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.307971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.308081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.308207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.308232] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.308371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.308495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.308520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.308624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.308727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.308751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.308851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.308992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.309017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.309124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.309293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.309319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.309425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.309527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.309551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.309675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.309778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.309802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.309907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.310007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.310033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.310143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.310241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.310270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.310379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.310514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.310539] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.310648] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.310775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.310799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.310926] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.311027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.311051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.311158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.311272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.311301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.311417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.311487] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:35.485 [2024-04-27 03:33:00.311543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.311567] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.311670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.311772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.311796] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.311942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.312108] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.312132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.312236] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.312349] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.312374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.485 qpair failed and we were unable to recover it. 00:21:35.485 [2024-04-27 03:33:00.312489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.312591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.485 [2024-04-27 03:33:00.312616] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.312716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.312823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.312849] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.312949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.313053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.313077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.313183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.313300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.313326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.313437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.313571] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.313597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.313731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.313842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.313867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.314001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.314132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.314156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.314283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.314395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.314420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.314532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.314636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.314660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.314769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.314899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.314923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.315028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.315138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.315163] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.315280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.315405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.315429] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.315535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.315679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.315703] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.315818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.315924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.315948] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.316089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.316198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.316222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.316330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.316452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.316477] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.316618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.316725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.316749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.316848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.316947] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.316971] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.317068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.317173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.317199] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.317306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.317412] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.317437] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.317538] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.317655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.317680] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.317816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.317937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.317963] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.318089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.318262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.318288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.318397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.318504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.318529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.318638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.318744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.318769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.486 [2024-04-27 03:33:00.318870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.319000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.486 [2024-04-27 03:33:00.319026] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.486 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.319138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.319269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.319298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.319428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.319535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.319560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.319686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.319804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.319829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.319933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.320066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.320092] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.320195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.320312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.320337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.320598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.320725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.320749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.320885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.320992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.321017] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.321127] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.321239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.321270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.321388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.321545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.321569] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.321703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.321878] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.321904] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.322008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.322171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.322197] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.322318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.322422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.322447] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.322585] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.322728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.322753] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.322866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.322983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.323007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.323109] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.323262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.323289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.323403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.323513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.323538] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.323660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.323792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.323817] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.323932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.324050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.324075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.324179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.324286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.324311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.324428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.324543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.324568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.324677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.324782] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.324807] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.324908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.325027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.325052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.325159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.325264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.325289] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.325396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.325526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.325550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.325655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.325787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.325811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.325917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.326025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.326050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.326157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.326266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.326292] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.326419] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.326529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.326554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.487 [2024-04-27 03:33:00.326678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.326774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.487 [2024-04-27 03:33:00.326798] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.487 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.326910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.327039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.327064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.327193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.327338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.327363] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.327469] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.327576] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.327601] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.327709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.327837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.327863] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.327972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.328084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.328109] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.328222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.328330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.328355] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.328491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.328620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.328644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.328771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.328900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.328924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.329058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.329164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.329189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.329297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.329401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.329426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.329530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.329670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.329695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.329794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.329897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.329922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.330029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.330132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.330159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.330272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.330380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.330404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.330511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.330617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.330642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.330749] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.330860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.330884] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.331016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.331141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.331165] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.331272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.331406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.331431] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.331560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.331682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.331707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.331834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.331953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.331978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.332084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.332185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.332210] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.332360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.332494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.332518] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.332661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.332763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.332787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.332894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.333018] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.333043] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.333173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.333305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.333331] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.333463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.333577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.333602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.333735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.333843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.333867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.334011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.334126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.334150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.488 [2024-04-27 03:33:00.334277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.334398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.488 [2024-04-27 03:33:00.334424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.488 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.334562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.334696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.334720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.334827] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.334955] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.334980] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.335117] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.335220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.335253] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.335391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.335490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.335516] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.335650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.335758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.335783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.335890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.336022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.336047] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.336180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.336298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.336325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.336458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.336570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.336594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.336726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.336851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.336875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.336977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.337091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.337115] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.337220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.337339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.337364] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.337464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.337565] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.337590] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.337699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.337833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.337860] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.337995] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.338101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.338125] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.338257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.338372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.338397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.338522] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.338668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.338692] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.338799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.338915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.338939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.339075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.339205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.339229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.339386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.339499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.339523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.339628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.339764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.339790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.339897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.339998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.340022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.340159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.340283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.340309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.340420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.340534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.340560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.340703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.340811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.340836] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.340967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.341064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.341091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.341234] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.341379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.341403] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.341507] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.341617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.341642] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.341769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.341881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.341906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.489 qpair failed and we were unable to recover it. 00:21:35.489 [2024-04-27 03:33:00.342014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.342170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.489 [2024-04-27 03:33:00.342194] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.342302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.342438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.342466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.342578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.342726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.342751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.342881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.343039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.343064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.343169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.343289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.343314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.343424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.343580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.343605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.343740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.343845] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.343870] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.343990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.344125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.344150] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.344260] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.344391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.344417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.344550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.344655] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.344679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.344812] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.344920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.344944] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.345082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.345217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.345259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.345369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.345470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.345494] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.345609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.345714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.345740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.345855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.345983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.346007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.346123] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.346266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.346304] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.346415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.346548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.346573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.346716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.346820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.346844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.346974] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.347077] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.347103] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.347216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.347350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.347375] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.347482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.347642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.347667] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.347821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.347977] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.348006] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.348132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.348235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.348266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.348370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.348476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.348502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.348640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.348757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.348783] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.490 [2024-04-27 03:33:00.348919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.349031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.490 [2024-04-27 03:33:00.349056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.490 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.349160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.349292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.349319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.349460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.349591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.349615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.349802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.349954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.349978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.350114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.350237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.350269] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.350380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.350524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.350549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.350699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.350832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.350856] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.350996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.351099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.351123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.351346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.351479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.351504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.351637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.351768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.351793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.351896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.352004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.352028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.352245] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.352353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.352379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.352489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.352603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.352627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.352731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.352837] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.352861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.352967] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.353102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.353128] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.353271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.353374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.353399] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.353504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.353610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.353636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.353769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.353905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.353929] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.354062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.354164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.354190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.354321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.354441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.354466] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.354630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.354738] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.354763] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.354879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.355011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.355036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.355143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.355272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.355299] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.355407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.355517] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.355543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.355674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.355793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.355819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.355929] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.356061] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.356087] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.356193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.356296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.356322] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.356464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.356601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.356626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.356759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.356917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.356941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.491 qpair failed and we were unable to recover it. 00:21:35.491 [2024-04-27 03:33:00.357081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.357209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.491 [2024-04-27 03:33:00.357234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.357379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.357490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.357515] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.357623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.357732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.357758] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.357876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.358009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.358035] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.358166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.358266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.358293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.358395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.358504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.358529] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.358630] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.358762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.358788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.358916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.359045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.359071] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.359212] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.359319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.359344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.359446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.359556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.359581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.359732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.359861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.359887] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.360042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.360152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.360177] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.360305] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.360446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.360472] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.360581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.360714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.360739] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.360844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.360976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.361001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.361130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.361258] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.361285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.361393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.361523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.361549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.361678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.361813] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.361839] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.361952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.362084] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.362111] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.362216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.362360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.362386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.362495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.362602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.362627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.362731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.362848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.362873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.363005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.363142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.363168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.363286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.363417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.363443] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.363550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.363681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.363706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.363807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.363935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.363960] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.364100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.364228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.364260] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.364395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.364523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.364548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.364661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.364788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.364812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.492 qpair failed and we were unable to recover it. 00:21:35.492 [2024-04-27 03:33:00.364921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.492 [2024-04-27 03:33:00.365056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.365081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.365257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.365387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.365411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.365530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.365660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.365685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.365790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.365894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.365919] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.366030] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.366145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.366169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.366299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.366433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.366458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.366561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.366665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.366691] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.366801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.366941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.366965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.367069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.367175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.367200] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.367318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.367446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.367471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.367593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.367725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.367750] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.367854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.367959] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.367985] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.368118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.368253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.368279] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.368389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.368533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.368559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.368677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.368781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.368806] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.368913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.369022] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.369046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.369182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.369289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.369315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.369487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.369620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.369644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.369772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.369880] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.369906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.370017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.370124] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.370149] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.370275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.370401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.370427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.370537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.370669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.370695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.370814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.370930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.370955] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.371120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.371224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.371262] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.371386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.371495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.371520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.371654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.371797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.371822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.371954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.372064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.372089] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.372200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.372313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.372339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.372451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.372570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.372594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.372721] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.372855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.372880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.493 qpair failed and we were unable to recover it. 00:21:35.493 [2024-04-27 03:33:00.372993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.493 [2024-04-27 03:33:00.373091] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.373116] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.373223] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.373359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.373384] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.373496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.373608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.373635] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.373746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.373875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.373900] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.374026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.374132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.374156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.374290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.374400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.374426] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.374530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.374663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.374689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.374825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.374933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.374958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.375089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.375224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.375254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.375375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.375488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.375513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.375654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.375769] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.375793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.375895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.376024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.376048] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.376156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.376262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.376288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.376391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.376527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.376553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.376691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.376821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.376846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.376952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.377064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.377090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.377228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.377363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.377389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.377536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.377676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.377700] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.377815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.377972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.377996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.378116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.378235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.378267] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.378398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.378539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.378564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.378673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.378777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.378803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.378938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.379070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.379095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.379289] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.379395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.379420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.379532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.379686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.379711] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.379815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.379948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.379972] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.380132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.380237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.380270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.380384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.380487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.380511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.380716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.380843] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.380869] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.380976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.381112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.381137] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.381267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.381374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.381400] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.494 qpair failed and we were unable to recover it. 00:21:35.494 [2024-04-27 03:33:00.381506] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.381637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.494 [2024-04-27 03:33:00.381663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.381766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.381901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.381926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.382026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.382167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.382191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.382308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.382433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.382458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.382603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.382737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.382762] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.382874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.382996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.383021] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.383154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.383298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.383346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.383461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.383590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.383615] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.383773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.383879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.383908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.384013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.384145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.384169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.384290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.384398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.384423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.384531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.384647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.384671] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.384791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.384919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.384943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.385050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.385166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.385190] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.385302] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.385408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.385432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.385535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.385644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.385669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.385801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.385933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.385957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.386087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.386200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.386226] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.386372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.386491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.386520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.386624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.386733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.386758] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.386875] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.387013] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.387037] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.387237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.387377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.387402] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.387513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.387615] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.387639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.387760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.387913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.387937] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.388075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.388215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.388240] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.388365] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.388495] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.388520] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.388653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.388755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.388780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.388896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.389004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.389030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.495 qpair failed and we were unable to recover it. 00:21:35.495 [2024-04-27 03:33:00.389133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.495 [2024-04-27 03:33:00.389262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.389301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.389407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.389511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.389537] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.389645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.389802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.389827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.389923] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.390027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.390052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.390175] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.390275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.390300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.390425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.390556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.390581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.390740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.390873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.390898] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.391005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.391149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.391174] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.391326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.391470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.391495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.391601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.391729] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.391754] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.391867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.391994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.392022] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.392125] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.392228] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.392258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.392374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.392486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.392510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.392642] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.392745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.392770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.392874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.392975] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.392999] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.393101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.393299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.393326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.393482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.393632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.393656] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.393758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.393854] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.393878] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.394017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.394159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.394184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.394294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.394397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.394421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.394552] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.394661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.394686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.394824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.394927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.394953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.395118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.395229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.395258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.395367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.395474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.395498] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.395629] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.395736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.395760] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.395874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.395994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.396018] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.396113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.396210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.396234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.396355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.396464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.396488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.396605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.396731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.396755] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.396887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.397000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.397025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.397160] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.397262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.397288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.496 [2024-04-27 03:33:00.397401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.397556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.496 [2024-04-27 03:33:00.397581] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.496 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.397698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.397810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.397834] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.397942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.398049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.398073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.398167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.398280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.398305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.398435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.398561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.398585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.398719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.398829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.398854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.398954] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.399059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.399083] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.399191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.399300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.399325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.399430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.399559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.399583] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.399687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.399792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.399816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.399935] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.400038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.400064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.400169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.400285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.400311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.400421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.400519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.400544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.400698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.400833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.400858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.400962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.401166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.401191] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.401317] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.401434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.401459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.401591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.401714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.401740] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.401871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.401999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.402023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.402152] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.402284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.402309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.402427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.402533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.402558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.402674] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.402822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.402847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.402962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.403095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.403119] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.403225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.403354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.403379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.403502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.403613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.403637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.403754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.403855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.403879] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.404009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.404148] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.404173] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.404287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.404396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.404420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.404528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.404640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.404664] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.404790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.404894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.404920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.405052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.405151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.405176] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.405286] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.405398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.405422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.405530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.405633] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.497 [2024-04-27 03:33:00.405658] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.497 qpair failed and we were unable to recover it. 00:21:35.497 [2024-04-27 03:33:00.405762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.405894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.405920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.406024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.406132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.406157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.406269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.406381] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.406405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.406513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.406643] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.406668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.406776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.406879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.406905] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.407023] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.407182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.407207] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.407338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.407473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.407499] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.407625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.407765] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.407790] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.407898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.408050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.408075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.408176] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.408295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.408321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.408433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.408532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.408556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.408687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.408796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.408822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.408978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.409086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.409113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.409208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.409325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.409352] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.409461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.409587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.409612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.409719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.409816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.409842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.409961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.410066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.410091] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.410193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.410300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.410326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.410440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.410542] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.410568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.410678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.410777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.410803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.410914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.411017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.411042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.411143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.411269] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.411294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.411430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.411543] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.411568] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.411661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.411757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.411781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.411933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.412036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.412061] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.412164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.412299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.412324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.412425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.412524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.412550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.412650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.412751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.498 [2024-04-27 03:33:00.412777] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.498 qpair failed and we were unable to recover it. 00:21:35.498 [2024-04-27 03:33:00.412885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.413015] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.413042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.413171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.413272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.413308] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.413421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.413516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.413542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.413649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.413790] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.413815] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.413948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.414075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.414100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.414232] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.414363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.414389] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.414491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.414595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.414620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.414757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.414852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.414877] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.415003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.415101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.415126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.415227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.415369] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.415396] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.415525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.415677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.415702] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.415806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.415961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.415986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.416089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.416192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.416219] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.416343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.416476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.416502] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.416609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.416724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.416749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.416889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.416997] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.417023] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.417135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.417244] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.417277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.417380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.417481] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.417506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.417641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.417736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.417761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.773 qpair failed and we were unable to recover it. 00:21:35.773 [2024-04-27 03:33:00.417867] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.417971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.773 [2024-04-27 03:33:00.417996] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.418154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.418267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.418294] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.418394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.418494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.418519] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.418651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.418766] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.418791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.418901] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.419004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.419029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.419164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.419275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.419301] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.419418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.419521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.419546] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.419687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.419796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.419821] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.419925] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.420032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.420057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.420170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.420272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.420298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.420400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.420518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.420543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.420651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.420779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.420805] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.420939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.421041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.421065] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.421202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.421313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.421339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.421463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.421563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.421587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.421692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.421836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.421861] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.421968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.422069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.422094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.422200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.422330] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.422356] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.422462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.422592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.422618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.422750] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.422881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.422906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.423039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.423145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.423171] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.423284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.423397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.423423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.423528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.423644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.423669] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.423801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.423942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.423969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.424082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.424209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.424235] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.424380] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.424497] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.424522] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.424624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.424755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.424781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.424912] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.425042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.425067] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.425184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.425353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.425378] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.774 qpair failed and we were unable to recover it. 00:21:35.774 [2024-04-27 03:33:00.425510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.774 [2024-04-27 03:33:00.425644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.425668] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.425804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.425940] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.425965] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.426067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.426167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.426196] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.426301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.426405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.426430] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.426534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.426636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.426660] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.426700] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:35.775 [2024-04-27 03:33:00.426738] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:35.775 [2024-04-27 03:33:00.426752] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:35.775 [2024-04-27 03:33:00.426764] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:35.775 [2024-04-27 03:33:00.426759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.426776] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:35.775 [2024-04-27 03:33:00.426862] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.426831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:21:35.775 [2024-04-27 03:33:00.426885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.426991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.427099] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.427126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.427121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:21:35.775 [2024-04-27 03:33:00.427154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:21:35.775 [2024-04-27 03:33:00.427158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:35.775 [2024-04-27 03:33:00.427239] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.427355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.427379] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.427485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.427598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.427624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.427763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.427868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.427893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.428001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.428107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.428132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.428235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.428371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.428397] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.428537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.428659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.428683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.428806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.428910] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.428934] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.429078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.429184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.429208] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.429332] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.429438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.429464] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.429600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.429700] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.429725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.429852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.429957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.429981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.430085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.430188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.430212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.430313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.430422] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.430446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.430581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.430698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.430724] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.430829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.430938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.430962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.431067] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.431163] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.431188] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.431313] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.431423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.431448] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.431558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.431660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.431686] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.431793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.431898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.431923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.775 qpair failed and we were unable to recover it. 00:21:35.775 [2024-04-27 03:33:00.432031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.775 [2024-04-27 03:33:00.432164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.432189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.432301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.432407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.432432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.432564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.432669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.432695] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.432825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.432931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.432957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.433087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.433196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.433221] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.433353] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.433484] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.433509] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.433613] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.433733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.433757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.433871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.434003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.434029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.434133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.434266] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.434291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.434398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.434500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.434525] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.434666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.434776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.434801] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.434924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.435027] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.435052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.435173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.435282] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.435313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.435434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.435534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.435558] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.435661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.435799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.435824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.435933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.436097] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.436121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.436235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.436420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.436446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.436559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.436694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.436719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.436836] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.436970] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.436995] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.437115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.437225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.437255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.437358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.437461] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.437487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.437600] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.437701] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.437727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.437844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.437946] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.437970] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.438083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.438179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.438204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.438338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.438448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.438473] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.438611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.438712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.438737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.438848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.438942] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.438967] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.439104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.439210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.439234] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.439370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.439468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.776 [2024-04-27 03:33:00.439492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.776 qpair failed and we were unable to recover it. 00:21:35.776 [2024-04-27 03:33:00.439604] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.439703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.439727] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.439835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.439950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.439975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.440085] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.440217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.440242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.440364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.440470] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.440495] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.440622] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.440725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.440749] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.440886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.440983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.441012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.441113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.441235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.441277] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.441386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.441489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.441515] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.441618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.441756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.441780] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.441913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.442016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.442041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.442174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.442290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.442316] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.442429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.442539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.442564] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.442698] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.442850] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.442875] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.442976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.443107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.443132] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.443237] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.443350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.443376] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.443471] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.443577] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.443606] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.443712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.443819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.443844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.443951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.444064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.444088] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.444200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.444309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.444335] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.444433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.444578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.444602] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.444707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.444811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.444837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.444936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.445047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.445072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.445173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.445284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.445309] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.777 qpair failed and we were unable to recover it. 00:21:35.777 [2024-04-27 03:33:00.445420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.445521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.777 [2024-04-27 03:33:00.445548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.445654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.445755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.445781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.445889] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.445990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.446020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.446179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.446318] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.446344] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.446453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.446549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.446573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.446681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.446784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.446809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.446913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.447033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.447058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.447161] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.447274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.447298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.447406] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.447518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.447543] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.447713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.447817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.447841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.447960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.448062] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.448086] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.448191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.448324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.448350] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.448453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.448568] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.448598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.448694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.448788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.448813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.448924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.449031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.449056] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.449164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.449274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.449300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.449455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.449572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.449597] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.449707] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.449835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.449859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.449964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.450072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.450096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.450214] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.450334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.450359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.450472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.450610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.450636] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.450770] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.450898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.450932] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.451064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.451199] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.451225] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.451366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.451474] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.451501] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.451640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.451742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.451768] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.451872] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.452005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.452030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.452134] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.452259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.452295] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.452429] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.452548] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.452573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.452693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.452804] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.452829] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.778 qpair failed and we were unable to recover it. 00:21:35.778 [2024-04-27 03:33:00.452969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.778 [2024-04-27 03:33:00.453075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.453100] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.453207] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.453326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.453354] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.453463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.453574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.453599] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.453699] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.453822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.453847] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.453952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.454056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.454081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.454224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.454335] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.454362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.454466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.454570] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.454594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.454711] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.454855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.454880] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.454980] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.455116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.455143] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.455256] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.455363] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.455388] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.455528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.455663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.455688] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.455796] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.455892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.455916] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.456047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.456192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.456216] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.456344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.456450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.456475] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.456597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.456695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.456720] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.456847] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.456985] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.457009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.457149] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.457294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.457320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.457449] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.457562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.457588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.457688] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.457802] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.457827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.457931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.458051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.458077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.458186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.458298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.458324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.458436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.458545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.458571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.458687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.458787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.458812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.458920] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.459025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.459051] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.459173] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.459274] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.459300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.459407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.459513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.459537] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.459664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.459767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.459791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.459893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.459994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.460020] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.460140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.460251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.460276] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.779 qpair failed and we were unable to recover it. 00:21:35.779 [2024-04-27 03:33:00.460385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.779 [2024-04-27 03:33:00.460488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.460512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.460609] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.460740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.460765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.460882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.460983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.461009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.461143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.461257] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.461283] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.461396] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.461500] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.461525] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.461645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.461753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.461778] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.461919] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.462025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.462052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.462166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.462265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.462291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.462408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.462536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.462561] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.462673] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.462817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.462842] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.462956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.463056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.463081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.463216] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.463336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.463362] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.463468] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.463601] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.463626] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.463730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.463826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.463851] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.463960] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.464107] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.464133] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.464241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.464355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.464380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.464496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.464599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.464624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.464728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.464835] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.464862] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.465002] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.465121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.465147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.465287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.465395] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.465421] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.465534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.465668] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.465693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.465791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.465899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.465926] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.466029] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.466143] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.466168] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.466281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.466399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.466424] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.466528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.466637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.466662] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.466810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.466931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.466962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.467079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.467185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.467211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.467338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.467445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.467471] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.467587] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.467696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.467721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.780 qpair failed and we were unable to recover it. 00:21:35.780 [2024-04-27 03:33:00.467842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.780 [2024-04-27 03:33:00.467949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.467975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.468083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.468188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.468215] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.468329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.468433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.468458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.468563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.468657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.468682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.468781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.468884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.468910] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.469008] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.469110] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.469134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.469278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.469385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.469410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.469515] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.469611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.469637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.469771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.469877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.469901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.470010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.470111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.470136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.470252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.470360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.470385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.470494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.470593] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.470618] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.470731] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.470825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.470850] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.470978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.471082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.471107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.471206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.471320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.471346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.471458] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.471563] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.471588] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.471695] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.471800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.471825] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.471930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.472042] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.472067] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.472178] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.472308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.472334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.472437] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.472537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.472562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.472662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.472767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.472793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.472896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.472998] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.473024] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.473130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.473265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.473298] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.473401] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.473540] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.473565] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.473669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.473772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.473797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.473904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.474010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.474036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.474132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.474288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.474315] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.474430] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.474537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.474562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.474665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.474788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.781 [2024-04-27 03:33:00.474813] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.781 qpair failed and we were unable to recover it. 00:21:35.781 [2024-04-27 03:33:00.474918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.475016] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.475041] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.475157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.475285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.475312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.475425] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.475527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.475552] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.475682] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.475798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.475824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.475939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.476050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.476077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.476182] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.476294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.476321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.476424] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.476530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.476557] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.476676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.476776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.476802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.476900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.477004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.477029] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.477141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.477254] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.477279] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.477397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.477498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.477523] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.477626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.477720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.477745] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.477846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.477948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.477974] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.478079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.478186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.478211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.478324] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.478436] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.478462] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.478564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.478671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.478696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.478806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.478916] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.478941] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.479049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.479202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.479229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.479341] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.479440] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.479467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.479578] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.479678] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.479704] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.479801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.479928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.479952] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.480054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.480151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.480175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.480310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.480409] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.480433] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.480572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.480671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.480696] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.782 [2024-04-27 03:33:00.480799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.480933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.782 [2024-04-27 03:33:00.480957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.782 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.481070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.481179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.481203] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.481345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.481456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.481481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.481590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.481696] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.481725] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.481859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.481965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.481991] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.482126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.482225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.482259] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbfec000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.482421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.482545] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.482573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.482694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.482793] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.482819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.482938] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.483045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.483070] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.483174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.483278] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.483305] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.483421] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.483527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.483553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.483693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.483799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.483824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.483922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.484043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.484069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.484181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.484310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.484342] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.484450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.484547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.484572] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.484684] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.484819] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.484844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.484957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.485059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.485085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.485192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.485312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.485339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.485445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.485559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.485585] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.485719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.485821] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.485846] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.485945] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.486044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.486069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.486174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.486287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.486313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.486415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.486523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.486549] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.486651] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.486756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.486789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.486890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.486983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.487008] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.487111] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.487224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.487254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.487373] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.487482] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.487510] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.487621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.487732] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.487757] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.487860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.488006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.488032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.783 [2024-04-27 03:33:00.488139] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.488243] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.783 [2024-04-27 03:33:00.488280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.783 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.488385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.488498] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.488535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.488685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.488794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.488824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.488934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.489050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.489075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.489183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.489315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.489346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.489491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.489603] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.489629] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.489740] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.489868] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.489893] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.489994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.490126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.490152] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.490290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.490393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.490418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.490550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.490659] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.490684] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.490826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.490931] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.490956] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.491071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.491177] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.491202] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.491310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.491413] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.491438] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.491544] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.491641] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.491666] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.491805] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.491936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.491962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.492132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.492253] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.492280] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.492386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.492488] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.492513] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.492634] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.492764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.492789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.492896] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.493043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.493068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.493195] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.493301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.493326] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.493472] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.493579] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.493605] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.493703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.493806] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.493832] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.493962] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.494071] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.494096] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.494209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.494321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.494348] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.494450] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.494555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.494579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.494681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.494794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.494819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.494927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.495043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.495068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.495200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.495314] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.495340] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.495448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.495547] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.495573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.784 qpair failed and we were unable to recover it. 00:21:35.784 [2024-04-27 03:33:00.495703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.495810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.784 [2024-04-27 03:33:00.495843] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.495949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.496058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.496085] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.496188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.496294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.496320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.496423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.496523] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.496548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.496657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.496763] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.496787] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.496903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.497007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.497033] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.497188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.497291] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.497317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.497460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.497559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.497584] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.497683] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.497794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.497819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.497933] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.498038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.498064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.498209] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.498319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.498345] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.498448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.498549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.498574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.498724] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.498828] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.498853] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.498968] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.499069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.499094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.499203] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.499319] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.499346] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.499455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.499557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.499582] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.499687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.499834] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.499859] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.499956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.500056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.500081] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.500185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.500294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.500320] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.500454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.500553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.500578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.500692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.500799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.500823] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.500934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.501043] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.501069] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.501196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.501312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.501339] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.501486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.501625] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.501651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.501762] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.501866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.501892] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.501999] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.502144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.502169] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.502283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.502390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.502417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.502526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.502628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.502653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.502758] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.502860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.502885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.785 qpair failed and we were unable to recover it. 00:21:35.785 [2024-04-27 03:33:00.503026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.785 [2024-04-27 03:33:00.503135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.503161] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.503270] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.503383] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.503410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.503514] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.503612] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.503637] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.503736] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.503881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.503906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.504044] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.504184] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.504211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.504321] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.504454] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.504479] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.504628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.504728] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.504752] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.504890] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.504990] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.505015] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.505113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.505222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.505254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.505403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.505504] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.505531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.505680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.505808] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.505833] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.505941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.506048] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.506075] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.506185] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.506298] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.506324] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.506428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.506534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.506559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.506664] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.506768] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.506793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.506903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.507007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.507032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.507144] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.507290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.507317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.507460] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.507582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.507612] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.507745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.507848] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.507874] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.508000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.508106] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.508136] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.508295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.508521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.508548] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.508675] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.508822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.508854] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.508992] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.509113] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.509145] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.509275] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.509389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.509422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.509539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.509755] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.509782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.509937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.510087] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.510120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.786 qpair failed and we were unable to recover it. 00:21:35.786 [2024-04-27 03:33:00.510277] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.510407] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.786 [2024-04-27 03:33:00.510441] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.510580] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.510706] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.510732] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.510877] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.510984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.511011] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.511227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.511351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.511383] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.511489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.511602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.511632] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.511748] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.511852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.511876] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.511994] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.512126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.512154] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.512267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.512387] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.512417] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.512524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.512628] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.512653] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.512871] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.512986] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.513012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.513142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.513265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.513296] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.513444] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.513561] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.513594] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.513717] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.513832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.513858] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.513958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.514065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.514090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.514210] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.514357] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.514386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.514511] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.514621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.514651] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.514756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.514859] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.514885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.515001] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.515104] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.515134] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.515255] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.515371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.515404] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.515517] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.515647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.515673] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.515792] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.515905] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.515931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.516045] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.516165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.516204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.516336] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.516446] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.516473] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.516592] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.516691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.516721] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.516829] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.516965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.516994] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.517112] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.517222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.517258] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.787 qpair failed and we were unable to recover it. 00:21:35.787 [2024-04-27 03:33:00.517375] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.517475] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.787 [2024-04-27 03:33:00.517504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.517636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.517780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.517810] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.517924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.518036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.518068] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.518180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.518283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.518312] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.518435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.518546] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.518573] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.518686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.518817] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.518844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.518969] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.519102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.519131] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.519238] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.519355] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.519386] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.519496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.519616] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.519641] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.519756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.519894] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.519923] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.520056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.520169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.520195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.520325] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.520427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.520457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.520572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.520679] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.520708] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.520833] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.520983] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.521009] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.521154] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.521294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.521323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.521448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.521558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.521587] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.521710] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.521855] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.521881] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.521991] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.522103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.522129] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.522267] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.522379] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.522405] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.522528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.522654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.522683] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.522799] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.522957] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.522986] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.523126] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.523262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.523300] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.523410] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.523525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.523554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.523660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.523807] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.523838] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.523961] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.524078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.524104] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.524268] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.524390] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.524415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.524533] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.524637] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.524663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.524779] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.524892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.524922] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.525059] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.525170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.525198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.788 [2024-04-27 03:33:00.525339] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.525456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.788 [2024-04-27 03:33:00.525483] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.788 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.525611] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.525714] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.525741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.525886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.526007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.526036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.526147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.526300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.526329] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.526451] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.526558] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.526589] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.526737] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.526846] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.526873] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.526984] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.527115] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.527144] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.527262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.527386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.527413] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.527530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.527660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.527689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.527798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.527939] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.527968] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.528094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.528204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.528231] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f3ef90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.528382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.528516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.528544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.528656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.528767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.528792] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.528918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.529025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.529050] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.529187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.529295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.529321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.529420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.529525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.529550] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.529667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.529794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.529820] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.529941] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.530053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.530084] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.530187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.530300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.530327] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.530438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.530554] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.530579] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.530687] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.530791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.530816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.530950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.531050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.531076] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.531190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.531297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.531323] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.531428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.531529] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.531554] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.531690] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.531811] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.531837] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.531948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.532051] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.532077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.532191] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.532308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.532334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.532441] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.532591] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.532620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.532733] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.532840] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.532866] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.789 qpair failed and we were unable to recover it. 00:21:35.789 [2024-04-27 03:33:00.532993] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.533101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.789 [2024-04-27 03:33:00.533126] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.533227] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.533356] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.533382] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.533490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.533599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.533624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.533735] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.533841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.533868] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.533972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.534081] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.534107] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.534235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.534397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.534423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.534560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.534663] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.534689] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.534794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.534900] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.534927] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.535036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.535138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.535172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.535285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.535386] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.535411] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.535526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.535621] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.535646] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.535759] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.535864] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.535889] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.535996] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.536096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.536121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.536226] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.536347] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.536374] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.536485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.536598] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.536624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.536725] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.536831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.536857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.537005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.537133] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.537159] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.537293] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.537402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.537427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.537532] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.537635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.537661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.537772] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.537874] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.537899] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.538047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.538150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.538175] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.538300] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.538400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.538425] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.538535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.538638] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.538663] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.538800] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.538928] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.538953] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.539053] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.539164] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.539189] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.539294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.539405] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.539432] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.539539] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.539667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.539693] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.539797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.539899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.539924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.540052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.540155] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.540180] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.790 qpair failed and we were unable to recover it. 00:21:35.790 [2024-04-27 03:33:00.540294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.790 [2024-04-27 03:33:00.540433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.540459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.540607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.540716] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.540741] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.540844] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.540944] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.540969] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.541089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.541197] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.541222] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.541328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.541433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.541459] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.541564] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.541680] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.541706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.541842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.541951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.541977] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.542093] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.542221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.542252] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.542358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.542466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.542491] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.542617] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.542722] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.542747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.542881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.542988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.543012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.543140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.543251] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.543278] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.543392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.543496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.543521] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.543649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.543757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.543781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.543883] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.544096] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.544121] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.544224] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.544346] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.544372] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.544473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.544602] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.544627] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.544727] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.544842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.544867] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.544965] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.545069] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.545094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.545201] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.545334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.545360] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.545466] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.545599] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.545624] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.545751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.545858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.545885] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.545988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.546088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.546113] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.546221] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.546443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.546469] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.546595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.546697] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.546723] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.791 qpair failed and we were unable to recover it. 00:21:35.791 [2024-04-27 03:33:00.546860] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.791 [2024-04-27 03:33:00.546964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.546989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.547094] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.547222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.547254] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.547372] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.547478] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.547504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.547610] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.547712] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.547737] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.547841] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.547948] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.547973] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.548078] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.548180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.548206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.548326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.548439] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.548465] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.548573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.548784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.548809] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.548943] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.549068] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.549094] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.549200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.549309] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.549336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.549550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.549650] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.549675] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.549795] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.549895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.549920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.550026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.550141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.550166] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.550280] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.550393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.550419] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.550526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.550635] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.550661] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.550818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.550922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.550947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.551050] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.551156] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.551182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.551297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.551402] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.551427] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.551528] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.551660] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.551685] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.551798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.551904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.551930] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.552064] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.552187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.552212] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.552350] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.552456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.552481] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.552586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.552694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.552719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.552818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.553065] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.553090] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.553202] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.553312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.553337] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.553502] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.553606] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.553631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.553761] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.553861] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.553886] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 [2024-04-27 03:33:00.553988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.554095] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.554120] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 03:33:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:35.792 [2024-04-27 03:33:00.554231] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 03:33:00 -- common/autotest_common.sh@850 -- # return 0 00:21:35.792 [2024-04-27 03:33:00.554418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.792 [2024-04-27 03:33:00.554444] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.792 qpair failed and we were unable to recover it. 00:21:35.792 03:33:00 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:35.793 [2024-04-27 03:33:00.554562] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 03:33:00 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:35.793 [2024-04-27 03:33:00.554693] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:35.793 [2024-04-27 03:33:00.554718] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.554823] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.555033] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.555058] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.555166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.555292] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.555319] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.555427] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.555534] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.555559] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.555658] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.555760] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.555788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.555904] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.556010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.556039] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.556145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.556259] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.556285] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.556418] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.556519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.556544] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.556653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.556756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.556781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.556892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.557004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.557030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.557131] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.557241] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.557293] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.557392] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.557505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.557531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.557636] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.557739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.557764] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.557865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.557964] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.557990] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.558088] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.558192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.558217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.558337] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.558438] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.558468] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.558581] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.558681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.558707] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.558810] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.558932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.558957] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.559086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.559188] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.559214] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.559334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.559448] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.559474] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.559588] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.559692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.559717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.559820] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.559956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.559981] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.560114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.560220] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.560251] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.560367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.560513] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.560540] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.560647] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.560771] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.560797] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.560927] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.561036] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.561066] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.561169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.561276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.561303] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.561408] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.561553] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.561578] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.793 qpair failed and we were unable to recover it. 00:21:35.793 [2024-04-27 03:33:00.561676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.793 [2024-04-27 03:33:00.561774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.561799] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.561903] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.562038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.562064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.562174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.562290] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.562317] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.562423] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.562527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.562560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.562666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.562816] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.562841] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.562950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.563052] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.563077] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.563187] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.563306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.563333] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.563434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.563536] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.563571] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.563689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.563801] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.563827] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.563930] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.564056] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.564082] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.564183] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.564288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.564314] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.564428] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.564530] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.564556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.564676] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.564786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.564811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.564909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.565035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.565059] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.565165] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.565301] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.565328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.565435] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.565535] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.565560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.565670] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.565778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.565804] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.565909] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.566014] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.566040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.566150] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.566264] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.566291] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.566426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.566531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.566556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.566665] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.566767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.566793] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.566897] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.567004] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.567030] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.567130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.567235] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.567266] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.567382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.567489] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.567514] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.567618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.567719] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.567746] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.567858] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.568070] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.568095] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.568225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.568345] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.568370] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.568527] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.568672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.568698] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.568814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.568914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.794 [2024-04-27 03:33:00.568940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.794 qpair failed and we were unable to recover it. 00:21:35.794 [2024-04-27 03:33:00.569058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.569159] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.569184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.569288] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.569393] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.569418] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.569550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.569662] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.569687] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.569852] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.569953] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.569978] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.570116] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.570215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.570241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.570359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.570464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.570490] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.570596] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.570720] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.570747] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.570853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.570950] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.570975] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.571101] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.571198] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.571223] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.571343] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.571453] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.571478] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.571608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.571726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.571751] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.571851] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.571963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.571989] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.572103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.572204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.572229] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.572352] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.572485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.572511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.572623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 03:33:00 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:35.795 [2024-04-27 03:33:00.572734] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.572761] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 03:33:00 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:35.795 [2024-04-27 03:33:00.572870] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 03:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.795 [2024-04-27 03:33:00.572971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.572998] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:35.795 [2024-04-27 03:33:00.573103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.573225] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.573263] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.573364] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.573467] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.573492] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.573619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.573754] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.573779] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.573881] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.573981] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.574007] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.574122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.574233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.574265] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.574384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.574486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.574511] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.574620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.574757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.574782] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.574898] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.575028] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.575052] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.575186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.575312] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.575338] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.575447] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.575549] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.575574] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.575671] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.575778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.575803] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.575934] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.576047] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.795 [2024-04-27 03:33:00.576073] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.795 qpair failed and we were unable to recover it. 00:21:35.795 [2024-04-27 03:33:00.576204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.576366] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.576392] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.576494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.576607] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.576631] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.576780] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.576886] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.576911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.577046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.577147] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.577172] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.577294] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.577399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.577423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.577559] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.577657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.577682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.577787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.577892] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.577917] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.578012] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.578137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.578162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.578285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.578431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.578457] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.578597] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.578747] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.578772] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.578869] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.578979] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.579003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.579158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.579271] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.579297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.579403] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.579531] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.579556] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.579666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.579798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.579824] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.579949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.580080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.580105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.580252] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.580360] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.580385] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.580494] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.580632] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.580657] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.580778] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.580893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.580918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.581046] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.581170] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.581195] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.581328] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.581433] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.581458] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.581560] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.581703] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.581729] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.581853] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.581978] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.582003] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.582103] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.582208] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.582233] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.582359] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.582486] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.582512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.796 qpair failed and we were unable to recover it. 00:21:35.796 [2024-04-27 03:33:00.582618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.582744] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.796 [2024-04-27 03:33:00.582769] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.582887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.582987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.583012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.583162] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.583281] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.583307] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.583414] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.583510] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.583535] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.583667] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.583767] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.583791] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.583914] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.584049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.584074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.584180] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.584303] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.584328] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.584443] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.584573] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.584598] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.584713] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.584893] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.584918] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.585039] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.585137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.585162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.585284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.585389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.585415] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.585556] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.585657] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.585682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.585781] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.585882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.585906] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.586010] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.586140] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.586167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.586276] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.586388] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.586414] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.586557] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.586681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.586706] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.586825] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.586937] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.586962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.587080] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.587193] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.587218] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.587389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.587491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.587516] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.587626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.587730] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.587756] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.587866] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.588003] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.588028] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.588130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.588229] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.588261] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.588374] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.588487] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.588512] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.588644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.588746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.588771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.588887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.588988] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.589014] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.589114] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.589217] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.589242] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.589371] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.589476] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.589506] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.589620] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.589764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.589789] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.589915] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.590058] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.797 [2024-04-27 03:33:00.590083] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.797 qpair failed and we were unable to recover it. 00:21:35.797 [2024-04-27 03:33:00.590204] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.590315] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.590343] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.590499] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.590649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.590674] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.590788] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.590899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.590924] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.591031] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.591137] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.591162] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.591297] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.591442] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.591467] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.591572] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.591709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.591735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.591899] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.592009] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.592040] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.592171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.592320] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.592351] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.592464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.592608] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.592633] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.592742] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.592876] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.592901] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.593024] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.593141] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.593167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.593279] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.593384] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.593410] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.593519] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.593623] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.593648] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.593776] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.593906] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.593931] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.594038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.594158] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.594184] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.594329] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.594455] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.594480] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.594586] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.594694] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.594719] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.594822] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.594972] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.595001] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.595135] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.595261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.595287] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.595385] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.595491] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.595516] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.595669] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.595818] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.595844] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 Malloc0 00:21:35.798 [2024-04-27 03:33:00.595949] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.596079] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.596105] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.596206] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 03:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.798 [2024-04-27 03:33:00.596333] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.596358] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 03:33:00 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:21:35.798 [2024-04-27 03:33:00.596503] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 03:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.798 [2024-04-27 03:33:00.596614] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.596639] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:35.798 [2024-04-27 03:33:00.596773] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.596885] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.596911] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.597026] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.597157] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.597182] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.597296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.597397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.597422] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.798 qpair failed and we were unable to recover it. 00:21:35.798 [2024-04-27 03:33:00.597574] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.798 [2024-04-27 03:33:00.597685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.597710] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.597865] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.597963] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.597988] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.598100] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.598196] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.598220] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.598340] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.598445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.598470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.598590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.598689] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.598713] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.598814] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.598922] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.598947] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.599054] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.599181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.599217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.599382] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.599516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.599542] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.599576] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:35.799 [2024-04-27 03:33:00.599652] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.599746] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.599771] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.599891] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.600005] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.600031] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.600136] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.600295] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.600321] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.600426] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.600524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.600553] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.600686] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.600794] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.600819] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.600956] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.601089] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.601123] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.601233] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.601354] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.601380] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.601485] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.601590] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.601620] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.601718] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.601824] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.601848] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.602006] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.602121] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.602146] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.602262] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.602398] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.602423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.602550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.602691] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.602717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.602856] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.602958] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.602983] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.603086] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.603186] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.603211] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.603310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.603417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.603442] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.603555] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.603681] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.603705] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.603826] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.603936] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.603962] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.604072] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.604213] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.604237] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.604400] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.604509] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.604536] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.604653] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.604797] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.604822] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.604952] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.605049] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.799 [2024-04-27 03:33:00.605074] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.799 qpair failed and we were unable to recover it. 00:21:35.799 [2024-04-27 03:33:00.605190] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.605326] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.605353] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.605473] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.605618] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.605644] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.605775] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.605908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.605939] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.606040] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.606181] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.606206] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.606370] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.606479] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.606504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.606619] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.606751] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.606776] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.606887] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.607000] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.607025] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.607138] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.607261] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.607288] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.607399] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.607524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.607560] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.607677] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.607786] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.607811] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 03:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.607908] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 03:33:00 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:35.800 [2024-04-27 03:33:00.608041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 03:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.800 [2024-04-27 03:33:00.608072] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:35.800 [2024-04-27 03:33:00.608194] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.608310] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.608336] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.608464] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.608584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.608609] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.608715] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.608831] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.608857] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.608976] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.609073] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.609099] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.609200] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.609334] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.609359] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.609496] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.609624] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.609649] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.609757] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.609863] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.609888] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.610019] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.610120] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.610147] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.610283] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.610394] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.610420] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.610524] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.610644] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.610670] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.610774] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.610882] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.610908] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.611021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.611122] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.800 [2024-04-27 03:33:00.611157] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.800 qpair failed and we were unable to recover it. 00:21:35.800 [2024-04-27 03:33:00.611284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.611420] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.611446] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.611550] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.611692] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.611717] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.611832] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.611932] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.611958] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.612066] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.612205] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.612241] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.612351] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.612462] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.612487] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.612595] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.612745] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.612770] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.612873] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.613011] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.613036] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.613130] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.613265] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.613297] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.613404] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.613505] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.613531] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.613626] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.613756] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.613781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.613918] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.614021] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.614046] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.614151] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.614299] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.614325] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.614431] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.614525] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.614551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.614672] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.614777] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.614802] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.614907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.615035] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.615060] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.615222] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.615361] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.615387] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.615493] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.615640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.615665] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.615798] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 03:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.801 [2024-04-27 03:33:00.615924] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.615949] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 03:33:00 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.616075] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 03:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.801 [2024-04-27 03:33:00.616174] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.616198] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:35.801 [2024-04-27 03:33:00.616358] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.616463] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.616488] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.616605] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.616709] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.616735] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.616842] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.616951] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.616976] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.617083] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.617192] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.617217] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.617344] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.617456] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.617482] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.617640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.617739] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.617765] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.617902] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.618007] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.618032] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.618166] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.618308] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.618334] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.618452] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.618584] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.801 [2024-04-27 03:33:00.618619] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.801 qpair failed and we were unable to recover it. 00:21:35.801 [2024-04-27 03:33:00.618726] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.618884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.618920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.619025] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.619132] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.619156] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.619272] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.619397] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.619423] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.619518] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.619654] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.619679] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.619789] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.619917] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.619943] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.620041] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.620142] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.620167] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.620284] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.620389] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.620416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.620521] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.620649] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.620674] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.620784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.620895] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.620920] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.621034] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.621145] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.621170] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.621296] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.621391] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.621416] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.621520] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.621656] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.621682] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.621784] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.621913] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.621940] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.622082] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.622179] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.622204] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.622338] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.622445] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.622470] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.622582] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.622685] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.622712] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.622815] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.622971] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.623002] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.623102] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.623230] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.623270] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.623377] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.623490] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.623516] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.623645] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.623753] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.623781] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.623879] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 03:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.802 [2024-04-27 03:33:00.623987] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.624012] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 03:33:00 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:35.802 [2024-04-27 03:33:00.624118] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 03:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.802 [2024-04-27 03:33:00.624215] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.624255] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:35.802 [2024-04-27 03:33:00.624367] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.624480] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.624504] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.624640] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.624764] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.624788] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.624884] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.625017] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.625042] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.625169] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.625287] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.625313] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.625417] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.625526] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.625551] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.625661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.625791] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.802 [2024-04-27 03:33:00.625816] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.802 qpair failed and we were unable to recover it. 00:21:35.802 [2024-04-27 03:33:00.625921] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.626038] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.626064] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.626171] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.626306] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.626330] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.626434] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.626537] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.626562] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.626666] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.626787] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.626812] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.626907] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.627032] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.627057] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.627167] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.627285] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.627311] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.627415] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.627516] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.627541] nvme_tcp.c:2371:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fbff4000b90 with addr=10.0.0.2, port=4420 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.627661] posix.c:1037:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:35.803 [2024-04-27 03:33:00.627894] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:35.803 [2024-04-27 03:33:00.630787] posix.c: 675:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:21:35.803 [2024-04-27 03:33:00.630844] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7fbff4000b90 (107): Transport endpoint is not connected 00:21:35.803 [2024-04-27 03:33:00.630912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 03:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.803 03:33:00 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:21:35.803 03:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.803 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:35.803 03:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.803 03:33:00 -- host/target_disconnect.sh@58 -- # wait 1531375 00:21:35.803 [2024-04-27 03:33:00.640274] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:35.803 [2024-04-27 03:33:00.640398] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:35.803 [2024-04-27 03:33:00.640431] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:35.803 [2024-04-27 03:33:00.640447] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:35.803 [2024-04-27 03:33:00.640460] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:35.803 [2024-04-27 03:33:00.640490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.650192] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:35.803 [2024-04-27 03:33:00.650306] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:35.803 [2024-04-27 03:33:00.650333] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:35.803 [2024-04-27 03:33:00.650348] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:35.803 [2024-04-27 03:33:00.650360] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:35.803 [2024-04-27 03:33:00.650390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.660146] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:35.803 [2024-04-27 03:33:00.660265] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:35.803 [2024-04-27 03:33:00.660292] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:35.803 [2024-04-27 03:33:00.660307] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:35.803 [2024-04-27 03:33:00.660320] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:35.803 [2024-04-27 03:33:00.660349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.670172] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:35.803 [2024-04-27 03:33:00.670295] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:35.803 [2024-04-27 03:33:00.670322] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:35.803 [2024-04-27 03:33:00.670337] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:35.803 [2024-04-27 03:33:00.670352] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:35.803 [2024-04-27 03:33:00.670382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.680170] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:35.803 [2024-04-27 03:33:00.680286] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:35.803 [2024-04-27 03:33:00.680312] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:35.803 [2024-04-27 03:33:00.680327] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:35.803 [2024-04-27 03:33:00.680345] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:35.803 [2024-04-27 03:33:00.680375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.690253] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:35.803 [2024-04-27 03:33:00.690374] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:35.803 [2024-04-27 03:33:00.690401] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:35.803 [2024-04-27 03:33:00.690415] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:35.803 [2024-04-27 03:33:00.690431] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:35.803 [2024-04-27 03:33:00.690461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.700224] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:35.803 [2024-04-27 03:33:00.700341] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:35.803 [2024-04-27 03:33:00.700367] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:35.803 [2024-04-27 03:33:00.700382] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:35.803 [2024-04-27 03:33:00.700395] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:35.803 [2024-04-27 03:33:00.700424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.710288] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:35.803 [2024-04-27 03:33:00.710394] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:35.803 [2024-04-27 03:33:00.710419] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:35.803 [2024-04-27 03:33:00.710433] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:35.803 [2024-04-27 03:33:00.710446] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:35.803 [2024-04-27 03:33:00.710475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.720315] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:35.803 [2024-04-27 03:33:00.720427] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:35.803 [2024-04-27 03:33:00.720457] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:35.803 [2024-04-27 03:33:00.720472] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:35.803 [2024-04-27 03:33:00.720485] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:35.803 [2024-04-27 03:33:00.720515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.803 qpair failed and we were unable to recover it. 00:21:35.803 [2024-04-27 03:33:00.730323] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:35.804 [2024-04-27 03:33:00.730429] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:35.804 [2024-04-27 03:33:00.730456] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:35.804 [2024-04-27 03:33:00.730471] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:35.804 [2024-04-27 03:33:00.730484] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:35.804 [2024-04-27 03:33:00.730513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:35.804 qpair failed and we were unable to recover it. 00:21:36.062 [2024-04-27 03:33:00.740360] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.062 [2024-04-27 03:33:00.740468] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.062 [2024-04-27 03:33:00.740494] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.062 [2024-04-27 03:33:00.740509] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.062 [2024-04-27 03:33:00.740522] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.062 [2024-04-27 03:33:00.740564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.062 qpair failed and we were unable to recover it. 00:21:36.062 [2024-04-27 03:33:00.750361] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.062 [2024-04-27 03:33:00.750475] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.062 [2024-04-27 03:33:00.750500] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.062 [2024-04-27 03:33:00.750515] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.062 [2024-04-27 03:33:00.750527] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.062 [2024-04-27 03:33:00.750556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.062 qpair failed and we were unable to recover it. 00:21:36.062 [2024-04-27 03:33:00.760394] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.062 [2024-04-27 03:33:00.760491] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.062 [2024-04-27 03:33:00.760516] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.062 [2024-04-27 03:33:00.760531] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.062 [2024-04-27 03:33:00.760543] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.062 [2024-04-27 03:33:00.760573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.062 qpair failed and we were unable to recover it. 00:21:36.062 [2024-04-27 03:33:00.770520] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.062 [2024-04-27 03:33:00.770645] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.062 [2024-04-27 03:33:00.770678] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.062 [2024-04-27 03:33:00.770694] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.062 [2024-04-27 03:33:00.770715] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.062 [2024-04-27 03:33:00.770759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.062 qpair failed and we were unable to recover it. 00:21:36.062 [2024-04-27 03:33:00.780458] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.062 [2024-04-27 03:33:00.780567] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.062 [2024-04-27 03:33:00.780593] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.062 [2024-04-27 03:33:00.780608] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.062 [2024-04-27 03:33:00.780621] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.062 [2024-04-27 03:33:00.780650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.062 qpair failed and we were unable to recover it. 00:21:36.062 [2024-04-27 03:33:00.790492] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.062 [2024-04-27 03:33:00.790607] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.062 [2024-04-27 03:33:00.790634] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.062 [2024-04-27 03:33:00.790648] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.062 [2024-04-27 03:33:00.790661] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.062 [2024-04-27 03:33:00.790691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.062 qpair failed and we were unable to recover it. 00:21:36.062 [2024-04-27 03:33:00.800522] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.062 [2024-04-27 03:33:00.800622] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.062 [2024-04-27 03:33:00.800647] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.062 [2024-04-27 03:33:00.800662] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.800675] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.800704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.810557] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.810666] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.810694] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.810709] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.810725] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.810755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.820579] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.820689] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.820716] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.820730] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.820742] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.820772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.830607] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.830712] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.830738] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.830753] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.830765] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.830794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.840636] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.840767] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.840792] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.840807] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.840819] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.840848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.850749] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.850849] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.850875] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.850890] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.850902] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.850943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.860669] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.860790] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.860816] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.860836] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.860850] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.860879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.870704] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.870812] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.870837] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.870852] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.870865] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.870894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.880752] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.880854] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.880880] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.880895] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.880907] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.880936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.890778] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.890882] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.890908] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.890923] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.890935] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.890964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.900810] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.900922] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.900948] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.900963] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.900975] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.901004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.910851] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.910970] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.911001] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.911016] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.911028] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.911056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.920895] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.921003] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.921029] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.921044] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.921056] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.921085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.063 qpair failed and we were unable to recover it. 00:21:36.063 [2024-04-27 03:33:00.930881] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.063 [2024-04-27 03:33:00.930990] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.063 [2024-04-27 03:33:00.931015] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.063 [2024-04-27 03:33:00.931030] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.063 [2024-04-27 03:33:00.931042] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.063 [2024-04-27 03:33:00.931071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.064 [2024-04-27 03:33:00.940895] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.064 [2024-04-27 03:33:00.941040] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.064 [2024-04-27 03:33:00.941065] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.064 [2024-04-27 03:33:00.941080] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.064 [2024-04-27 03:33:00.941093] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.064 [2024-04-27 03:33:00.941121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.064 [2024-04-27 03:33:00.950968] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.064 [2024-04-27 03:33:00.951073] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.064 [2024-04-27 03:33:00.951104] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.064 [2024-04-27 03:33:00.951119] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.064 [2024-04-27 03:33:00.951132] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.064 [2024-04-27 03:33:00.951161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.064 [2024-04-27 03:33:00.961027] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.064 [2024-04-27 03:33:00.961132] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.064 [2024-04-27 03:33:00.961156] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.064 [2024-04-27 03:33:00.961170] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.064 [2024-04-27 03:33:00.961183] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.064 [2024-04-27 03:33:00.961212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.064 [2024-04-27 03:33:00.971039] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.064 [2024-04-27 03:33:00.971136] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.064 [2024-04-27 03:33:00.971163] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.064 [2024-04-27 03:33:00.971177] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.064 [2024-04-27 03:33:00.971190] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.064 [2024-04-27 03:33:00.971219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.064 [2024-04-27 03:33:00.981011] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.064 [2024-04-27 03:33:00.981120] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.064 [2024-04-27 03:33:00.981146] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.064 [2024-04-27 03:33:00.981161] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.064 [2024-04-27 03:33:00.981173] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.064 [2024-04-27 03:33:00.981202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.064 [2024-04-27 03:33:00.991101] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.064 [2024-04-27 03:33:00.991258] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.064 [2024-04-27 03:33:00.991284] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.064 [2024-04-27 03:33:00.991298] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.064 [2024-04-27 03:33:00.991311] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.064 [2024-04-27 03:33:00.991346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.064 [2024-04-27 03:33:01.001068] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.064 [2024-04-27 03:33:01.001178] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.064 [2024-04-27 03:33:01.001203] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.064 [2024-04-27 03:33:01.001218] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.064 [2024-04-27 03:33:01.001230] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.064 [2024-04-27 03:33:01.001266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.064 [2024-04-27 03:33:01.011115] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.064 [2024-04-27 03:33:01.011236] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.064 [2024-04-27 03:33:01.011271] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.064 [2024-04-27 03:33:01.011290] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.064 [2024-04-27 03:33:01.011303] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.064 [2024-04-27 03:33:01.011334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.064 [2024-04-27 03:33:01.021144] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.064 [2024-04-27 03:33:01.021270] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.064 [2024-04-27 03:33:01.021296] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.064 [2024-04-27 03:33:01.021311] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.064 [2024-04-27 03:33:01.021323] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.064 [2024-04-27 03:33:01.021352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.064 [2024-04-27 03:33:01.031149] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.064 [2024-04-27 03:33:01.031266] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.064 [2024-04-27 03:33:01.031291] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.064 [2024-04-27 03:33:01.031306] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.064 [2024-04-27 03:33:01.031318] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.064 [2024-04-27 03:33:01.031348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.064 qpair failed and we were unable to recover it. 00:21:36.323 [2024-04-27 03:33:01.041188] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.323 [2024-04-27 03:33:01.041314] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.323 [2024-04-27 03:33:01.041346] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.323 [2024-04-27 03:33:01.041362] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.323 [2024-04-27 03:33:01.041375] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.323 [2024-04-27 03:33:01.041404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.323 qpair failed and we were unable to recover it. 00:21:36.323 [2024-04-27 03:33:01.051183] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.323 [2024-04-27 03:33:01.051348] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.323 [2024-04-27 03:33:01.051374] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.323 [2024-04-27 03:33:01.051389] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.323 [2024-04-27 03:33:01.051401] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.323 [2024-04-27 03:33:01.051430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.323 qpair failed and we were unable to recover it. 00:21:36.323 [2024-04-27 03:33:01.061240] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.323 [2024-04-27 03:33:01.061354] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.323 [2024-04-27 03:33:01.061381] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.323 [2024-04-27 03:33:01.061395] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.323 [2024-04-27 03:33:01.061408] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.323 [2024-04-27 03:33:01.061450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.323 qpair failed and we were unable to recover it. 00:21:36.323 [2024-04-27 03:33:01.071269] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.323 [2024-04-27 03:33:01.071375] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.323 [2024-04-27 03:33:01.071400] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.323 [2024-04-27 03:33:01.071415] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.323 [2024-04-27 03:33:01.071428] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.323 [2024-04-27 03:33:01.071456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.323 qpair failed and we were unable to recover it. 00:21:36.323 [2024-04-27 03:33:01.081309] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.323 [2024-04-27 03:33:01.081409] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.323 [2024-04-27 03:33:01.081434] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.323 [2024-04-27 03:33:01.081449] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.323 [2024-04-27 03:33:01.081469] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.323 [2024-04-27 03:33:01.081499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.323 qpair failed and we were unable to recover it. 00:21:36.323 [2024-04-27 03:33:01.091335] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.323 [2024-04-27 03:33:01.091435] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.323 [2024-04-27 03:33:01.091460] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.323 [2024-04-27 03:33:01.091475] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.323 [2024-04-27 03:33:01.091487] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.323 [2024-04-27 03:33:01.091516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.323 qpair failed and we were unable to recover it. 00:21:36.323 [2024-04-27 03:33:01.101380] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.323 [2024-04-27 03:33:01.101514] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.323 [2024-04-27 03:33:01.101539] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.101560] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.101573] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.101601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.111380] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.111516] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.111542] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.111556] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.111569] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.111597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.121403] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.121511] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.121537] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.121558] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.121571] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.121600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.131471] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.131585] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.131611] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.131626] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.131638] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.131667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.141469] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.141586] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.141612] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.141626] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.141639] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.141667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.151483] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.151600] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.151625] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.151640] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.151653] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.151681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.161492] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.161597] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.161623] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.161638] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.161650] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.161679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.171534] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.171658] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.171684] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.171699] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.171716] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.171746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.181596] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.181711] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.181737] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.181752] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.181764] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.181793] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.191609] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.191729] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.191756] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.191771] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.191788] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.191819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.201618] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.201728] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.201755] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.201769] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.201782] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.201811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.211659] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.211761] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.211787] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.211802] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.211815] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:36.324 [2024-04-27 03:33:01.211845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.221744] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.221888] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.221918] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.221934] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.221947] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.324 [2024-04-27 03:33:01.221976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.231686] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.231796] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.231824] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.231839] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.231851] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.324 [2024-04-27 03:33:01.231879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.241735] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.324 [2024-04-27 03:33:01.241846] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.324 [2024-04-27 03:33:01.241872] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.324 [2024-04-27 03:33:01.241886] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.324 [2024-04-27 03:33:01.241899] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.324 [2024-04-27 03:33:01.241927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.324 qpair failed and we were unable to recover it. 00:21:36.324 [2024-04-27 03:33:01.251786] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.325 [2024-04-27 03:33:01.251886] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.325 [2024-04-27 03:33:01.251911] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.325 [2024-04-27 03:33:01.251925] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.325 [2024-04-27 03:33:01.251937] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.325 [2024-04-27 03:33:01.251966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.325 qpair failed and we were unable to recover it. 00:21:36.325 [2024-04-27 03:33:01.261790] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.325 [2024-04-27 03:33:01.261897] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.325 [2024-04-27 03:33:01.261923] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.325 [2024-04-27 03:33:01.261943] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.325 [2024-04-27 03:33:01.261957] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.325 [2024-04-27 03:33:01.261985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.325 qpair failed and we were unable to recover it. 00:21:36.325 [2024-04-27 03:33:01.271829] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.325 [2024-04-27 03:33:01.271948] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.325 [2024-04-27 03:33:01.271974] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.325 [2024-04-27 03:33:01.271988] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.325 [2024-04-27 03:33:01.272001] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.325 [2024-04-27 03:33:01.272029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.325 qpair failed and we were unable to recover it. 00:21:36.325 [2024-04-27 03:33:01.281829] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.325 [2024-04-27 03:33:01.281941] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.325 [2024-04-27 03:33:01.281967] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.325 [2024-04-27 03:33:01.281982] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.325 [2024-04-27 03:33:01.281994] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.325 [2024-04-27 03:33:01.282021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.325 qpair failed and we were unable to recover it. 00:21:36.325 [2024-04-27 03:33:01.291871] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.325 [2024-04-27 03:33:01.291975] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.325 [2024-04-27 03:33:01.292000] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.325 [2024-04-27 03:33:01.292014] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.325 [2024-04-27 03:33:01.292026] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.325 [2024-04-27 03:33:01.292054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.325 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.301952] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.302081] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.302108] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.302123] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.302135] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.302163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.311923] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.312021] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.312047] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.312062] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.312074] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.312103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.321947] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.322074] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.322100] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.322115] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.322127] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.322155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.331962] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.332067] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.332093] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.332108] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.332121] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.332149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.342008] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.342116] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.342141] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.342156] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.342168] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.342195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.352017] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.352118] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.352143] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.352163] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.352176] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.352203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.362083] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.362194] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.362219] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.362234] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.362254] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.362284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.372107] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.372207] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.372239] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.372261] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.372274] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.372303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.382152] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.382276] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.382302] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.382316] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.382329] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.382357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.392138] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.392241] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.392273] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.392287] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.392300] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.392327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.402182] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.402289] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.402313] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.402327] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.402340] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.402367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.412196] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.412318] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.585 [2024-04-27 03:33:01.412344] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.585 [2024-04-27 03:33:01.412358] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.585 [2024-04-27 03:33:01.412370] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.585 [2024-04-27 03:33:01.412397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.585 qpair failed and we were unable to recover it. 00:21:36.585 [2024-04-27 03:33:01.422267] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.585 [2024-04-27 03:33:01.422372] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.422398] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.422412] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.422424] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.422452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.432285] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.432418] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.432445] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.432460] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.432476] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.432505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.442459] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.442571] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.442602] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.442618] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.442631] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.442660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.452360] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.452461] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.452488] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.452503] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.452515] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.452553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.462438] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.462578] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.462605] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.462620] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.462632] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.462661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.472444] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.472560] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.472586] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.472601] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.472613] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.472642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.482417] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.482534] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.482560] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.482575] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.482587] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.482615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.492476] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.492582] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.492608] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.492622] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.492634] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.492663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.502471] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.502585] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.502610] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.502625] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.502637] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.502665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.512592] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.512724] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.512749] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.512764] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.512776] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.512804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.522510] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.522619] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.522646] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.522660] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.522673] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.522700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.532539] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.532636] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.532666] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.532681] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.532694] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.532721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.542588] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.542697] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.542722] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.542737] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.542749] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.586 [2024-04-27 03:33:01.542776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.586 qpair failed and we were unable to recover it. 00:21:36.586 [2024-04-27 03:33:01.552664] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.586 [2024-04-27 03:33:01.552813] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.586 [2024-04-27 03:33:01.552838] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.586 [2024-04-27 03:33:01.552853] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.586 [2024-04-27 03:33:01.552865] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.587 [2024-04-27 03:33:01.552892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.587 qpair failed and we were unable to recover it. 00:21:36.848 [2024-04-27 03:33:01.562634] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.562742] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.849 [2024-04-27 03:33:01.562768] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.849 [2024-04-27 03:33:01.562783] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.849 [2024-04-27 03:33:01.562796] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.849 [2024-04-27 03:33:01.562824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.849 qpair failed and we were unable to recover it. 00:21:36.849 [2024-04-27 03:33:01.572644] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.572748] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.849 [2024-04-27 03:33:01.572774] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.849 [2024-04-27 03:33:01.572789] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.849 [2024-04-27 03:33:01.572801] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.849 [2024-04-27 03:33:01.572835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.849 qpair failed and we were unable to recover it. 00:21:36.849 [2024-04-27 03:33:01.582703] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.582812] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.849 [2024-04-27 03:33:01.582838] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.849 [2024-04-27 03:33:01.582852] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.849 [2024-04-27 03:33:01.582865] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.849 [2024-04-27 03:33:01.582893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.849 qpair failed and we were unable to recover it. 00:21:36.849 [2024-04-27 03:33:01.592768] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.592870] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.849 [2024-04-27 03:33:01.592896] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.849 [2024-04-27 03:33:01.592911] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.849 [2024-04-27 03:33:01.592923] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.849 [2024-04-27 03:33:01.592951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.849 qpair failed and we were unable to recover it. 00:21:36.849 [2024-04-27 03:33:01.602739] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.602876] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.849 [2024-04-27 03:33:01.602902] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.849 [2024-04-27 03:33:01.602917] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.849 [2024-04-27 03:33:01.602929] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.849 [2024-04-27 03:33:01.602956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.849 qpair failed and we were unable to recover it. 00:21:36.849 [2024-04-27 03:33:01.612802] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.612929] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.849 [2024-04-27 03:33:01.612955] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.849 [2024-04-27 03:33:01.612969] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.849 [2024-04-27 03:33:01.612981] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.849 [2024-04-27 03:33:01.613009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.849 qpair failed and we were unable to recover it. 00:21:36.849 [2024-04-27 03:33:01.622818] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.622923] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.849 [2024-04-27 03:33:01.622954] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.849 [2024-04-27 03:33:01.622969] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.849 [2024-04-27 03:33:01.622981] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.849 [2024-04-27 03:33:01.623009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.849 qpair failed and we were unable to recover it. 00:21:36.849 [2024-04-27 03:33:01.632864] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.633012] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.849 [2024-04-27 03:33:01.633038] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.849 [2024-04-27 03:33:01.633052] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.849 [2024-04-27 03:33:01.633065] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.849 [2024-04-27 03:33:01.633092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.849 qpair failed and we were unable to recover it. 00:21:36.849 [2024-04-27 03:33:01.642963] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.643070] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.849 [2024-04-27 03:33:01.643096] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.849 [2024-04-27 03:33:01.643111] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.849 [2024-04-27 03:33:01.643123] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.849 [2024-04-27 03:33:01.643151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.849 qpair failed and we were unable to recover it. 00:21:36.849 [2024-04-27 03:33:01.652860] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.652960] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.849 [2024-04-27 03:33:01.652985] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.849 [2024-04-27 03:33:01.652999] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.849 [2024-04-27 03:33:01.653012] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.849 [2024-04-27 03:33:01.653040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.849 qpair failed and we were unable to recover it. 00:21:36.849 [2024-04-27 03:33:01.662926] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.849 [2024-04-27 03:33:01.663033] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.663059] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.663074] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.663087] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.663120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.672942] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.850 [2024-04-27 03:33:01.673068] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.673094] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.673109] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.673121] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.673148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.682946] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.850 [2024-04-27 03:33:01.683050] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.683075] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.683089] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.683102] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.683130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.693008] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.850 [2024-04-27 03:33:01.693106] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.693131] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.693145] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.693157] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.693185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.703030] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.850 [2024-04-27 03:33:01.703133] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.703158] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.703172] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.703184] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.703211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.713069] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.850 [2024-04-27 03:33:01.713211] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.713261] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.713280] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.713293] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.713323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.723098] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.850 [2024-04-27 03:33:01.723210] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.723237] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.723262] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.723277] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.723307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.733136] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.850 [2024-04-27 03:33:01.733235] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.733270] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.733286] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.733299] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.733327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.743135] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.850 [2024-04-27 03:33:01.743240] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.743273] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.743287] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.743300] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.743328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.753157] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.850 [2024-04-27 03:33:01.753274] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.753300] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.753314] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.753332] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.753362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.763190] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.850 [2024-04-27 03:33:01.763320] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.850 [2024-04-27 03:33:01.763346] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.850 [2024-04-27 03:33:01.763361] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.850 [2024-04-27 03:33:01.763373] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.850 [2024-04-27 03:33:01.763401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.850 qpair failed and we were unable to recover it. 00:21:36.850 [2024-04-27 03:33:01.773238] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.851 [2024-04-27 03:33:01.773363] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.851 [2024-04-27 03:33:01.773388] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.851 [2024-04-27 03:33:01.773402] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.851 [2024-04-27 03:33:01.773415] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.851 [2024-04-27 03:33:01.773442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.851 qpair failed and we were unable to recover it. 00:21:36.851 [2024-04-27 03:33:01.783238] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.851 [2024-04-27 03:33:01.783374] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.851 [2024-04-27 03:33:01.783400] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.851 [2024-04-27 03:33:01.783414] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.851 [2024-04-27 03:33:01.783426] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.851 [2024-04-27 03:33:01.783454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.851 qpair failed and we were unable to recover it. 00:21:36.851 [2024-04-27 03:33:01.793269] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.851 [2024-04-27 03:33:01.793376] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.851 [2024-04-27 03:33:01.793401] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.851 [2024-04-27 03:33:01.793415] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.851 [2024-04-27 03:33:01.793427] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.851 [2024-04-27 03:33:01.793455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.851 qpair failed and we were unable to recover it. 00:21:36.851 [2024-04-27 03:33:01.803292] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.851 [2024-04-27 03:33:01.803397] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.851 [2024-04-27 03:33:01.803422] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.851 [2024-04-27 03:33:01.803436] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.851 [2024-04-27 03:33:01.803448] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.851 [2024-04-27 03:33:01.803476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.851 qpair failed and we were unable to recover it. 00:21:36.851 [2024-04-27 03:33:01.813396] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.851 [2024-04-27 03:33:01.813549] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.851 [2024-04-27 03:33:01.813575] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.851 [2024-04-27 03:33:01.813589] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.851 [2024-04-27 03:33:01.813601] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.851 [2024-04-27 03:33:01.813629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.851 qpair failed and we were unable to recover it. 00:21:36.851 [2024-04-27 03:33:01.823358] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.851 [2024-04-27 03:33:01.823493] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.851 [2024-04-27 03:33:01.823520] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.851 [2024-04-27 03:33:01.823534] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.851 [2024-04-27 03:33:01.823549] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:36.851 [2024-04-27 03:33:01.823577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.851 qpair failed and we were unable to recover it. 00:21:37.113 [2024-04-27 03:33:01.833386] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.113 [2024-04-27 03:33:01.833507] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.113 [2024-04-27 03:33:01.833533] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.113 [2024-04-27 03:33:01.833548] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.113 [2024-04-27 03:33:01.833561] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.113 [2024-04-27 03:33:01.833588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.113 qpair failed and we were unable to recover it. 00:21:37.113 [2024-04-27 03:33:01.843427] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.113 [2024-04-27 03:33:01.843535] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.113 [2024-04-27 03:33:01.843561] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.113 [2024-04-27 03:33:01.843575] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.113 [2024-04-27 03:33:01.843593] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.113 [2024-04-27 03:33:01.843622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.113 qpair failed and we were unable to recover it. 00:21:37.113 [2024-04-27 03:33:01.853444] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.113 [2024-04-27 03:33:01.853566] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.113 [2024-04-27 03:33:01.853591] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.113 [2024-04-27 03:33:01.853605] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.113 [2024-04-27 03:33:01.853618] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.113 [2024-04-27 03:33:01.853646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.113 qpair failed and we were unable to recover it. 00:21:37.113 [2024-04-27 03:33:01.863533] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.113 [2024-04-27 03:33:01.863671] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.113 [2024-04-27 03:33:01.863697] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.113 [2024-04-27 03:33:01.863712] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.113 [2024-04-27 03:33:01.863724] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.113 [2024-04-27 03:33:01.863752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.113 qpair failed and we were unable to recover it. 00:21:37.113 [2024-04-27 03:33:01.873525] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.113 [2024-04-27 03:33:01.873634] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.113 [2024-04-27 03:33:01.873660] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.113 [2024-04-27 03:33:01.873674] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.113 [2024-04-27 03:33:01.873687] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.113 [2024-04-27 03:33:01.873715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.113 qpair failed and we were unable to recover it. 00:21:37.113 [2024-04-27 03:33:01.883540] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.113 [2024-04-27 03:33:01.883646] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.113 [2024-04-27 03:33:01.883674] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.113 [2024-04-27 03:33:01.883689] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.113 [2024-04-27 03:33:01.883702] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.113 [2024-04-27 03:33:01.883731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.113 qpair failed and we were unable to recover it. 00:21:37.113 [2024-04-27 03:33:01.893542] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.113 [2024-04-27 03:33:01.893655] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.113 [2024-04-27 03:33:01.893681] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.113 [2024-04-27 03:33:01.893695] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.113 [2024-04-27 03:33:01.893707] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.113 [2024-04-27 03:33:01.893736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.113 qpair failed and we were unable to recover it. 00:21:37.113 [2024-04-27 03:33:01.903606] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.113 [2024-04-27 03:33:01.903717] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.113 [2024-04-27 03:33:01.903742] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.113 [2024-04-27 03:33:01.903757] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.113 [2024-04-27 03:33:01.903769] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.113 [2024-04-27 03:33:01.903796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.113 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:01.913629] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:01.913748] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:01.913774] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:01.913788] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:01.913801] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:01.913829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:01.923630] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:01.923758] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:01.923783] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:01.923797] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:01.923809] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:01.923837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:01.933659] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:01.933807] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:01.933833] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:01.933847] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:01.933864] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:01.933893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:01.943837] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:01.943949] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:01.943973] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:01.943988] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:01.944000] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:01.944028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:01.953782] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:01.953927] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:01.953952] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:01.953966] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:01.953978] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:01.954005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:01.963733] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:01.963842] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:01.963872] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:01.963888] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:01.963900] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:01.963930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:01.973799] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:01.973909] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:01.973936] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:01.973950] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:01.973962] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:01.973991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:01.983823] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:01.983979] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:01.984005] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:01.984019] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:01.984031] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:01.984059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:01.993842] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:01.993942] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:01.993968] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:01.993982] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:01.993994] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:01.994022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:02.003906] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:02.004014] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:02.004039] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:02.004055] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:02.004067] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:02.004095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:02.013951] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:02.014053] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:02.014078] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:02.014092] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:02.014105] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:02.014132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:02.023938] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:02.024049] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:02.024073] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:02.024094] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:02.024106] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:02.024134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:02.033949] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:02.034054] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:02.034079] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:02.034094] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.114 [2024-04-27 03:33:02.034106] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.114 [2024-04-27 03:33:02.034133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.114 qpair failed and we were unable to recover it. 00:21:37.114 [2024-04-27 03:33:02.043978] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.114 [2024-04-27 03:33:02.044082] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.114 [2024-04-27 03:33:02.044107] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.114 [2024-04-27 03:33:02.044121] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.115 [2024-04-27 03:33:02.044133] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.115 [2024-04-27 03:33:02.044161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.115 qpair failed and we were unable to recover it. 00:21:37.115 [2024-04-27 03:33:02.054102] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.115 [2024-04-27 03:33:02.054201] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.115 [2024-04-27 03:33:02.054226] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.115 [2024-04-27 03:33:02.054240] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.115 [2024-04-27 03:33:02.054260] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.115 [2024-04-27 03:33:02.054289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.115 qpair failed and we were unable to recover it. 00:21:37.115 [2024-04-27 03:33:02.064042] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.115 [2024-04-27 03:33:02.064154] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.115 [2024-04-27 03:33:02.064180] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.115 [2024-04-27 03:33:02.064194] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.115 [2024-04-27 03:33:02.064206] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.115 [2024-04-27 03:33:02.064233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.115 qpair failed and we were unable to recover it. 00:21:37.115 [2024-04-27 03:33:02.074063] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.115 [2024-04-27 03:33:02.074196] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.115 [2024-04-27 03:33:02.074221] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.115 [2024-04-27 03:33:02.074235] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.115 [2024-04-27 03:33:02.074253] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.115 [2024-04-27 03:33:02.074282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.115 qpair failed and we were unable to recover it. 00:21:37.115 [2024-04-27 03:33:02.084092] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.115 [2024-04-27 03:33:02.084196] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.115 [2024-04-27 03:33:02.084223] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.115 [2024-04-27 03:33:02.084238] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.115 [2024-04-27 03:33:02.084259] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.115 [2024-04-27 03:33:02.084288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.115 qpair failed and we were unable to recover it. 00:21:37.377 [2024-04-27 03:33:02.094148] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.377 [2024-04-27 03:33:02.094272] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.377 [2024-04-27 03:33:02.094299] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.377 [2024-04-27 03:33:02.094325] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.377 [2024-04-27 03:33:02.094342] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.377 [2024-04-27 03:33:02.094375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.377 qpair failed and we were unable to recover it. 00:21:37.377 [2024-04-27 03:33:02.104173] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.377 [2024-04-27 03:33:02.104280] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.377 [2024-04-27 03:33:02.104306] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.377 [2024-04-27 03:33:02.104321] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.377 [2024-04-27 03:33:02.104333] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.377 [2024-04-27 03:33:02.104360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.377 qpair failed and we were unable to recover it. 00:21:37.377 [2024-04-27 03:33:02.114199] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.377 [2024-04-27 03:33:02.114322] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.377 [2024-04-27 03:33:02.114348] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.377 [2024-04-27 03:33:02.114368] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.377 [2024-04-27 03:33:02.114381] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.377 [2024-04-27 03:33:02.114409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.377 qpair failed and we were unable to recover it. 00:21:37.377 [2024-04-27 03:33:02.124204] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.377 [2024-04-27 03:33:02.124328] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.377 [2024-04-27 03:33:02.124353] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.377 [2024-04-27 03:33:02.124367] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.377 [2024-04-27 03:33:02.124379] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.377 [2024-04-27 03:33:02.124407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.377 qpair failed and we were unable to recover it. 00:21:37.377 [2024-04-27 03:33:02.134285] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.377 [2024-04-27 03:33:02.134398] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.377 [2024-04-27 03:33:02.134423] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.377 [2024-04-27 03:33:02.134438] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.377 [2024-04-27 03:33:02.134450] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.377 [2024-04-27 03:33:02.134477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.377 qpair failed and we were unable to recover it. 00:21:37.377 [2024-04-27 03:33:02.144280] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.377 [2024-04-27 03:33:02.144399] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.377 [2024-04-27 03:33:02.144426] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.377 [2024-04-27 03:33:02.144441] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.377 [2024-04-27 03:33:02.144453] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.377 [2024-04-27 03:33:02.144482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.377 qpair failed and we were unable to recover it. 00:21:37.377 [2024-04-27 03:33:02.154340] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.377 [2024-04-27 03:33:02.154447] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.377 [2024-04-27 03:33:02.154473] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.377 [2024-04-27 03:33:02.154488] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.377 [2024-04-27 03:33:02.154500] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.377 [2024-04-27 03:33:02.154529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.377 qpair failed and we were unable to recover it. 00:21:37.377 [2024-04-27 03:33:02.164331] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.377 [2024-04-27 03:33:02.164438] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.377 [2024-04-27 03:33:02.164463] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.377 [2024-04-27 03:33:02.164477] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.377 [2024-04-27 03:33:02.164490] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.377 [2024-04-27 03:33:02.164518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.377 qpair failed and we were unable to recover it. 00:21:37.377 [2024-04-27 03:33:02.174337] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.174444] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.174470] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.174484] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.174496] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.174524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.184400] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.184516] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.184542] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.184556] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.184568] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.184596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.194398] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.194502] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.194527] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.194541] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.194554] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.194581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.204448] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.204555] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.204580] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.204600] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.204612] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.204640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.214474] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.214586] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.214611] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.214625] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.214637] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.214667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.224532] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.224682] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.224708] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.224723] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.224735] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.224763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.234526] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.234658] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.234684] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.234699] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.234711] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.234739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.244543] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.244644] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.244670] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.244684] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.244696] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.244724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.254565] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.254721] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.254746] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.254760] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.254772] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.254800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.264628] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.264753] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.264779] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.264793] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.264808] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.264836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.274629] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.274733] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.274758] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.274773] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.274785] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.274813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.284656] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.284752] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.284777] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.284792] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.284804] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.284833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.294706] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.294809] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.294840] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.294856] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.294868] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.378 [2024-04-27 03:33:02.294897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.378 qpair failed and we were unable to recover it. 00:21:37.378 [2024-04-27 03:33:02.304749] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.378 [2024-04-27 03:33:02.304892] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.378 [2024-04-27 03:33:02.304917] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.378 [2024-04-27 03:33:02.304932] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.378 [2024-04-27 03:33:02.304944] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.379 [2024-04-27 03:33:02.304971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.379 qpair failed and we were unable to recover it. 00:21:37.379 [2024-04-27 03:33:02.314734] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.379 [2024-04-27 03:33:02.314836] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.379 [2024-04-27 03:33:02.314862] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.379 [2024-04-27 03:33:02.314876] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.379 [2024-04-27 03:33:02.314888] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.379 [2024-04-27 03:33:02.314916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.379 qpair failed and we were unable to recover it. 00:21:37.379 [2024-04-27 03:33:02.324764] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.379 [2024-04-27 03:33:02.324869] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.379 [2024-04-27 03:33:02.324894] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.379 [2024-04-27 03:33:02.324908] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.379 [2024-04-27 03:33:02.324920] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.379 [2024-04-27 03:33:02.324948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.379 qpair failed and we were unable to recover it. 00:21:37.379 [2024-04-27 03:33:02.334794] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.379 [2024-04-27 03:33:02.334907] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.379 [2024-04-27 03:33:02.334932] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.379 [2024-04-27 03:33:02.334947] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.379 [2024-04-27 03:33:02.334959] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.379 [2024-04-27 03:33:02.334992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.379 qpair failed and we were unable to recover it. 00:21:37.379 [2024-04-27 03:33:02.344831] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.379 [2024-04-27 03:33:02.344939] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.379 [2024-04-27 03:33:02.344964] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.379 [2024-04-27 03:33:02.344978] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.379 [2024-04-27 03:33:02.344990] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.379 [2024-04-27 03:33:02.345018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.379 qpair failed and we were unable to recover it. 00:21:37.640 [2024-04-27 03:33:02.354861] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.640 [2024-04-27 03:33:02.354996] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.640 [2024-04-27 03:33:02.355022] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.640 [2024-04-27 03:33:02.355037] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.640 [2024-04-27 03:33:02.355049] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.640 [2024-04-27 03:33:02.355077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.640 qpair failed and we were unable to recover it. 00:21:37.640 [2024-04-27 03:33:02.364882] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.640 [2024-04-27 03:33:02.364988] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.640 [2024-04-27 03:33:02.365014] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.640 [2024-04-27 03:33:02.365028] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.640 [2024-04-27 03:33:02.365040] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.640 [2024-04-27 03:33:02.365069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.640 qpair failed and we were unable to recover it. 00:21:37.640 [2024-04-27 03:33:02.374886] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.640 [2024-04-27 03:33:02.375000] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.640 [2024-04-27 03:33:02.375026] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.640 [2024-04-27 03:33:02.375040] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.640 [2024-04-27 03:33:02.375053] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.640 [2024-04-27 03:33:02.375081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.640 qpair failed and we were unable to recover it. 00:21:37.640 [2024-04-27 03:33:02.384964] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.640 [2024-04-27 03:33:02.385099] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.640 [2024-04-27 03:33:02.385130] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.640 [2024-04-27 03:33:02.385145] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.640 [2024-04-27 03:33:02.385157] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.640 [2024-04-27 03:33:02.385185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.640 qpair failed and we were unable to recover it. 00:21:37.640 [2024-04-27 03:33:02.394955] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.640 [2024-04-27 03:33:02.395085] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.640 [2024-04-27 03:33:02.395111] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.640 [2024-04-27 03:33:02.395125] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.640 [2024-04-27 03:33:02.395137] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.640 [2024-04-27 03:33:02.395165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.640 qpair failed and we were unable to recover it. 00:21:37.640 [2024-04-27 03:33:02.404995] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.640 [2024-04-27 03:33:02.405096] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.640 [2024-04-27 03:33:02.405121] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.640 [2024-04-27 03:33:02.405135] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.405147] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.405174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.415017] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.415158] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.415183] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.415197] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.415210] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.415237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.425061] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.425178] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.425202] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.425217] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.425229] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.425269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.435066] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.435166] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.435191] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.435205] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.435217] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.435245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.445098] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.445224] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.445256] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.445273] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.445285] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.445313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.455120] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.455223] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.455254] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.455270] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.455282] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.455310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.465187] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.465313] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.465343] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.465359] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.465371] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.465400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.475189] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.475298] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.475330] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.475346] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.475358] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.475387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.485206] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.485310] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.485336] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.485350] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.485362] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.485390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.495279] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.495384] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.495410] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.495424] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.495437] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.495464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.505294] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.505403] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.505428] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.505442] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.505454] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.505482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.515316] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.515436] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.515461] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.515475] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.515487] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.515520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.525333] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.525434] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.525459] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.525473] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.525485] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.525513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.535386] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.641 [2024-04-27 03:33:02.535530] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.641 [2024-04-27 03:33:02.535556] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.641 [2024-04-27 03:33:02.535570] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.641 [2024-04-27 03:33:02.535582] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.641 [2024-04-27 03:33:02.535610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.641 qpair failed and we were unable to recover it. 00:21:37.641 [2024-04-27 03:33:02.545405] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.642 [2024-04-27 03:33:02.545527] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.642 [2024-04-27 03:33:02.545553] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.642 [2024-04-27 03:33:02.545567] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.642 [2024-04-27 03:33:02.545579] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.642 [2024-04-27 03:33:02.545607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.642 qpair failed and we were unable to recover it. 00:21:37.642 [2024-04-27 03:33:02.555418] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.642 [2024-04-27 03:33:02.555521] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.642 [2024-04-27 03:33:02.555546] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.642 [2024-04-27 03:33:02.555560] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.642 [2024-04-27 03:33:02.555572] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.642 [2024-04-27 03:33:02.555600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.642 qpair failed and we were unable to recover it. 00:21:37.642 [2024-04-27 03:33:02.565459] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.642 [2024-04-27 03:33:02.565591] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.642 [2024-04-27 03:33:02.565622] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.642 [2024-04-27 03:33:02.565637] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.642 [2024-04-27 03:33:02.565649] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.642 [2024-04-27 03:33:02.565677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.642 qpair failed and we were unable to recover it. 00:21:37.642 [2024-04-27 03:33:02.575502] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.642 [2024-04-27 03:33:02.575607] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.642 [2024-04-27 03:33:02.575632] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.642 [2024-04-27 03:33:02.575646] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.642 [2024-04-27 03:33:02.575658] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.642 [2024-04-27 03:33:02.575685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.642 qpair failed and we were unable to recover it. 00:21:37.642 [2024-04-27 03:33:02.585541] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.642 [2024-04-27 03:33:02.585647] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.642 [2024-04-27 03:33:02.585672] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.642 [2024-04-27 03:33:02.585686] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.642 [2024-04-27 03:33:02.585699] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.642 [2024-04-27 03:33:02.585726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.642 qpair failed and we were unable to recover it. 00:21:37.642 [2024-04-27 03:33:02.595538] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.642 [2024-04-27 03:33:02.595645] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.642 [2024-04-27 03:33:02.595670] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.642 [2024-04-27 03:33:02.595684] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.642 [2024-04-27 03:33:02.595697] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.642 [2024-04-27 03:33:02.595724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.642 qpair failed and we were unable to recover it. 00:21:37.642 [2024-04-27 03:33:02.605571] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.642 [2024-04-27 03:33:02.605682] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.642 [2024-04-27 03:33:02.605708] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.642 [2024-04-27 03:33:02.605722] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.642 [2024-04-27 03:33:02.605740] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.642 [2024-04-27 03:33:02.605768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.642 qpair failed and we were unable to recover it. 00:21:37.642 [2024-04-27 03:33:02.615586] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.642 [2024-04-27 03:33:02.615717] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.642 [2024-04-27 03:33:02.615743] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.642 [2024-04-27 03:33:02.615758] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.642 [2024-04-27 03:33:02.615770] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.642 [2024-04-27 03:33:02.615797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.642 qpair failed and we were unable to recover it. 00:21:37.908 [2024-04-27 03:33:02.625663] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.908 [2024-04-27 03:33:02.625779] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.908 [2024-04-27 03:33:02.625805] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.908 [2024-04-27 03:33:02.625820] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.908 [2024-04-27 03:33:02.625833] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.908 [2024-04-27 03:33:02.625861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.908 qpair failed and we were unable to recover it. 00:21:37.908 [2024-04-27 03:33:02.635664] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.908 [2024-04-27 03:33:02.635772] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.908 [2024-04-27 03:33:02.635797] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.908 [2024-04-27 03:33:02.635812] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.908 [2024-04-27 03:33:02.635824] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.908 [2024-04-27 03:33:02.635852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.908 qpair failed and we were unable to recover it. 00:21:37.908 [2024-04-27 03:33:02.645695] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.908 [2024-04-27 03:33:02.645802] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.908 [2024-04-27 03:33:02.645828] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.908 [2024-04-27 03:33:02.645842] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.908 [2024-04-27 03:33:02.645854] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.908 [2024-04-27 03:33:02.645882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.908 qpair failed and we were unable to recover it. 00:21:37.908 [2024-04-27 03:33:02.655756] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.908 [2024-04-27 03:33:02.655878] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.908 [2024-04-27 03:33:02.655903] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.908 [2024-04-27 03:33:02.655918] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.908 [2024-04-27 03:33:02.655930] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.908 [2024-04-27 03:33:02.655958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.908 qpair failed and we were unable to recover it. 00:21:37.908 [2024-04-27 03:33:02.665794] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.908 [2024-04-27 03:33:02.665905] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.908 [2024-04-27 03:33:02.665931] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.908 [2024-04-27 03:33:02.665945] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.908 [2024-04-27 03:33:02.665957] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.908 [2024-04-27 03:33:02.665984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.908 qpair failed and we were unable to recover it. 00:21:37.908 [2024-04-27 03:33:02.675785] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.908 [2024-04-27 03:33:02.675890] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.908 [2024-04-27 03:33:02.675915] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.908 [2024-04-27 03:33:02.675929] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.908 [2024-04-27 03:33:02.675941] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.908 [2024-04-27 03:33:02.675969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.908 qpair failed and we were unable to recover it. 00:21:37.908 [2024-04-27 03:33:02.685829] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.908 [2024-04-27 03:33:02.685937] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.908 [2024-04-27 03:33:02.685961] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.908 [2024-04-27 03:33:02.685976] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.908 [2024-04-27 03:33:02.685988] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.908 [2024-04-27 03:33:02.686015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.695849] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.909 [2024-04-27 03:33:02.695959] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.909 [2024-04-27 03:33:02.695985] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.909 [2024-04-27 03:33:02.695999] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.909 [2024-04-27 03:33:02.696020] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.909 [2024-04-27 03:33:02.696048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.705866] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.909 [2024-04-27 03:33:02.705973] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.909 [2024-04-27 03:33:02.705998] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.909 [2024-04-27 03:33:02.706012] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.909 [2024-04-27 03:33:02.706024] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.909 [2024-04-27 03:33:02.706051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.715889] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.909 [2024-04-27 03:33:02.716004] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.909 [2024-04-27 03:33:02.716032] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.909 [2024-04-27 03:33:02.716048] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.909 [2024-04-27 03:33:02.716060] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.909 [2024-04-27 03:33:02.716089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.725980] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.909 [2024-04-27 03:33:02.726078] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.909 [2024-04-27 03:33:02.726104] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.909 [2024-04-27 03:33:02.726118] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.909 [2024-04-27 03:33:02.726130] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.909 [2024-04-27 03:33:02.726159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.735942] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.909 [2024-04-27 03:33:02.736074] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.909 [2024-04-27 03:33:02.736100] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.909 [2024-04-27 03:33:02.736115] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.909 [2024-04-27 03:33:02.736127] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.909 [2024-04-27 03:33:02.736155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.745974] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.909 [2024-04-27 03:33:02.746087] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.909 [2024-04-27 03:33:02.746113] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.909 [2024-04-27 03:33:02.746129] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.909 [2024-04-27 03:33:02.746141] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.909 [2024-04-27 03:33:02.746169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.756016] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.909 [2024-04-27 03:33:02.756135] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.909 [2024-04-27 03:33:02.756162] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.909 [2024-04-27 03:33:02.756177] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.909 [2024-04-27 03:33:02.756192] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.909 [2024-04-27 03:33:02.756221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.766051] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.909 [2024-04-27 03:33:02.766160] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.909 [2024-04-27 03:33:02.766185] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.909 [2024-04-27 03:33:02.766200] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.909 [2024-04-27 03:33:02.766212] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.909 [2024-04-27 03:33:02.766240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.776054] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.909 [2024-04-27 03:33:02.776156] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.909 [2024-04-27 03:33:02.776182] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.909 [2024-04-27 03:33:02.776196] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.909 [2024-04-27 03:33:02.776209] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.909 [2024-04-27 03:33:02.776237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.786115] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.909 [2024-04-27 03:33:02.786218] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.909 [2024-04-27 03:33:02.786245] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.909 [2024-04-27 03:33:02.786274] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.909 [2024-04-27 03:33:02.786287] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.909 [2024-04-27 03:33:02.786315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.909 qpair failed and we were unable to recover it. 00:21:37.909 [2024-04-27 03:33:02.796127] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.910 [2024-04-27 03:33:02.796232] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.910 [2024-04-27 03:33:02.796266] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.910 [2024-04-27 03:33:02.796281] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.910 [2024-04-27 03:33:02.796295] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.910 [2024-04-27 03:33:02.796323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.910 qpair failed and we were unable to recover it. 00:21:37.910 [2024-04-27 03:33:02.806142] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.910 [2024-04-27 03:33:02.806254] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.910 [2024-04-27 03:33:02.806280] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.910 [2024-04-27 03:33:02.806294] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.910 [2024-04-27 03:33:02.806307] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.910 [2024-04-27 03:33:02.806335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.910 qpair failed and we were unable to recover it. 00:21:37.910 [2024-04-27 03:33:02.816161] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.910 [2024-04-27 03:33:02.816273] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.910 [2024-04-27 03:33:02.816298] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.910 [2024-04-27 03:33:02.816313] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.910 [2024-04-27 03:33:02.816325] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.910 [2024-04-27 03:33:02.816353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.910 qpair failed and we were unable to recover it. 00:21:37.910 [2024-04-27 03:33:02.826295] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.910 [2024-04-27 03:33:02.826454] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.910 [2024-04-27 03:33:02.826479] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.910 [2024-04-27 03:33:02.826494] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.910 [2024-04-27 03:33:02.826506] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.910 [2024-04-27 03:33:02.826534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.910 qpair failed and we were unable to recover it. 00:21:37.910 [2024-04-27 03:33:02.836273] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.910 [2024-04-27 03:33:02.836384] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.910 [2024-04-27 03:33:02.836409] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.910 [2024-04-27 03:33:02.836423] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.910 [2024-04-27 03:33:02.836435] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.910 [2024-04-27 03:33:02.836463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.910 qpair failed and we were unable to recover it. 00:21:37.910 [2024-04-27 03:33:02.846282] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.910 [2024-04-27 03:33:02.846403] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.910 [2024-04-27 03:33:02.846428] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.910 [2024-04-27 03:33:02.846443] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.910 [2024-04-27 03:33:02.846455] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.910 [2024-04-27 03:33:02.846483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.910 qpair failed and we were unable to recover it. 00:21:37.910 [2024-04-27 03:33:02.856286] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.910 [2024-04-27 03:33:02.856385] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.910 [2024-04-27 03:33:02.856410] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.910 [2024-04-27 03:33:02.856425] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.910 [2024-04-27 03:33:02.856437] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.910 [2024-04-27 03:33:02.856465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.910 qpair failed and we were unable to recover it. 00:21:37.910 [2024-04-27 03:33:02.866333] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.910 [2024-04-27 03:33:02.866464] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.910 [2024-04-27 03:33:02.866489] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.910 [2024-04-27 03:33:02.866503] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.910 [2024-04-27 03:33:02.866515] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.910 [2024-04-27 03:33:02.866543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.910 qpair failed and we were unable to recover it. 00:21:37.910 [2024-04-27 03:33:02.876336] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:37.910 [2024-04-27 03:33:02.876476] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:37.910 [2024-04-27 03:33:02.876503] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:37.910 [2024-04-27 03:33:02.876523] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:37.910 [2024-04-27 03:33:02.876536] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:37.910 [2024-04-27 03:33:02.876565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:37.910 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.886370] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.886485] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.886511] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.886525] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.886538] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.886566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.896375] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.896519] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.896544] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.896559] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.896571] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.896600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.906421] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.906563] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.906588] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.906603] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.906615] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.906643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.916465] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.916583] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.916608] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.916623] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.916635] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.916662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.926498] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.926601] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.926626] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.926640] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.926653] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.926680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.936514] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.936616] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.936641] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.936656] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.936668] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.936696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.946542] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.946655] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.946680] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.946694] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.946707] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.946734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.956533] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.956634] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.956659] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.956673] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.956686] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.956714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.966654] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.966802] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.966828] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.966848] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.966861] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.966897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.976597] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.976727] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.976754] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.976769] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.976781] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.976810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.986650] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.986760] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.986786] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.986800] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.986813] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.986840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:02.996749] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:02.996849] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:02.996875] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.172 [2024-04-27 03:33:02.996889] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.172 [2024-04-27 03:33:02.996901] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.172 [2024-04-27 03:33:02.996929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.172 qpair failed and we were unable to recover it. 00:21:38.172 [2024-04-27 03:33:03.006700] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.172 [2024-04-27 03:33:03.006811] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.172 [2024-04-27 03:33:03.006836] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.006850] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.006862] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.006890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.016698] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.016800] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.016825] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.016840] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.016852] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.016880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.026768] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.026894] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.026919] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.026934] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.026946] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.026974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.036846] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.036949] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.036975] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.036989] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.037001] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.037029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.046825] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.046953] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.046978] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.046993] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.047005] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.047032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.056843] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.056962] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.056992] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.057007] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.057019] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.057047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.066870] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.066988] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.067015] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.067030] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.067043] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.067071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.076876] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.076997] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.077023] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.077038] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.077050] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.077078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.086901] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.087017] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.087042] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.087057] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.087069] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.087097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.096919] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.097019] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.097045] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.097059] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.097071] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.097104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.107009] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.107116] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.107142] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.107156] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.107168] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.107196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.117031] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.117182] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.117208] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.117223] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.117235] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.117272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.127024] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.127172] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.127197] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.127212] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.127224] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.127261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.137034] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.137137] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.137162] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.137177] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.137189] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.137217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.173 [2024-04-27 03:33:03.147072] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.173 [2024-04-27 03:33:03.147182] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.173 [2024-04-27 03:33:03.147213] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.173 [2024-04-27 03:33:03.147228] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.173 [2024-04-27 03:33:03.147241] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.173 [2024-04-27 03:33:03.147277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.173 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.157094] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.157199] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.157225] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.157240] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.157260] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.157290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.167115] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.167214] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.167240] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.167262] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.167275] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.167303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.177172] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.177302] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.177327] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.177341] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.177354] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.177382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.187258] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.187369] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.187394] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.187409] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.187421] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.187454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.197210] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.197323] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.197348] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.197363] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.197375] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.197403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.207373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.207487] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.207513] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.207527] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.207540] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.207567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.217266] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.217399] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.217425] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.217440] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.217452] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.217481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.227315] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.227452] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.227478] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.227493] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.227505] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.227534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.237361] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.237490] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.237521] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.237539] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.237551] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.237579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.247384] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.247527] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.247553] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.247568] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.247580] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.247607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.257373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.257498] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.257522] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.257536] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.257548] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.257576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.267450] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.432 [2024-04-27 03:33:03.267597] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.432 [2024-04-27 03:33:03.267622] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.432 [2024-04-27 03:33:03.267636] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.432 [2024-04-27 03:33:03.267648] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.432 [2024-04-27 03:33:03.267676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.432 qpair failed and we were unable to recover it. 00:21:38.432 [2024-04-27 03:33:03.277459] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.277582] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.277607] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.277621] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.277634] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.277667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.287450] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.287556] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.287582] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.287596] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.287608] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.287635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.297593] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.297698] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.297723] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.297737] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.297749] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.297777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.307526] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.307632] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.307657] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.307671] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.307684] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.307711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.317583] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.317708] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.317732] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.317747] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.317759] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.317787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.327599] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.327730] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.327760] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.327775] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.327787] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.327815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.337598] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.337716] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.337742] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.337756] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.337768] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.337796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.347665] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.347792] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.347816] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.347831] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.347843] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.347871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.357669] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.357775] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.357800] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.357814] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.357826] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.357854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.367708] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.367825] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.367850] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.367864] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.367882] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.367910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.377739] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.377843] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.377868] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.377883] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.377895] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.377923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.387752] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.387861] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.387886] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.387900] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.387912] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.387940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.397766] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.397869] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.397894] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.397908] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.397920] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.433 [2024-04-27 03:33:03.397948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.433 qpair failed and we were unable to recover it. 00:21:38.433 [2024-04-27 03:33:03.407830] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.433 [2024-04-27 03:33:03.407962] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.433 [2024-04-27 03:33:03.407988] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.433 [2024-04-27 03:33:03.408002] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.433 [2024-04-27 03:33:03.408015] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.434 [2024-04-27 03:33:03.408042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.434 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.417838] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.417966] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.417991] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.418006] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.418018] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.695 [2024-04-27 03:33:03.418046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.427927] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.428036] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.428061] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.428075] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.428087] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.695 [2024-04-27 03:33:03.428115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.437873] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.438008] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.438033] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.438047] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.438059] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.695 [2024-04-27 03:33:03.438087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.447990] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.448100] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.448124] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.448139] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.448151] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.695 [2024-04-27 03:33:03.448179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.457988] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.458122] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.458147] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.458162] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.458183] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.695 [2024-04-27 03:33:03.458212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.468021] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.468137] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.468167] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.468183] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.468195] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:38.695 [2024-04-27 03:33:03.468224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.478033] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.478142] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.478175] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.478191] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.478204] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.695 [2024-04-27 03:33:03.478253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.488108] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.488211] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.488242] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.488267] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.488280] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.695 [2024-04-27 03:33:03.488311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.498078] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.498183] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.498210] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.498226] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.498242] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.695 [2024-04-27 03:33:03.498281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.508164] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.508284] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.508311] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.508326] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.508339] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.695 [2024-04-27 03:33:03.508368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.518129] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.695 [2024-04-27 03:33:03.518232] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.695 [2024-04-27 03:33:03.518267] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.695 [2024-04-27 03:33:03.518283] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.695 [2024-04-27 03:33:03.518296] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.695 [2024-04-27 03:33:03.518326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.695 qpair failed and we were unable to recover it. 00:21:38.695 [2024-04-27 03:33:03.528161] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.528280] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.528308] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.528323] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.528339] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.528368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.538186] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.538308] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.538335] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.538350] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.538363] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.538393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.548292] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.548441] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.548468] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.548488] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.548502] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.548531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.558266] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.558383] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.558409] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.558424] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.558437] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.558466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.568241] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.568389] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.568416] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.568431] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.568444] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.568473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.578304] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.578420] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.578447] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.578462] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.578475] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.578504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.588404] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.588513] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.588539] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.588554] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.588566] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.588596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.598318] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.598422] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.598448] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.598462] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.598475] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.598504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.608377] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.608484] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.608510] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.608524] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.608537] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.608566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.618431] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.618580] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.618611] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.618627] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.618643] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.618675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.628448] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.628560] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.628586] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.628601] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.628614] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.628643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.638437] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.638558] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.638584] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.638604] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.638618] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.696 [2024-04-27 03:33:03.638649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.696 qpair failed and we were unable to recover it. 00:21:38.696 [2024-04-27 03:33:03.648485] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.696 [2024-04-27 03:33:03.648610] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.696 [2024-04-27 03:33:03.648635] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.696 [2024-04-27 03:33:03.648650] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.696 [2024-04-27 03:33:03.648663] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.697 [2024-04-27 03:33:03.648692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.697 qpair failed and we were unable to recover it. 00:21:38.697 [2024-04-27 03:33:03.658512] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.697 [2024-04-27 03:33:03.658654] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.697 [2024-04-27 03:33:03.658681] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.697 [2024-04-27 03:33:03.658696] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.697 [2024-04-27 03:33:03.658708] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.697 [2024-04-27 03:33:03.658737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.697 qpair failed and we were unable to recover it. 00:21:38.697 [2024-04-27 03:33:03.668536] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.697 [2024-04-27 03:33:03.668648] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.697 [2024-04-27 03:33:03.668674] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.697 [2024-04-27 03:33:03.668689] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.697 [2024-04-27 03:33:03.668701] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.697 [2024-04-27 03:33:03.668730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.697 qpair failed and we were unable to recover it. 00:21:38.956 [2024-04-27 03:33:03.678618] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.956 [2024-04-27 03:33:03.678750] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.956 [2024-04-27 03:33:03.678776] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.956 [2024-04-27 03:33:03.678791] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.956 [2024-04-27 03:33:03.678804] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.956 [2024-04-27 03:33:03.678846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.956 qpair failed and we were unable to recover it. 00:21:38.956 [2024-04-27 03:33:03.688580] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.956 [2024-04-27 03:33:03.688713] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.956 [2024-04-27 03:33:03.688739] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.956 [2024-04-27 03:33:03.688754] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.956 [2024-04-27 03:33:03.688766] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.956 [2024-04-27 03:33:03.688795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.956 qpair failed and we were unable to recover it. 00:21:38.956 [2024-04-27 03:33:03.698645] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.956 [2024-04-27 03:33:03.698794] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.956 [2024-04-27 03:33:03.698820] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.956 [2024-04-27 03:33:03.698834] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.956 [2024-04-27 03:33:03.698847] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.956 [2024-04-27 03:33:03.698888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.956 qpair failed and we were unable to recover it. 00:21:38.956 [2024-04-27 03:33:03.708659] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.956 [2024-04-27 03:33:03.708763] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.956 [2024-04-27 03:33:03.708790] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.956 [2024-04-27 03:33:03.708804] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.956 [2024-04-27 03:33:03.708817] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.956 [2024-04-27 03:33:03.708846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.956 qpair failed and we were unable to recover it. 00:21:38.956 [2024-04-27 03:33:03.718663] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.956 [2024-04-27 03:33:03.718768] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.956 [2024-04-27 03:33:03.718792] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.956 [2024-04-27 03:33:03.718806] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.956 [2024-04-27 03:33:03.718818] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.956 [2024-04-27 03:33:03.718848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.956 qpair failed and we were unable to recover it. 00:21:38.956 [2024-04-27 03:33:03.728683] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.956 [2024-04-27 03:33:03.728786] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.956 [2024-04-27 03:33:03.728819] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.956 [2024-04-27 03:33:03.728835] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.956 [2024-04-27 03:33:03.728848] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.956 [2024-04-27 03:33:03.728877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.956 qpair failed and we were unable to recover it. 00:21:38.956 [2024-04-27 03:33:03.738735] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.956 [2024-04-27 03:33:03.738853] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.956 [2024-04-27 03:33:03.738879] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.956 [2024-04-27 03:33:03.738894] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.956 [2024-04-27 03:33:03.738906] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.956 [2024-04-27 03:33:03.738948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.956 qpair failed and we were unable to recover it. 00:21:38.956 [2024-04-27 03:33:03.748752] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.956 [2024-04-27 03:33:03.748862] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.956 [2024-04-27 03:33:03.748889] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.956 [2024-04-27 03:33:03.748903] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.956 [2024-04-27 03:33:03.748915] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.956 [2024-04-27 03:33:03.748945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.956 qpair failed and we were unable to recover it. 00:21:38.956 [2024-04-27 03:33:03.758779] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.956 [2024-04-27 03:33:03.758906] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.956 [2024-04-27 03:33:03.758932] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.956 [2024-04-27 03:33:03.758947] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.758959] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.758988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.768794] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.768911] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.768937] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.768952] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.768968] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.769002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.778824] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.778922] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.778948] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.778962] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.778974] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.779003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.788911] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.789055] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.789080] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.789095] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.789108] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.789137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.798925] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.799050] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.799076] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.799090] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.799103] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.799132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.808922] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.809025] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.809051] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.809065] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.809078] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.809107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.818960] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.819066] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.819100] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.819116] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.819129] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.819158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.828994] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.829101] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.829127] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.829142] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.829154] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.829183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.839030] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.839139] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.839165] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.839179] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.839192] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.839233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.849088] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.849214] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.849240] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.849266] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.849279] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.849309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.859099] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.859207] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.859233] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.859256] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.859276] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.859308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.869105] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.869219] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.869251] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.869268] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.869281] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.869310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.879174] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.879307] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.879332] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.879347] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.879359] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.879388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.889163] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.957 [2024-04-27 03:33:03.889281] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.957 [2024-04-27 03:33:03.889307] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.957 [2024-04-27 03:33:03.889321] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.957 [2024-04-27 03:33:03.889334] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.957 [2024-04-27 03:33:03.889364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.957 qpair failed and we were unable to recover it. 00:21:38.957 [2024-04-27 03:33:03.899235] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.958 [2024-04-27 03:33:03.899347] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.958 [2024-04-27 03:33:03.899373] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.958 [2024-04-27 03:33:03.899387] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.958 [2024-04-27 03:33:03.899399] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.958 [2024-04-27 03:33:03.899445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.958 qpair failed and we were unable to recover it. 00:21:38.958 [2024-04-27 03:33:03.909235] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.958 [2024-04-27 03:33:03.909375] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.958 [2024-04-27 03:33:03.909401] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.958 [2024-04-27 03:33:03.909416] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.958 [2024-04-27 03:33:03.909429] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.958 [2024-04-27 03:33:03.909458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.958 qpair failed and we were unable to recover it. 00:21:38.958 [2024-04-27 03:33:03.919299] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.958 [2024-04-27 03:33:03.919458] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.958 [2024-04-27 03:33:03.919484] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.958 [2024-04-27 03:33:03.919498] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.958 [2024-04-27 03:33:03.919511] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.958 [2024-04-27 03:33:03.919540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.958 qpair failed and we were unable to recover it. 00:21:38.958 [2024-04-27 03:33:03.929312] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:38.958 [2024-04-27 03:33:03.929419] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:38.958 [2024-04-27 03:33:03.929445] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:38.958 [2024-04-27 03:33:03.929459] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:38.958 [2024-04-27 03:33:03.929474] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:38.958 [2024-04-27 03:33:03.929516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:38.958 qpair failed and we were unable to recover it. 00:21:39.219 [2024-04-27 03:33:03.939319] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.219 [2024-04-27 03:33:03.939421] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.219 [2024-04-27 03:33:03.939448] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.219 [2024-04-27 03:33:03.939462] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.219 [2024-04-27 03:33:03.939476] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.219 [2024-04-27 03:33:03.939505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.219 qpair failed and we were unable to recover it. 00:21:39.219 [2024-04-27 03:33:03.949410] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.219 [2024-04-27 03:33:03.949524] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.219 [2024-04-27 03:33:03.949550] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.219 [2024-04-27 03:33:03.949570] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.219 [2024-04-27 03:33:03.949584] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.219 [2024-04-27 03:33:03.949614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.219 qpair failed and we were unable to recover it. 00:21:39.219 [2024-04-27 03:33:03.959414] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.219 [2024-04-27 03:33:03.959516] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.219 [2024-04-27 03:33:03.959542] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.219 [2024-04-27 03:33:03.959556] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.219 [2024-04-27 03:33:03.959569] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.219 [2024-04-27 03:33:03.959611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.219 qpair failed and we were unable to recover it. 00:21:39.219 [2024-04-27 03:33:03.969441] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.219 [2024-04-27 03:33:03.969550] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.219 [2024-04-27 03:33:03.969576] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.219 [2024-04-27 03:33:03.969591] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.219 [2024-04-27 03:33:03.969604] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.219 [2024-04-27 03:33:03.969633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.219 qpair failed and we were unable to recover it. 00:21:39.219 [2024-04-27 03:33:03.979460] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.219 [2024-04-27 03:33:03.979558] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.219 [2024-04-27 03:33:03.979585] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.219 [2024-04-27 03:33:03.979600] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.219 [2024-04-27 03:33:03.979612] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.219 [2024-04-27 03:33:03.979643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.219 qpair failed and we were unable to recover it. 00:21:39.219 [2024-04-27 03:33:03.989491] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.219 [2024-04-27 03:33:03.989608] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.219 [2024-04-27 03:33:03.989633] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.219 [2024-04-27 03:33:03.989648] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.219 [2024-04-27 03:33:03.989661] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.219 [2024-04-27 03:33:03.989690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.219 qpair failed and we were unable to recover it. 00:21:39.219 [2024-04-27 03:33:03.999518] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.219 [2024-04-27 03:33:03.999624] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.219 [2024-04-27 03:33:03.999650] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.219 [2024-04-27 03:33:03.999665] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.219 [2024-04-27 03:33:03.999677] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.219 [2024-04-27 03:33:03.999719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.009576] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.009734] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.009760] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.009775] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.220 [2024-04-27 03:33:04.009790] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.220 [2024-04-27 03:33:04.009820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.019527] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.019629] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.019658] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.019673] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.220 [2024-04-27 03:33:04.019686] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.220 [2024-04-27 03:33:04.019716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.029602] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.029761] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.029787] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.029802] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.220 [2024-04-27 03:33:04.029814] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.220 [2024-04-27 03:33:04.029843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.039586] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.039693] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.039719] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.039739] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.220 [2024-04-27 03:33:04.039753] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.220 [2024-04-27 03:33:04.039782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.049677] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.049783] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.049808] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.049822] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.220 [2024-04-27 03:33:04.049835] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.220 [2024-04-27 03:33:04.049877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.059636] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.059761] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.059787] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.059801] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.220 [2024-04-27 03:33:04.059814] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.220 [2024-04-27 03:33:04.059843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.069841] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.070001] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.070026] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.070040] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.220 [2024-04-27 03:33:04.070053] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.220 [2024-04-27 03:33:04.070082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.079746] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.079853] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.079882] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.079897] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.220 [2024-04-27 03:33:04.079909] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.220 [2024-04-27 03:33:04.079938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.089729] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.089827] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.089853] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.089867] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.220 [2024-04-27 03:33:04.089880] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.220 [2024-04-27 03:33:04.089909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.099768] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.099868] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.099894] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.099908] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.220 [2024-04-27 03:33:04.099921] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.220 [2024-04-27 03:33:04.099950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.220 qpair failed and we were unable to recover it. 00:21:39.220 [2024-04-27 03:33:04.109802] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.220 [2024-04-27 03:33:04.109913] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.220 [2024-04-27 03:33:04.109939] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.220 [2024-04-27 03:33:04.109954] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.221 [2024-04-27 03:33:04.109966] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.221 [2024-04-27 03:33:04.109995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.221 qpair failed and we were unable to recover it. 00:21:39.221 [2024-04-27 03:33:04.119836] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.221 [2024-04-27 03:33:04.119943] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.221 [2024-04-27 03:33:04.119969] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.221 [2024-04-27 03:33:04.119983] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.221 [2024-04-27 03:33:04.119996] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.221 [2024-04-27 03:33:04.120025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.221 qpair failed and we were unable to recover it. 00:21:39.221 [2024-04-27 03:33:04.129898] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.221 [2024-04-27 03:33:04.130025] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.221 [2024-04-27 03:33:04.130056] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.221 [2024-04-27 03:33:04.130071] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.221 [2024-04-27 03:33:04.130084] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.221 [2024-04-27 03:33:04.130114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.221 qpair failed and we were unable to recover it. 00:21:39.221 [2024-04-27 03:33:04.139894] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.221 [2024-04-27 03:33:04.139997] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.221 [2024-04-27 03:33:04.140023] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.221 [2024-04-27 03:33:04.140037] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.221 [2024-04-27 03:33:04.140050] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.221 [2024-04-27 03:33:04.140079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.221 qpair failed and we were unable to recover it. 00:21:39.221 [2024-04-27 03:33:04.149919] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.221 [2024-04-27 03:33:04.150025] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.221 [2024-04-27 03:33:04.150051] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.221 [2024-04-27 03:33:04.150065] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.221 [2024-04-27 03:33:04.150078] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.221 [2024-04-27 03:33:04.150107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.221 qpair failed and we were unable to recover it. 00:21:39.221 [2024-04-27 03:33:04.159950] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.221 [2024-04-27 03:33:04.160083] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.221 [2024-04-27 03:33:04.160108] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.221 [2024-04-27 03:33:04.160122] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.221 [2024-04-27 03:33:04.160135] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.221 [2024-04-27 03:33:04.160164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.221 qpair failed and we were unable to recover it. 00:21:39.221 [2024-04-27 03:33:04.169977] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.221 [2024-04-27 03:33:04.170087] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.221 [2024-04-27 03:33:04.170113] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.221 [2024-04-27 03:33:04.170128] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.221 [2024-04-27 03:33:04.170141] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.221 [2024-04-27 03:33:04.170175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.221 qpair failed and we were unable to recover it. 00:21:39.221 [2024-04-27 03:33:04.180040] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.221 [2024-04-27 03:33:04.180168] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.221 [2024-04-27 03:33:04.180194] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.221 [2024-04-27 03:33:04.180208] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.221 [2024-04-27 03:33:04.180221] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.221 [2024-04-27 03:33:04.180257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.221 qpair failed and we were unable to recover it. 00:21:39.221 [2024-04-27 03:33:04.190061] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.221 [2024-04-27 03:33:04.190181] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.221 [2024-04-27 03:33:04.190206] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.221 [2024-04-27 03:33:04.190221] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.221 [2024-04-27 03:33:04.190234] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.221 [2024-04-27 03:33:04.190283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.221 qpair failed and we were unable to recover it. 00:21:39.484 [2024-04-27 03:33:04.200082] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.484 [2024-04-27 03:33:04.200187] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.484 [2024-04-27 03:33:04.200214] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.484 [2024-04-27 03:33:04.200228] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.484 [2024-04-27 03:33:04.200241] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.484 [2024-04-27 03:33:04.200278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.484 qpair failed and we were unable to recover it. 00:21:39.484 [2024-04-27 03:33:04.210186] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.484 [2024-04-27 03:33:04.210303] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.484 [2024-04-27 03:33:04.210329] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.484 [2024-04-27 03:33:04.210344] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.484 [2024-04-27 03:33:04.210356] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.484 [2024-04-27 03:33:04.210386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.484 qpair failed and we were unable to recover it. 00:21:39.484 [2024-04-27 03:33:04.220134] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.484 [2024-04-27 03:33:04.220235] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.484 [2024-04-27 03:33:04.220273] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.484 [2024-04-27 03:33:04.220289] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.484 [2024-04-27 03:33:04.220302] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.484 [2024-04-27 03:33:04.220331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.484 qpair failed and we were unable to recover it. 00:21:39.484 [2024-04-27 03:33:04.230139] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.484 [2024-04-27 03:33:04.230245] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.484 [2024-04-27 03:33:04.230277] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.484 [2024-04-27 03:33:04.230291] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.484 [2024-04-27 03:33:04.230304] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.484 [2024-04-27 03:33:04.230334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.484 qpair failed and we were unable to recover it. 00:21:39.484 [2024-04-27 03:33:04.240177] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.484 [2024-04-27 03:33:04.240284] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.484 [2024-04-27 03:33:04.240310] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.484 [2024-04-27 03:33:04.240325] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.484 [2024-04-27 03:33:04.240338] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.484 [2024-04-27 03:33:04.240367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.484 qpair failed and we were unable to recover it. 00:21:39.484 [2024-04-27 03:33:04.250201] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.484 [2024-04-27 03:33:04.250308] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.484 [2024-04-27 03:33:04.250334] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.484 [2024-04-27 03:33:04.250348] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.484 [2024-04-27 03:33:04.250361] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.484 [2024-04-27 03:33:04.250390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.484 qpair failed and we were unable to recover it. 00:21:39.484 [2024-04-27 03:33:04.260211] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.484 [2024-04-27 03:33:04.260327] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.484 [2024-04-27 03:33:04.260352] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.484 [2024-04-27 03:33:04.260366] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.484 [2024-04-27 03:33:04.260383] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.484 [2024-04-27 03:33:04.260413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.484 qpair failed and we were unable to recover it. 00:21:39.484 [2024-04-27 03:33:04.270290] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.484 [2024-04-27 03:33:04.270401] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.484 [2024-04-27 03:33:04.270427] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.484 [2024-04-27 03:33:04.270442] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.484 [2024-04-27 03:33:04.270454] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.484 [2024-04-27 03:33:04.270482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.484 qpair failed and we were unable to recover it. 00:21:39.484 [2024-04-27 03:33:04.280302] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.484 [2024-04-27 03:33:04.280408] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.484 [2024-04-27 03:33:04.280433] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.484 [2024-04-27 03:33:04.280448] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.484 [2024-04-27 03:33:04.280461] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.484 [2024-04-27 03:33:04.280489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.484 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.290352] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.290479] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.290504] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.290519] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.290532] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.290561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.300357] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.300458] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.300483] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.300497] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.300510] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.300539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.310391] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.310520] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.310546] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.310560] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.310575] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.310605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.320400] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.320507] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.320534] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.320548] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.320560] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.320589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.330444] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.330562] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.330588] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.330603] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.330618] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.330647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.340457] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.340557] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.340583] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.340598] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.340610] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.340651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.350483] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.350588] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.350615] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.350629] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.350647] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.350677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.360501] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.360602] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.360628] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.360642] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.360655] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.360684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.370559] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.370670] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.370696] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.370710] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.370722] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.370751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.380615] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.380717] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.380745] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.380760] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.380772] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.380813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.390590] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.390695] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.390721] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.390735] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.390747] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.390776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.400657] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.400789] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.400814] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.400829] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.400841] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.400870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.410670] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.410769] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.410797] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.485 [2024-04-27 03:33:04.410813] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.485 [2024-04-27 03:33:04.410825] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.485 [2024-04-27 03:33:04.410854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.485 qpair failed and we were unable to recover it. 00:21:39.485 [2024-04-27 03:33:04.420688] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.485 [2024-04-27 03:33:04.420793] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.485 [2024-04-27 03:33:04.420820] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.486 [2024-04-27 03:33:04.420834] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.486 [2024-04-27 03:33:04.420847] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.486 [2024-04-27 03:33:04.420878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.486 qpair failed and we were unable to recover it. 00:21:39.486 [2024-04-27 03:33:04.430706] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.486 [2024-04-27 03:33:04.430815] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.486 [2024-04-27 03:33:04.430841] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.486 [2024-04-27 03:33:04.430855] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.486 [2024-04-27 03:33:04.430868] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.486 [2024-04-27 03:33:04.430898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.486 qpair failed and we were unable to recover it. 00:21:39.486 [2024-04-27 03:33:04.440729] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.486 [2024-04-27 03:33:04.440833] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.486 [2024-04-27 03:33:04.440858] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.486 [2024-04-27 03:33:04.440878] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.486 [2024-04-27 03:33:04.440892] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.486 [2024-04-27 03:33:04.440921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.486 qpair failed and we were unable to recover it. 00:21:39.486 [2024-04-27 03:33:04.450747] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.486 [2024-04-27 03:33:04.450847] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.486 [2024-04-27 03:33:04.450873] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.486 [2024-04-27 03:33:04.450887] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.486 [2024-04-27 03:33:04.450900] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.486 [2024-04-27 03:33:04.450928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.486 qpair failed and we were unable to recover it. 00:21:39.746 [2024-04-27 03:33:04.460768] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.746 [2024-04-27 03:33:04.460903] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.746 [2024-04-27 03:33:04.460928] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.746 [2024-04-27 03:33:04.460943] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.746 [2024-04-27 03:33:04.460955] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.746 [2024-04-27 03:33:04.460985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.746 qpair failed and we were unable to recover it. 00:21:39.746 [2024-04-27 03:33:04.470823] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.746 [2024-04-27 03:33:04.470929] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.746 [2024-04-27 03:33:04.470953] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.746 [2024-04-27 03:33:04.470967] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.746 [2024-04-27 03:33:04.470980] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.746 [2024-04-27 03:33:04.471009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.480843] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.480948] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.480973] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.480987] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.481000] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.481028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.490859] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.490955] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.490980] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.490995] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.491007] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.491036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.500896] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.500998] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.501023] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.501038] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.501050] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.501079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.510935] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.511044] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.511070] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.511084] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.511097] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.511126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.520983] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.521085] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.521115] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.521132] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.521144] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.521175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.531002] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.531145] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.531176] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.531192] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.531205] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.531234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.540997] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.541150] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.541176] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.541191] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.541207] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.541237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.551040] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.551147] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.551173] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.551187] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.551200] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.551229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.561075] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.561201] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.561226] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.561241] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.561261] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.561291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.571096] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.571207] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.571235] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.571259] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.571284] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.571323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.581110] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.581213] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.581240] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.581262] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.581287] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:39.747 [2024-04-27 03:33:04.581317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.591172] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.591290] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.591322] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.591337] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.591350] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.747 [2024-04-27 03:33:04.591380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.601282] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.601396] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.747 [2024-04-27 03:33:04.601426] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.747 [2024-04-27 03:33:04.601442] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.747 [2024-04-27 03:33:04.601455] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.747 [2024-04-27 03:33:04.601498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.747 qpair failed and we were unable to recover it. 00:21:39.747 [2024-04-27 03:33:04.611208] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.747 [2024-04-27 03:33:04.611320] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.611350] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.611365] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.611378] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.611408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.621317] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.621420] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.621451] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.621466] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.621478] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.621521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.631307] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.631426] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.631452] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.631467] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.631479] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.631508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.641286] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.641394] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.641420] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.641435] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.641448] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.641478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.651321] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.651440] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.651468] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.651484] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.651497] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.651527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.661346] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.661456] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.661482] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.661502] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.661520] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.661551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.671412] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.671534] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.671560] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.671575] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.671588] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.671617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.681413] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.681519] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.681545] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.681559] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.681572] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.681600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.691474] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.691628] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.691653] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.691668] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.691681] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.691709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.701467] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.701574] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.701599] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.701614] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.701627] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.701655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.711537] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.711679] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.711704] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.711719] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.711732] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.711760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:39.748 [2024-04-27 03:33:04.721552] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:39.748 [2024-04-27 03:33:04.721663] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:39.748 [2024-04-27 03:33:04.721689] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:39.748 [2024-04-27 03:33:04.721704] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:39.748 [2024-04-27 03:33:04.721719] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:39.748 [2024-04-27 03:33:04.721748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:39.748 qpair failed and we were unable to recover it. 00:21:40.008 [2024-04-27 03:33:04.731555] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.008 [2024-04-27 03:33:04.731654] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.008 [2024-04-27 03:33:04.731680] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.008 [2024-04-27 03:33:04.731695] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.008 [2024-04-27 03:33:04.731707] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.008 [2024-04-27 03:33:04.731736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.008 qpair failed and we were unable to recover it. 00:21:40.008 [2024-04-27 03:33:04.741597] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.008 [2024-04-27 03:33:04.741726] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.008 [2024-04-27 03:33:04.741751] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.008 [2024-04-27 03:33:04.741766] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.008 [2024-04-27 03:33:04.741778] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.008 [2024-04-27 03:33:04.741807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.008 qpair failed and we were unable to recover it. 00:21:40.008 [2024-04-27 03:33:04.751634] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.008 [2024-04-27 03:33:04.751739] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.008 [2024-04-27 03:33:04.751764] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.008 [2024-04-27 03:33:04.751778] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.008 [2024-04-27 03:33:04.751796] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.008 [2024-04-27 03:33:04.751825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.008 qpair failed and we were unable to recover it. 00:21:40.008 [2024-04-27 03:33:04.761655] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.008 [2024-04-27 03:33:04.761782] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.008 [2024-04-27 03:33:04.761807] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.761822] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.009 [2024-04-27 03:33:04.761835] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.009 [2024-04-27 03:33:04.761864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.009 qpair failed and we were unable to recover it. 00:21:40.009 [2024-04-27 03:33:04.771685] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.009 [2024-04-27 03:33:04.771787] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.009 [2024-04-27 03:33:04.771814] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.771829] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.009 [2024-04-27 03:33:04.771841] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.009 [2024-04-27 03:33:04.771870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.009 qpair failed and we were unable to recover it. 00:21:40.009 [2024-04-27 03:33:04.781736] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.009 [2024-04-27 03:33:04.781839] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.009 [2024-04-27 03:33:04.781865] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.781880] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.009 [2024-04-27 03:33:04.781892] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.009 [2024-04-27 03:33:04.781922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.009 qpair failed and we were unable to recover it. 00:21:40.009 [2024-04-27 03:33:04.791730] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.009 [2024-04-27 03:33:04.791836] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.009 [2024-04-27 03:33:04.791862] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.791876] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.009 [2024-04-27 03:33:04.791889] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.009 [2024-04-27 03:33:04.791917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.009 qpair failed and we were unable to recover it. 00:21:40.009 [2024-04-27 03:33:04.801773] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.009 [2024-04-27 03:33:04.801882] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.009 [2024-04-27 03:33:04.801909] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.801925] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.009 [2024-04-27 03:33:04.801937] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.009 [2024-04-27 03:33:04.801967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.009 qpair failed and we were unable to recover it. 00:21:40.009 [2024-04-27 03:33:04.811834] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.009 [2024-04-27 03:33:04.811986] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.009 [2024-04-27 03:33:04.812011] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.812026] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.009 [2024-04-27 03:33:04.812038] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.009 [2024-04-27 03:33:04.812068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.009 qpair failed and we were unable to recover it. 00:21:40.009 [2024-04-27 03:33:04.821829] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.009 [2024-04-27 03:33:04.821935] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.009 [2024-04-27 03:33:04.821961] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.821975] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.009 [2024-04-27 03:33:04.821991] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.009 [2024-04-27 03:33:04.822020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.009 qpair failed and we were unable to recover it. 00:21:40.009 [2024-04-27 03:33:04.831873] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.009 [2024-04-27 03:33:04.831992] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.009 [2024-04-27 03:33:04.832018] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.832032] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.009 [2024-04-27 03:33:04.832045] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.009 [2024-04-27 03:33:04.832088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.009 qpair failed and we were unable to recover it. 00:21:40.009 [2024-04-27 03:33:04.841900] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.009 [2024-04-27 03:33:04.842031] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.009 [2024-04-27 03:33:04.842056] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.842076] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.009 [2024-04-27 03:33:04.842090] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.009 [2024-04-27 03:33:04.842119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.009 qpair failed and we were unable to recover it. 00:21:40.009 [2024-04-27 03:33:04.851911] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.009 [2024-04-27 03:33:04.852040] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.009 [2024-04-27 03:33:04.852066] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.852080] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.009 [2024-04-27 03:33:04.852093] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.009 [2024-04-27 03:33:04.852121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.009 qpair failed and we were unable to recover it. 00:21:40.009 [2024-04-27 03:33:04.861970] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.009 [2024-04-27 03:33:04.862120] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.009 [2024-04-27 03:33:04.862145] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.009 [2024-04-27 03:33:04.862160] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.862172] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.862201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.871958] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.872068] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.872093] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.872107] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.872120] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.872148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.881970] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.882070] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.882095] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.882110] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.882122] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.882151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.892028] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.892133] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.892158] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.892172] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.892184] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.892213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.902020] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.902124] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.902149] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.902164] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.902177] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.902205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.912053] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.912159] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.912184] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.912199] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.912211] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.912239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.922114] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.922226] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.922259] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.922278] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.922290] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.922320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.932102] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.932252] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.932283] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.932298] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.932311] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.932340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.942137] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.942234] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.942268] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.942284] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.942296] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.942337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.952194] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.952314] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.952341] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.952355] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.952367] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.952397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.962223] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.962337] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.962363] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.962378] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.010 [2024-04-27 03:33:04.962391] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.010 [2024-04-27 03:33:04.962420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.010 qpair failed and we were unable to recover it. 00:21:40.010 [2024-04-27 03:33:04.972260] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.010 [2024-04-27 03:33:04.972364] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.010 [2024-04-27 03:33:04.972388] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.010 [2024-04-27 03:33:04.972402] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.011 [2024-04-27 03:33:04.972415] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.011 [2024-04-27 03:33:04.972449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.011 qpair failed and we were unable to recover it. 00:21:40.011 [2024-04-27 03:33:04.982236] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.011 [2024-04-27 03:33:04.982359] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.011 [2024-04-27 03:33:04.982385] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.011 [2024-04-27 03:33:04.982399] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.011 [2024-04-27 03:33:04.982411] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.011 [2024-04-27 03:33:04.982441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.011 qpair failed and we were unable to recover it. 00:21:40.270 [2024-04-27 03:33:04.992313] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.270 [2024-04-27 03:33:04.992419] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.270 [2024-04-27 03:33:04.992445] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.270 [2024-04-27 03:33:04.992459] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.270 [2024-04-27 03:33:04.992472] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.270 [2024-04-27 03:33:04.992500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.270 qpair failed and we were unable to recover it. 00:21:40.270 [2024-04-27 03:33:05.002311] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.270 [2024-04-27 03:33:05.002417] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.270 [2024-04-27 03:33:05.002443] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.270 [2024-04-27 03:33:05.002457] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.270 [2024-04-27 03:33:05.002470] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.270 [2024-04-27 03:33:05.002510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.270 qpair failed and we were unable to recover it. 00:21:40.270 [2024-04-27 03:33:05.012360] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.270 [2024-04-27 03:33:05.012486] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.270 [2024-04-27 03:33:05.012511] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.270 [2024-04-27 03:33:05.012526] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.270 [2024-04-27 03:33:05.012538] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.270 [2024-04-27 03:33:05.012567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.270 qpair failed and we were unable to recover it. 00:21:40.270 [2024-04-27 03:33:05.022354] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.270 [2024-04-27 03:33:05.022457] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.270 [2024-04-27 03:33:05.022488] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.270 [2024-04-27 03:33:05.022503] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.270 [2024-04-27 03:33:05.022516] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.270 [2024-04-27 03:33:05.022545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.270 qpair failed and we were unable to recover it. 00:21:40.270 [2024-04-27 03:33:05.032401] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.270 [2024-04-27 03:33:05.032509] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.270 [2024-04-27 03:33:05.032539] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.270 [2024-04-27 03:33:05.032555] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.270 [2024-04-27 03:33:05.032567] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.270 [2024-04-27 03:33:05.032597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.270 qpair failed and we were unable to recover it. 00:21:40.270 [2024-04-27 03:33:05.042433] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.270 [2024-04-27 03:33:05.042542] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.270 [2024-04-27 03:33:05.042567] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.270 [2024-04-27 03:33:05.042582] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.270 [2024-04-27 03:33:05.042594] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.270 [2024-04-27 03:33:05.042623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.270 qpair failed and we were unable to recover it. 00:21:40.270 [2024-04-27 03:33:05.052442] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.052544] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.052570] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.052585] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.052597] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.271 [2024-04-27 03:33:05.052626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.271 qpair failed and we were unable to recover it. 00:21:40.271 [2024-04-27 03:33:05.062520] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.062676] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.062702] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.062716] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.062729] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.271 [2024-04-27 03:33:05.062763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.271 qpair failed and we were unable to recover it. 00:21:40.271 [2024-04-27 03:33:05.072541] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.072654] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.072679] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.072694] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.072706] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.271 [2024-04-27 03:33:05.072735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.271 qpair failed and we were unable to recover it. 00:21:40.271 [2024-04-27 03:33:05.082557] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.082682] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.082718] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.082733] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.082745] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.271 [2024-04-27 03:33:05.082788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.271 qpair failed and we were unable to recover it. 00:21:40.271 [2024-04-27 03:33:05.092537] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.092647] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.092672] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.092687] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.092699] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.271 [2024-04-27 03:33:05.092734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.271 qpair failed and we were unable to recover it. 00:21:40.271 [2024-04-27 03:33:05.102671] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.102767] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.102793] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.102808] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.102820] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.271 [2024-04-27 03:33:05.102862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.271 qpair failed and we were unable to recover it. 00:21:40.271 [2024-04-27 03:33:05.112631] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.112740] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.112766] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.112780] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.112792] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.271 [2024-04-27 03:33:05.112821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.271 qpair failed and we were unable to recover it. 00:21:40.271 [2024-04-27 03:33:05.122654] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.122770] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.122795] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.122809] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.122821] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.271 [2024-04-27 03:33:05.122850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.271 qpair failed and we were unable to recover it. 00:21:40.271 [2024-04-27 03:33:05.132655] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.132793] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.132819] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.132833] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.132846] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.271 [2024-04-27 03:33:05.132874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.271 qpair failed and we were unable to recover it. 00:21:40.271 [2024-04-27 03:33:05.142689] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.142791] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.142816] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.142830] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.142842] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.271 [2024-04-27 03:33:05.142883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.271 qpair failed and we were unable to recover it. 00:21:40.271 [2024-04-27 03:33:05.152727] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.271 [2024-04-27 03:33:05.152830] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.271 [2024-04-27 03:33:05.152854] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.271 [2024-04-27 03:33:05.152867] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.271 [2024-04-27 03:33:05.152885] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.272 [2024-04-27 03:33:05.152915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.272 qpair failed and we were unable to recover it. 00:21:40.272 [2024-04-27 03:33:05.162851] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.272 [2024-04-27 03:33:05.162982] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.272 [2024-04-27 03:33:05.163007] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.272 [2024-04-27 03:33:05.163021] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.272 [2024-04-27 03:33:05.163034] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.272 [2024-04-27 03:33:05.163063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.272 qpair failed and we were unable to recover it. 00:21:40.272 [2024-04-27 03:33:05.172769] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.272 [2024-04-27 03:33:05.172871] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.272 [2024-04-27 03:33:05.172896] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.272 [2024-04-27 03:33:05.172910] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.272 [2024-04-27 03:33:05.172922] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.272 [2024-04-27 03:33:05.172951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.272 qpair failed and we were unable to recover it. 00:21:40.272 [2024-04-27 03:33:05.182822] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.272 [2024-04-27 03:33:05.182924] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.272 [2024-04-27 03:33:05.182950] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.272 [2024-04-27 03:33:05.182964] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.272 [2024-04-27 03:33:05.182977] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.272 [2024-04-27 03:33:05.183005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.272 qpair failed and we were unable to recover it. 00:21:40.272 [2024-04-27 03:33:05.192850] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.272 [2024-04-27 03:33:05.192954] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.272 [2024-04-27 03:33:05.192980] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.272 [2024-04-27 03:33:05.192994] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.272 [2024-04-27 03:33:05.193006] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.272 [2024-04-27 03:33:05.193048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.272 qpair failed and we were unable to recover it. 00:21:40.272 [2024-04-27 03:33:05.202860] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.272 [2024-04-27 03:33:05.202970] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.272 [2024-04-27 03:33:05.202996] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.272 [2024-04-27 03:33:05.203010] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.272 [2024-04-27 03:33:05.203023] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.272 [2024-04-27 03:33:05.203051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.272 qpair failed and we were unable to recover it. 00:21:40.272 [2024-04-27 03:33:05.212888] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.272 [2024-04-27 03:33:05.212995] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.272 [2024-04-27 03:33:05.213020] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.272 [2024-04-27 03:33:05.213034] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.272 [2024-04-27 03:33:05.213046] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.272 [2024-04-27 03:33:05.213075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.272 qpair failed and we were unable to recover it. 00:21:40.272 [2024-04-27 03:33:05.222900] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.272 [2024-04-27 03:33:05.223005] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.272 [2024-04-27 03:33:05.223030] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.272 [2024-04-27 03:33:05.223044] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.272 [2024-04-27 03:33:05.223056] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.272 [2024-04-27 03:33:05.223085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.272 qpair failed and we were unable to recover it. 00:21:40.272 [2024-04-27 03:33:05.232945] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.272 [2024-04-27 03:33:05.233050] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.272 [2024-04-27 03:33:05.233075] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.272 [2024-04-27 03:33:05.233089] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.272 [2024-04-27 03:33:05.233101] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.272 [2024-04-27 03:33:05.233130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.272 qpair failed and we were unable to recover it. 00:21:40.272 [2024-04-27 03:33:05.243078] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.272 [2024-04-27 03:33:05.243206] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.272 [2024-04-27 03:33:05.243231] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.272 [2024-04-27 03:33:05.243259] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.272 [2024-04-27 03:33:05.243273] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.272 [2024-04-27 03:33:05.243303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.272 qpair failed and we were unable to recover it. 00:21:40.534 [2024-04-27 03:33:05.252998] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.534 [2024-04-27 03:33:05.253124] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.534 [2024-04-27 03:33:05.253150] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.534 [2024-04-27 03:33:05.253164] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.534 [2024-04-27 03:33:05.253177] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.534 [2024-04-27 03:33:05.253206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.534 qpair failed and we were unable to recover it. 00:21:40.534 [2024-04-27 03:33:05.263020] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.534 [2024-04-27 03:33:05.263119] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.263143] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.263157] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.263169] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.263197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.273062] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.273170] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.273195] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.273209] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.273222] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.273257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.283096] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.283213] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.283239] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.283265] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.283280] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.283310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.293111] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.293216] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.293243] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.293265] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.293278] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.293307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.303182] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.303292] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.303318] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.303333] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.303345] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.303374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.313199] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.313321] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.313347] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.313361] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.313373] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.313402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.323209] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.323324] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.323349] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.323364] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.323376] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.323405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.333229] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.333343] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.333369] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.333389] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.333402] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.333431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.343254] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.343353] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.343379] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.343393] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.343406] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.343434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.353309] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.353418] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.353443] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.353458] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.353470] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.353498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.363330] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.363436] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.363462] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.363477] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.363489] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.363517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.373360] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.373464] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.373492] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.373506] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.373519] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.373548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.383413] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.383540] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.383565] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.383580] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.383592] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.535 [2024-04-27 03:33:05.383621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.535 qpair failed and we were unable to recover it. 00:21:40.535 [2024-04-27 03:33:05.393459] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.535 [2024-04-27 03:33:05.393573] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.535 [2024-04-27 03:33:05.393599] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.535 [2024-04-27 03:33:05.393613] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.535 [2024-04-27 03:33:05.393625] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.393654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.403466] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.403573] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.403598] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.403612] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.403624] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.403653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.413458] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.413567] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.413593] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.413607] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.413620] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.413649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.423498] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.423599] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.423630] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.423646] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.423658] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.423686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.433524] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.433633] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.433658] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.433673] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.433686] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.433715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.443602] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.443749] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.443774] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.443788] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.443801] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.443830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.453564] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.453700] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.453728] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.453742] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.453755] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.453784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.463650] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.463755] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.463780] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.463794] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.463807] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.463841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.473633] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.473771] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.473796] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.473811] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.473823] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.473852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.483657] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.483760] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.483786] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.483800] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.483812] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.483841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.493729] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.493875] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.493899] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.493914] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.493927] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.493955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.536 [2024-04-27 03:33:05.503711] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.536 [2024-04-27 03:33:05.503811] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.536 [2024-04-27 03:33:05.503836] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.536 [2024-04-27 03:33:05.503850] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.536 [2024-04-27 03:33:05.503863] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.536 [2024-04-27 03:33:05.503891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.536 qpair failed and we were unable to recover it. 00:21:40.799 [2024-04-27 03:33:05.513756] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.799 [2024-04-27 03:33:05.513863] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.799 [2024-04-27 03:33:05.513893] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.799 [2024-04-27 03:33:05.513908] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.799 [2024-04-27 03:33:05.513921] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.799 [2024-04-27 03:33:05.513949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.799 qpair failed and we were unable to recover it. 00:21:40.799 [2024-04-27 03:33:05.523776] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.799 [2024-04-27 03:33:05.523878] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.799 [2024-04-27 03:33:05.523904] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.799 [2024-04-27 03:33:05.523918] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.799 [2024-04-27 03:33:05.523931] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.799 [2024-04-27 03:33:05.523959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.799 qpair failed and we were unable to recover it. 00:21:40.799 [2024-04-27 03:33:05.533791] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.799 [2024-04-27 03:33:05.533891] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.799 [2024-04-27 03:33:05.533917] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.799 [2024-04-27 03:33:05.533931] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.799 [2024-04-27 03:33:05.533943] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.799 [2024-04-27 03:33:05.533972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.799 qpair failed and we were unable to recover it. 00:21:40.799 [2024-04-27 03:33:05.543818] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.799 [2024-04-27 03:33:05.543918] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.799 [2024-04-27 03:33:05.543943] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.799 [2024-04-27 03:33:05.543957] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.799 [2024-04-27 03:33:05.543970] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.799 [2024-04-27 03:33:05.543998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.799 qpair failed and we were unable to recover it. 00:21:40.799 [2024-04-27 03:33:05.553852] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.799 [2024-04-27 03:33:05.553953] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.799 [2024-04-27 03:33:05.553977] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.799 [2024-04-27 03:33:05.553992] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.799 [2024-04-27 03:33:05.554009] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.799 [2024-04-27 03:33:05.554039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.799 qpair failed and we were unable to recover it. 00:21:40.799 [2024-04-27 03:33:05.563920] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.799 [2024-04-27 03:33:05.564042] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.799 [2024-04-27 03:33:05.564070] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.799 [2024-04-27 03:33:05.564085] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.799 [2024-04-27 03:33:05.564097] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.799 [2024-04-27 03:33:05.564125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.799 qpair failed and we were unable to recover it. 00:21:40.799 [2024-04-27 03:33:05.573890] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.799 [2024-04-27 03:33:05.573999] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.799 [2024-04-27 03:33:05.574025] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.799 [2024-04-27 03:33:05.574039] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.799 [2024-04-27 03:33:05.574052] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.799 [2024-04-27 03:33:05.574081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.799 qpair failed and we were unable to recover it. 00:21:40.799 [2024-04-27 03:33:05.583933] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.799 [2024-04-27 03:33:05.584035] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.799 [2024-04-27 03:33:05.584061] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.584076] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.584088] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.584116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.593966] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.594076] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.594102] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.594116] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.594128] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.594157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.603996] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.604101] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.604126] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.604141] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.604153] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.604194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.614088] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.614255] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.614282] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.614296] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.614309] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.614339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.624141] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.624245] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.624280] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.624295] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.624307] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.624349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.634179] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.634296] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.634322] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.634337] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.634349] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.634378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.644155] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.644265] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.644290] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.644311] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.644324] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.644353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.654148] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.654266] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.654292] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.654306] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.654319] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.654361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.664150] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.664254] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.664280] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.664294] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.664307] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.664336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.674210] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.674325] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.674351] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.674365] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.674377] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.674406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.684226] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.684356] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.684382] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.684397] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.684409] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.684438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.694256] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.694359] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.694385] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.694399] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.694411] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.694441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.704299] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.704398] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.704423] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.704438] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.800 [2024-04-27 03:33:05.704450] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.800 [2024-04-27 03:33:05.704479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.800 qpair failed and we were unable to recover it. 00:21:40.800 [2024-04-27 03:33:05.714311] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.800 [2024-04-27 03:33:05.714416] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.800 [2024-04-27 03:33:05.714440] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.800 [2024-04-27 03:33:05.714454] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.801 [2024-04-27 03:33:05.714466] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.801 [2024-04-27 03:33:05.714495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.801 qpair failed and we were unable to recover it. 00:21:40.801 [2024-04-27 03:33:05.724353] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.801 [2024-04-27 03:33:05.724459] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.801 [2024-04-27 03:33:05.724483] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.801 [2024-04-27 03:33:05.724497] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.801 [2024-04-27 03:33:05.724509] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.801 [2024-04-27 03:33:05.724538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.801 qpair failed and we were unable to recover it. 00:21:40.801 [2024-04-27 03:33:05.734378] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.801 [2024-04-27 03:33:05.734491] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.801 [2024-04-27 03:33:05.734516] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.801 [2024-04-27 03:33:05.734536] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.801 [2024-04-27 03:33:05.734549] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.801 [2024-04-27 03:33:05.734578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.801 qpair failed and we were unable to recover it. 00:21:40.801 [2024-04-27 03:33:05.744473] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.801 [2024-04-27 03:33:05.744576] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.801 [2024-04-27 03:33:05.744602] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.801 [2024-04-27 03:33:05.744616] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.801 [2024-04-27 03:33:05.744628] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.801 [2024-04-27 03:33:05.744657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.801 qpair failed and we were unable to recover it. 00:21:40.801 [2024-04-27 03:33:05.754451] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.801 [2024-04-27 03:33:05.754553] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.801 [2024-04-27 03:33:05.754578] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.801 [2024-04-27 03:33:05.754592] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.801 [2024-04-27 03:33:05.754605] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.801 [2024-04-27 03:33:05.754645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.801 qpair failed and we were unable to recover it. 00:21:40.801 [2024-04-27 03:33:05.764551] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.801 [2024-04-27 03:33:05.764652] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.801 [2024-04-27 03:33:05.764677] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.801 [2024-04-27 03:33:05.764692] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.801 [2024-04-27 03:33:05.764704] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.801 [2024-04-27 03:33:05.764745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.801 qpair failed and we were unable to recover it. 00:21:40.801 [2024-04-27 03:33:05.774581] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:40.801 [2024-04-27 03:33:05.774678] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:40.801 [2024-04-27 03:33:05.774703] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:40.801 [2024-04-27 03:33:05.774717] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:40.801 [2024-04-27 03:33:05.774730] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:40.801 [2024-04-27 03:33:05.774771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.801 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.784518] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.784620] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.784646] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.063 [2024-04-27 03:33:05.784661] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.063 [2024-04-27 03:33:05.784673] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.063 [2024-04-27 03:33:05.784702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.063 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.794559] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.794669] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.794694] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.063 [2024-04-27 03:33:05.794708] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.063 [2024-04-27 03:33:05.794720] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.063 [2024-04-27 03:33:05.794749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.063 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.804592] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.804695] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.804720] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.063 [2024-04-27 03:33:05.804735] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.063 [2024-04-27 03:33:05.804747] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.063 [2024-04-27 03:33:05.804776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.063 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.814603] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.814746] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.814771] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.063 [2024-04-27 03:33:05.814786] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.063 [2024-04-27 03:33:05.814798] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.063 [2024-04-27 03:33:05.814827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.063 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.824653] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.824764] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.824798] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.063 [2024-04-27 03:33:05.824814] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.063 [2024-04-27 03:33:05.824826] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.063 [2024-04-27 03:33:05.824857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.063 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.834699] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.834815] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.834841] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.063 [2024-04-27 03:33:05.834855] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.063 [2024-04-27 03:33:05.834867] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.063 [2024-04-27 03:33:05.834896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.063 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.844680] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.844797] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.844822] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.063 [2024-04-27 03:33:05.844836] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.063 [2024-04-27 03:33:05.844848] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.063 [2024-04-27 03:33:05.844883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.063 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.854739] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.854846] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.854871] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.063 [2024-04-27 03:33:05.854885] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.063 [2024-04-27 03:33:05.854898] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.063 [2024-04-27 03:33:05.854927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.063 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.864765] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.864866] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.864892] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.063 [2024-04-27 03:33:05.864907] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.063 [2024-04-27 03:33:05.864919] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.063 [2024-04-27 03:33:05.864953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.063 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.874793] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.874903] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.874929] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.063 [2024-04-27 03:33:05.874943] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.063 [2024-04-27 03:33:05.874955] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.063 [2024-04-27 03:33:05.874984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.063 qpair failed and we were unable to recover it. 00:21:41.063 [2024-04-27 03:33:05.884814] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.063 [2024-04-27 03:33:05.884916] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.063 [2024-04-27 03:33:05.884941] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.884956] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.884968] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.885009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.894858] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.894960] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.894986] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.895001] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.895013] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.895042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.904862] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.904977] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.905004] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.905019] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.905035] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.905066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.915018] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.915121] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.915152] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.915168] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.915180] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.915221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.924942] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.925049] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.925074] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.925089] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.925101] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.925130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.934981] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.935088] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.935114] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.935129] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.935141] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.935170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.944996] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.945110] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.945135] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.945150] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.945162] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.945191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.955004] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.955108] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.955135] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.955149] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.955167] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.955197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.965069] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.965196] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.965222] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.965237] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.965259] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.965290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.975084] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.975205] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.975231] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.975253] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.975268] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.975297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.985187] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.985309] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.985335] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.985350] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.985362] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.985404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:05.995118] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:05.995240] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:05.995278] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:05.995301] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:05.995314] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:05.995345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:06.005168] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:06.005291] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:06.005317] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:06.005331] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.064 [2024-04-27 03:33:06.005344] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.064 [2024-04-27 03:33:06.005373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.064 qpair failed and we were unable to recover it. 00:21:41.064 [2024-04-27 03:33:06.015268] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.064 [2024-04-27 03:33:06.015393] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.064 [2024-04-27 03:33:06.015419] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.064 [2024-04-27 03:33:06.015433] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.065 [2024-04-27 03:33:06.015445] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.065 [2024-04-27 03:33:06.015488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.065 qpair failed and we were unable to recover it. 00:21:41.065 [2024-04-27 03:33:06.025259] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.065 [2024-04-27 03:33:06.025362] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.065 [2024-04-27 03:33:06.025387] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.065 [2024-04-27 03:33:06.025402] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.065 [2024-04-27 03:33:06.025414] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.065 [2024-04-27 03:33:06.025443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.065 qpair failed and we were unable to recover it. 00:21:41.065 [2024-04-27 03:33:06.035255] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.065 [2024-04-27 03:33:06.035362] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.065 [2024-04-27 03:33:06.035387] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.065 [2024-04-27 03:33:06.035401] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.065 [2024-04-27 03:33:06.035414] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.065 [2024-04-27 03:33:06.035442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.065 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.045266] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.045385] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.045411] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.045426] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.045448] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.045479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.055311] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.055413] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.055440] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.055454] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.055467] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.055496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.065310] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.065411] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.065436] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.065450] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.065462] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.065491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.075336] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.075438] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.075465] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.075479] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.075491] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.075521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.085354] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.085463] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.085489] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.085503] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.085516] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.085545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.095393] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.095497] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.095523] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.095538] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.095550] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.095579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.105421] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.105529] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.105555] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.105569] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.105581] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.105610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.115485] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.115595] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.115624] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.115638] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.115651] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.115680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.125507] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.125638] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.125664] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.125679] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.125691] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.125720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.135506] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.135638] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.135663] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.135683] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.135697] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.135726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.145546] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.145653] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.145678] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.145692] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.145705] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.145734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.155562] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.155667] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.155693] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.155708] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.326 [2024-04-27 03:33:06.155720] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.326 [2024-04-27 03:33:06.155749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.326 qpair failed and we were unable to recover it. 00:21:41.326 [2024-04-27 03:33:06.165609] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.326 [2024-04-27 03:33:06.165714] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.326 [2024-04-27 03:33:06.165739] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.326 [2024-04-27 03:33:06.165754] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.165767] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.165796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.175684] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.175788] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.175813] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.175828] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.175841] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.175883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.185641] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.185745] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.185771] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.185786] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.185798] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.185829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.195698] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.195808] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.195834] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.195848] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.195861] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.195889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.205705] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.205812] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.205838] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.205852] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.205865] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.205907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.215704] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.215812] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.215839] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.215854] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.215866] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.215895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.225788] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.225885] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.225914] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.225930] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.225943] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.225971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.235772] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.235880] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.235905] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.235919] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.235932] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.235962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.245807] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.245917] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.245943] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.245957] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.245969] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.245998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.255879] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.255987] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.256014] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.256031] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.256045] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.256074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.265860] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.265967] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.265991] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.266005] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.266018] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.266063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.275930] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.276033] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.276058] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.276072] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.276085] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.276113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.285921] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.286021] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.286045] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.286059] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.286071] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.286100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.327 [2024-04-27 03:33:06.295939] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.327 [2024-04-27 03:33:06.296047] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.327 [2024-04-27 03:33:06.296072] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.327 [2024-04-27 03:33:06.296087] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.327 [2024-04-27 03:33:06.296100] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.327 [2024-04-27 03:33:06.296129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.327 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.305967] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.306074] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.306099] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.306114] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.306126] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.306155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.316027] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.316137] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.316168] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.316183] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.316195] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.316224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.326059] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.326174] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.326199] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.326213] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.326226] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.326262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.336059] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.336173] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.336199] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.336214] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.336230] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.336268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.346073] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.346179] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.346205] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.346219] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.346232] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.346268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.356165] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.356282] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.356307] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.356322] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.356340] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.356370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.366161] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.366273] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.366298] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.366313] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.366325] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.366354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.376194] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.376330] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.376355] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.376370] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.376382] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.376411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.386253] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.386395] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.386421] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.386435] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.386448] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.386476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.396336] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.396441] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.396466] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.396481] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.396493] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.396534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.406288] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.587 [2024-04-27 03:33:06.406393] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.587 [2024-04-27 03:33:06.406420] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.587 [2024-04-27 03:33:06.406434] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.587 [2024-04-27 03:33:06.406447] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.587 [2024-04-27 03:33:06.406476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.587 qpair failed and we were unable to recover it. 00:21:41.587 [2024-04-27 03:33:06.416297] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.416397] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.416422] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.416437] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.416449] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.588 [2024-04-27 03:33:06.416477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.426321] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.426420] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.426445] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.426460] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.426472] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.588 [2024-04-27 03:33:06.426500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.436369] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.436484] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.436509] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.436523] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.436536] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.588 [2024-04-27 03:33:06.436565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.446393] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.446524] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.446550] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.446565] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.446583] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.588 [2024-04-27 03:33:06.446625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.456420] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.456520] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.456544] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.456560] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.456572] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbff4000b90 00:21:41.588 [2024-04-27 03:33:06.456601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.466425] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.466526] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.466557] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.466573] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.466586] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:41.588 [2024-04-27 03:33:06.466616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.476467] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.476579] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.476610] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.476625] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.476638] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfec000b90 00:21:41.588 [2024-04-27 03:33:06.476668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.486511] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.486635] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.486667] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.486683] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.486696] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfe4000b90 00:21:41.588 [2024-04-27 03:33:06.486730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.496529] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.496640] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.496670] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.496686] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.496699] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fbfe4000b90 00:21:41.588 [2024-04-27 03:33:06.496729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.506594] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.506716] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.506748] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.506765] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.506780] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:41.588 [2024-04-27 03:33:06.506810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.516582] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:41.588 [2024-04-27 03:33:06.516694] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:41.588 [2024-04-27 03:33:06.516722] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:41.588 [2024-04-27 03:33:06.516736] nvme_tcp.c:2423:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:41.588 [2024-04-27 03:33:06.516749] nvme_tcp.c:2213:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1f3ef90 00:21:41.588 [2024-04-27 03:33:06.516777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:41.588 qpair failed and we were unable to recover it. 00:21:41.588 [2024-04-27 03:33:06.516870] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:21:41.588 A controller has encountered a failure and is being reset. 00:21:41.588 [2024-04-27 03:33:06.516922] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f4c910 (9): Bad file descriptor 00:21:41.847 Controller properly reset. 00:21:41.847 Initializing NVMe Controllers 00:21:41.847 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:41.847 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:41.847 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:21:41.847 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:21:41.847 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:21:41.847 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:21:41.847 Initialization complete. Launching workers. 00:21:41.847 Starting thread on core 1 00:21:41.847 Starting thread on core 2 00:21:41.847 Starting thread on core 3 00:21:41.847 Starting thread on core 0 00:21:41.847 03:33:06 -- host/target_disconnect.sh@59 -- # sync 00:21:41.847 00:21:41.847 real 0m10.861s 00:21:41.847 user 0m18.723s 00:21:41.847 sys 0m5.071s 00:21:41.847 03:33:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:41.847 03:33:06 -- common/autotest_common.sh@10 -- # set +x 00:21:41.847 ************************************ 00:21:41.847 END TEST nvmf_target_disconnect_tc2 00:21:41.847 ************************************ 00:21:41.847 03:33:06 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:21:41.847 03:33:06 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:21:41.847 03:33:06 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:21:41.847 03:33:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:41.847 03:33:06 -- nvmf/common.sh@117 -- # sync 00:21:41.847 03:33:06 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:21:41.847 03:33:06 -- nvmf/common.sh@120 -- # set +e 00:21:41.847 03:33:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:41.847 03:33:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:21:41.847 rmmod nvme_tcp 00:21:41.847 rmmod nvme_fabrics 00:21:41.847 rmmod nvme_keyring 00:21:41.847 03:33:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:41.847 03:33:06 -- nvmf/common.sh@124 -- # set -e 00:21:41.847 03:33:06 -- nvmf/common.sh@125 -- # return 0 00:21:41.847 03:33:06 -- nvmf/common.sh@478 -- # '[' -n 1531815 ']' 00:21:41.847 03:33:06 -- nvmf/common.sh@479 -- # killprocess 1531815 00:21:41.847 03:33:06 -- common/autotest_common.sh@936 -- # '[' -z 1531815 ']' 00:21:41.847 03:33:06 -- common/autotest_common.sh@940 -- # kill -0 1531815 00:21:41.847 03:33:06 -- common/autotest_common.sh@941 -- # uname 00:21:41.847 03:33:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:41.847 03:33:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1531815 00:21:41.847 03:33:06 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:21:41.847 03:33:06 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:21:41.847 03:33:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1531815' 00:21:41.847 killing process with pid 1531815 00:21:41.847 03:33:06 -- common/autotest_common.sh@955 -- # kill 1531815 00:21:41.847 03:33:06 -- common/autotest_common.sh@960 -- # wait 1531815 00:21:42.120 03:33:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:42.120 03:33:06 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:21:42.120 03:33:06 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:21:42.120 03:33:06 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:42.120 03:33:06 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:21:42.120 03:33:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:42.120 03:33:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:42.120 03:33:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:44.044 03:33:08 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:21:44.044 00:21:44.044 real 0m15.680s 00:21:44.044 user 0m45.091s 00:21:44.044 sys 0m7.002s 00:21:44.044 03:33:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:44.044 03:33:08 -- common/autotest_common.sh@10 -- # set +x 00:21:44.044 ************************************ 00:21:44.044 END TEST nvmf_target_disconnect 00:21:44.044 ************************************ 00:21:44.302 03:33:09 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:21:44.303 03:33:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:44.303 03:33:09 -- common/autotest_common.sh@10 -- # set +x 00:21:44.303 03:33:09 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:21:44.303 00:21:44.303 real 15m29.748s 00:21:44.303 user 35m57.771s 00:21:44.303 sys 4m12.133s 00:21:44.303 03:33:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:44.303 03:33:09 -- common/autotest_common.sh@10 -- # set +x 00:21:44.303 ************************************ 00:21:44.303 END TEST nvmf_tcp 00:21:44.303 ************************************ 00:21:44.303 03:33:09 -- spdk/autotest.sh@286 -- # [[ 0 -eq 0 ]] 00:21:44.303 03:33:09 -- spdk/autotest.sh@287 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:21:44.303 03:33:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:44.303 03:33:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:44.303 03:33:09 -- common/autotest_common.sh@10 -- # set +x 00:21:44.303 ************************************ 00:21:44.303 START TEST spdkcli_nvmf_tcp 00:21:44.303 ************************************ 00:21:44.303 03:33:09 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:21:44.303 * Looking for test storage... 00:21:44.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:21:44.303 03:33:09 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:21:44.303 03:33:09 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:21:44.303 03:33:09 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:21:44.303 03:33:09 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:44.303 03:33:09 -- nvmf/common.sh@7 -- # uname -s 00:21:44.303 03:33:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:44.303 03:33:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:44.303 03:33:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:44.303 03:33:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:44.303 03:33:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:44.303 03:33:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:44.303 03:33:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:44.303 03:33:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:44.303 03:33:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:44.303 03:33:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:44.303 03:33:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:21:44.303 03:33:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:21:44.303 03:33:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:44.303 03:33:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:44.303 03:33:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:44.303 03:33:09 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:44.303 03:33:09 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:44.303 03:33:09 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:44.303 03:33:09 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:44.303 03:33:09 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:44.303 03:33:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.303 03:33:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.303 03:33:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.303 03:33:09 -- paths/export.sh@5 -- # export PATH 00:21:44.303 03:33:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.303 03:33:09 -- nvmf/common.sh@47 -- # : 0 00:21:44.303 03:33:09 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:44.303 03:33:09 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:44.303 03:33:09 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:44.303 03:33:09 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:44.303 03:33:09 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:44.303 03:33:09 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:44.303 03:33:09 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:44.303 03:33:09 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:44.303 03:33:09 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:21:44.303 03:33:09 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:21:44.303 03:33:09 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:21:44.303 03:33:09 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:21:44.303 03:33:09 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:44.303 03:33:09 -- common/autotest_common.sh@10 -- # set +x 00:21:44.303 03:33:09 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:21:44.303 03:33:09 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1533601 00:21:44.303 03:33:09 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:21:44.303 03:33:09 -- spdkcli/common.sh@34 -- # waitforlisten 1533601 00:21:44.303 03:33:09 -- common/autotest_common.sh@817 -- # '[' -z 1533601 ']' 00:21:44.303 03:33:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:44.303 03:33:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:44.303 03:33:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:44.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:44.303 03:33:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:44.303 03:33:09 -- common/autotest_common.sh@10 -- # set +x 00:21:44.303 [2024-04-27 03:33:09.269799] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:21:44.303 [2024-04-27 03:33:09.269897] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1533601 ] 00:21:44.562 EAL: No free 2048 kB hugepages reported on node 1 00:21:44.562 [2024-04-27 03:33:09.328294] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:21:44.562 [2024-04-27 03:33:09.433075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:44.562 [2024-04-27 03:33:09.433079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:44.822 03:33:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:44.822 03:33:09 -- common/autotest_common.sh@850 -- # return 0 00:21:44.822 03:33:09 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:21:44.822 03:33:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:44.822 03:33:09 -- common/autotest_common.sh@10 -- # set +x 00:21:44.822 03:33:09 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:21:44.822 03:33:09 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:21:44.822 03:33:09 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:21:44.822 03:33:09 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:44.822 03:33:09 -- common/autotest_common.sh@10 -- # set +x 00:21:44.823 03:33:09 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:21:44.823 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:21:44.823 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:21:44.823 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:21:44.823 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:21:44.823 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:21:44.823 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:21:44.823 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:21:44.823 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:21:44.823 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:21:44.823 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:21:44.823 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:21:44.823 ' 00:21:45.081 [2024-04-27 03:33:09.982375] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:21:47.621 [2024-04-27 03:33:12.148367] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:48.554 [2024-04-27 03:33:13.384757] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:21:51.091 [2024-04-27 03:33:15.663828] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:21:52.998 [2024-04-27 03:33:17.622043] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:21:54.376 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:21:54.376 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:21:54.376 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:21:54.376 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:21:54.376 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:21:54.376 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:21:54.376 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:21:54.376 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:21:54.376 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:21:54.376 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:21:54.376 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:21:54.376 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:21:54.376 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:21:54.376 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:21:54.376 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:21:54.376 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:21:54.376 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:21:54.377 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:21:54.377 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:21:54.377 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:21:54.377 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:21:54.377 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:21:54.377 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:21:54.377 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:21:54.377 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:21:54.377 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:21:54.377 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:21:54.377 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:21:54.377 03:33:19 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:21:54.377 03:33:19 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:54.377 03:33:19 -- common/autotest_common.sh@10 -- # set +x 00:21:54.377 03:33:19 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:21:54.377 03:33:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:54.377 03:33:19 -- common/autotest_common.sh@10 -- # set +x 00:21:54.377 03:33:19 -- spdkcli/nvmf.sh@69 -- # check_match 00:21:54.377 03:33:19 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:21:54.944 03:33:19 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:21:54.945 03:33:19 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:21:54.945 03:33:19 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:21:54.945 03:33:19 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:54.945 03:33:19 -- common/autotest_common.sh@10 -- # set +x 00:21:54.945 03:33:19 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:21:54.945 03:33:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:54.945 03:33:19 -- common/autotest_common.sh@10 -- # set +x 00:21:54.945 03:33:19 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:21:54.945 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:21:54.945 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:21:54.945 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:21:54.945 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:21:54.945 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:21:54.945 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:21:54.945 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:21:54.945 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:21:54.945 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:21:54.945 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:21:54.945 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:21:54.945 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:21:54.945 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:21:54.945 ' 00:22:00.225 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:22:00.225 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:22:00.225 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:22:00.225 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:22:00.225 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:22:00.225 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:22:00.225 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:22:00.225 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:22:00.225 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:22:00.225 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:22:00.225 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:22:00.225 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:22:00.225 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:22:00.225 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:22:00.225 03:33:24 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:22:00.225 03:33:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:00.225 03:33:25 -- common/autotest_common.sh@10 -- # set +x 00:22:00.225 03:33:25 -- spdkcli/nvmf.sh@90 -- # killprocess 1533601 00:22:00.225 03:33:25 -- common/autotest_common.sh@936 -- # '[' -z 1533601 ']' 00:22:00.225 03:33:25 -- common/autotest_common.sh@940 -- # kill -0 1533601 00:22:00.225 03:33:25 -- common/autotest_common.sh@941 -- # uname 00:22:00.225 03:33:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:00.225 03:33:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1533601 00:22:00.225 03:33:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:00.225 03:33:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:00.225 03:33:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1533601' 00:22:00.225 killing process with pid 1533601 00:22:00.225 03:33:25 -- common/autotest_common.sh@955 -- # kill 1533601 00:22:00.225 [2024-04-27 03:33:25.047804] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:00.225 03:33:25 -- common/autotest_common.sh@960 -- # wait 1533601 00:22:00.485 03:33:25 -- spdkcli/nvmf.sh@1 -- # cleanup 00:22:00.485 03:33:25 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:22:00.485 03:33:25 -- spdkcli/common.sh@13 -- # '[' -n 1533601 ']' 00:22:00.485 03:33:25 -- spdkcli/common.sh@14 -- # killprocess 1533601 00:22:00.485 03:33:25 -- common/autotest_common.sh@936 -- # '[' -z 1533601 ']' 00:22:00.485 03:33:25 -- common/autotest_common.sh@940 -- # kill -0 1533601 00:22:00.485 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1533601) - No such process 00:22:00.485 03:33:25 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1533601 is not found' 00:22:00.485 Process with pid 1533601 is not found 00:22:00.485 03:33:25 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:22:00.485 03:33:25 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:22:00.485 03:33:25 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:22:00.485 00:22:00.485 real 0m16.169s 00:22:00.485 user 0m34.232s 00:22:00.485 sys 0m0.795s 00:22:00.485 03:33:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:00.485 03:33:25 -- common/autotest_common.sh@10 -- # set +x 00:22:00.485 ************************************ 00:22:00.485 END TEST spdkcli_nvmf_tcp 00:22:00.485 ************************************ 00:22:00.485 03:33:25 -- spdk/autotest.sh@288 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:22:00.485 03:33:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:00.485 03:33:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:00.485 03:33:25 -- common/autotest_common.sh@10 -- # set +x 00:22:00.744 ************************************ 00:22:00.744 START TEST nvmf_identify_passthru 00:22:00.744 ************************************ 00:22:00.744 03:33:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:22:00.744 * Looking for test storage... 00:22:00.744 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:00.744 03:33:25 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:00.744 03:33:25 -- nvmf/common.sh@7 -- # uname -s 00:22:00.744 03:33:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:00.744 03:33:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:00.744 03:33:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:00.744 03:33:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:00.744 03:33:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:00.744 03:33:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:00.744 03:33:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:00.744 03:33:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:00.745 03:33:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:00.745 03:33:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:00.745 03:33:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:22:00.745 03:33:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:22:00.745 03:33:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:00.745 03:33:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:00.745 03:33:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:00.745 03:33:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:00.745 03:33:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:00.745 03:33:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:00.745 03:33:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:00.745 03:33:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:00.745 03:33:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.745 03:33:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.745 03:33:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.745 03:33:25 -- paths/export.sh@5 -- # export PATH 00:22:00.745 03:33:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.745 03:33:25 -- nvmf/common.sh@47 -- # : 0 00:22:00.745 03:33:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:00.745 03:33:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:00.745 03:33:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:00.745 03:33:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:00.745 03:33:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:00.745 03:33:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:00.745 03:33:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:00.745 03:33:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:00.745 03:33:25 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:00.745 03:33:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:00.745 03:33:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:00.745 03:33:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:00.745 03:33:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.745 03:33:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.745 03:33:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.745 03:33:25 -- paths/export.sh@5 -- # export PATH 00:22:00.745 03:33:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:00.745 03:33:25 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:22:00.745 03:33:25 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:22:00.745 03:33:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:00.745 03:33:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:00.745 03:33:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:00.745 03:33:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:00.745 03:33:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:00.745 03:33:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:22:00.745 03:33:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:00.745 03:33:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:00.745 03:33:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:00.745 03:33:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:00.745 03:33:25 -- common/autotest_common.sh@10 -- # set +x 00:22:02.651 03:33:27 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:02.651 03:33:27 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:02.651 03:33:27 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:02.651 03:33:27 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:02.651 03:33:27 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:02.651 03:33:27 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:02.651 03:33:27 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:02.651 03:33:27 -- nvmf/common.sh@295 -- # net_devs=() 00:22:02.651 03:33:27 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:02.651 03:33:27 -- nvmf/common.sh@296 -- # e810=() 00:22:02.651 03:33:27 -- nvmf/common.sh@296 -- # local -ga e810 00:22:02.651 03:33:27 -- nvmf/common.sh@297 -- # x722=() 00:22:02.651 03:33:27 -- nvmf/common.sh@297 -- # local -ga x722 00:22:02.651 03:33:27 -- nvmf/common.sh@298 -- # mlx=() 00:22:02.651 03:33:27 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:02.651 03:33:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:02.651 03:33:27 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:02.651 03:33:27 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:22:02.651 03:33:27 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:02.651 03:33:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:02.651 03:33:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:22:02.651 Found 0000:09:00.0 (0x8086 - 0x159b) 00:22:02.651 03:33:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:02.651 03:33:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:22:02.651 Found 0000:09:00.1 (0x8086 - 0x159b) 00:22:02.651 03:33:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:02.651 03:33:27 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:02.651 03:33:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:02.651 03:33:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:02.651 03:33:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:02.651 03:33:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:22:02.651 Found net devices under 0000:09:00.0: cvl_0_0 00:22:02.651 03:33:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:02.651 03:33:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:02.651 03:33:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:02.651 03:33:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:02.651 03:33:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:02.651 03:33:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:22:02.651 Found net devices under 0000:09:00.1: cvl_0_1 00:22:02.651 03:33:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:02.651 03:33:27 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:02.651 03:33:27 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:02.651 03:33:27 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:22:02.651 03:33:27 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:22:02.651 03:33:27 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:02.651 03:33:27 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:02.651 03:33:27 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:02.651 03:33:27 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:22:02.651 03:33:27 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:02.651 03:33:27 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:02.651 03:33:27 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:22:02.651 03:33:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:02.652 03:33:27 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:02.652 03:33:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:22:02.652 03:33:27 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:22:02.652 03:33:27 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:22:02.652 03:33:27 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:02.652 03:33:27 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:02.652 03:33:27 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:02.652 03:33:27 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:22:02.652 03:33:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:02.652 03:33:27 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:02.652 03:33:27 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:02.652 03:33:27 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:22:02.652 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:02.652 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:22:02.652 00:22:02.652 --- 10.0.0.2 ping statistics --- 00:22:02.652 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:02.652 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:22:02.652 03:33:27 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:02.911 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:02.911 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:22:02.911 00:22:02.911 --- 10.0.0.1 ping statistics --- 00:22:02.911 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:02.911 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:22:02.911 03:33:27 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:02.911 03:33:27 -- nvmf/common.sh@411 -- # return 0 00:22:02.911 03:33:27 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:02.911 03:33:27 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:02.911 03:33:27 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:22:02.911 03:33:27 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:22:02.911 03:33:27 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:02.911 03:33:27 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:22:02.911 03:33:27 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:22:02.911 03:33:27 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:22:02.911 03:33:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:02.911 03:33:27 -- common/autotest_common.sh@10 -- # set +x 00:22:02.911 03:33:27 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:22:02.911 03:33:27 -- common/autotest_common.sh@1510 -- # bdfs=() 00:22:02.911 03:33:27 -- common/autotest_common.sh@1510 -- # local bdfs 00:22:02.911 03:33:27 -- common/autotest_common.sh@1511 -- # bdfs=($(get_nvme_bdfs)) 00:22:02.911 03:33:27 -- common/autotest_common.sh@1511 -- # get_nvme_bdfs 00:22:02.911 03:33:27 -- common/autotest_common.sh@1499 -- # bdfs=() 00:22:02.911 03:33:27 -- common/autotest_common.sh@1499 -- # local bdfs 00:22:02.911 03:33:27 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:22:02.911 03:33:27 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:22:02.911 03:33:27 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:22:02.911 03:33:27 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:22:02.911 03:33:27 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:0b:00.0 00:22:02.911 03:33:27 -- common/autotest_common.sh@1513 -- # echo 0000:0b:00.0 00:22:02.911 03:33:27 -- target/identify_passthru.sh@16 -- # bdf=0000:0b:00.0 00:22:02.911 03:33:27 -- target/identify_passthru.sh@17 -- # '[' -z 0000:0b:00.0 ']' 00:22:02.911 03:33:27 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:0b:00.0' -i 0 00:22:02.911 03:33:27 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:22:02.911 03:33:27 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:22:02.911 EAL: No free 2048 kB hugepages reported on node 1 00:22:07.111 03:33:31 -- target/identify_passthru.sh@23 -- # nvme_serial_number=BTLJ72430F4Q1P0FGN 00:22:07.111 03:33:31 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:0b:00.0' -i 0 00:22:07.111 03:33:31 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:22:07.111 03:33:31 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:22:07.111 EAL: No free 2048 kB hugepages reported on node 1 00:22:11.305 03:33:35 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:22:11.305 03:33:35 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:22:11.305 03:33:35 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:11.305 03:33:35 -- common/autotest_common.sh@10 -- # set +x 00:22:11.305 03:33:36 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:22:11.305 03:33:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:11.305 03:33:36 -- common/autotest_common.sh@10 -- # set +x 00:22:11.305 03:33:36 -- target/identify_passthru.sh@31 -- # nvmfpid=1538238 00:22:11.305 03:33:36 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:11.305 03:33:36 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:11.305 03:33:36 -- target/identify_passthru.sh@35 -- # waitforlisten 1538238 00:22:11.305 03:33:36 -- common/autotest_common.sh@817 -- # '[' -z 1538238 ']' 00:22:11.305 03:33:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:11.305 03:33:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:11.305 03:33:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:11.305 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:11.305 03:33:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:11.305 03:33:36 -- common/autotest_common.sh@10 -- # set +x 00:22:11.305 [2024-04-27 03:33:36.048899] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:22:11.305 [2024-04-27 03:33:36.049002] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:11.305 EAL: No free 2048 kB hugepages reported on node 1 00:22:11.305 [2024-04-27 03:33:36.118651] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:11.305 [2024-04-27 03:33:36.226950] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:11.305 [2024-04-27 03:33:36.227019] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:11.305 [2024-04-27 03:33:36.227047] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:11.305 [2024-04-27 03:33:36.227059] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:11.305 [2024-04-27 03:33:36.227070] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:11.305 [2024-04-27 03:33:36.227199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:11.305 [2024-04-27 03:33:36.230265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:11.305 [2024-04-27 03:33:36.230332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:11.305 [2024-04-27 03:33:36.230336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:11.305 03:33:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:11.305 03:33:36 -- common/autotest_common.sh@850 -- # return 0 00:22:11.305 03:33:36 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:22:11.305 03:33:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:11.305 03:33:36 -- common/autotest_common.sh@10 -- # set +x 00:22:11.305 INFO: Log level set to 20 00:22:11.305 INFO: Requests: 00:22:11.305 { 00:22:11.305 "jsonrpc": "2.0", 00:22:11.305 "method": "nvmf_set_config", 00:22:11.305 "id": 1, 00:22:11.305 "params": { 00:22:11.305 "admin_cmd_passthru": { 00:22:11.305 "identify_ctrlr": true 00:22:11.305 } 00:22:11.305 } 00:22:11.305 } 00:22:11.305 00:22:11.305 INFO: response: 00:22:11.305 { 00:22:11.305 "jsonrpc": "2.0", 00:22:11.305 "id": 1, 00:22:11.305 "result": true 00:22:11.305 } 00:22:11.305 00:22:11.305 03:33:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:11.305 03:33:36 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:22:11.305 03:33:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:11.305 03:33:36 -- common/autotest_common.sh@10 -- # set +x 00:22:11.305 INFO: Setting log level to 20 00:22:11.305 INFO: Setting log level to 20 00:22:11.305 INFO: Log level set to 20 00:22:11.305 INFO: Log level set to 20 00:22:11.305 INFO: Requests: 00:22:11.305 { 00:22:11.305 "jsonrpc": "2.0", 00:22:11.305 "method": "framework_start_init", 00:22:11.305 "id": 1 00:22:11.305 } 00:22:11.305 00:22:11.305 INFO: Requests: 00:22:11.305 { 00:22:11.305 "jsonrpc": "2.0", 00:22:11.305 "method": "framework_start_init", 00:22:11.305 "id": 1 00:22:11.305 } 00:22:11.305 00:22:11.565 [2024-04-27 03:33:36.375616] nvmf_tgt.c: 453:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:22:11.565 INFO: response: 00:22:11.565 { 00:22:11.565 "jsonrpc": "2.0", 00:22:11.565 "id": 1, 00:22:11.565 "result": true 00:22:11.565 } 00:22:11.565 00:22:11.565 INFO: response: 00:22:11.565 { 00:22:11.565 "jsonrpc": "2.0", 00:22:11.565 "id": 1, 00:22:11.565 "result": true 00:22:11.565 } 00:22:11.565 00:22:11.565 03:33:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:11.565 03:33:36 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:11.565 03:33:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:11.565 03:33:36 -- common/autotest_common.sh@10 -- # set +x 00:22:11.565 INFO: Setting log level to 40 00:22:11.565 INFO: Setting log level to 40 00:22:11.565 INFO: Setting log level to 40 00:22:11.565 [2024-04-27 03:33:36.385754] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:11.565 03:33:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:11.565 03:33:36 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:22:11.565 03:33:36 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:11.565 03:33:36 -- common/autotest_common.sh@10 -- # set +x 00:22:11.565 03:33:36 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:0b:00.0 00:22:11.565 03:33:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:11.565 03:33:36 -- common/autotest_common.sh@10 -- # set +x 00:22:14.892 Nvme0n1 00:22:14.892 03:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:14.892 03:33:39 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:22:14.892 03:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:14.892 03:33:39 -- common/autotest_common.sh@10 -- # set +x 00:22:14.892 03:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:14.892 03:33:39 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:22:14.892 03:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:14.892 03:33:39 -- common/autotest_common.sh@10 -- # set +x 00:22:14.892 03:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:14.892 03:33:39 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:14.892 03:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:14.892 03:33:39 -- common/autotest_common.sh@10 -- # set +x 00:22:14.892 [2024-04-27 03:33:39.274554] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:14.892 03:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:14.892 03:33:39 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:22:14.892 03:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:14.892 03:33:39 -- common/autotest_common.sh@10 -- # set +x 00:22:14.892 [2024-04-27 03:33:39.282271] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:14.892 [ 00:22:14.892 { 00:22:14.892 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:14.892 "subtype": "Discovery", 00:22:14.892 "listen_addresses": [], 00:22:14.892 "allow_any_host": true, 00:22:14.892 "hosts": [] 00:22:14.892 }, 00:22:14.892 { 00:22:14.892 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:14.892 "subtype": "NVMe", 00:22:14.892 "listen_addresses": [ 00:22:14.892 { 00:22:14.892 "transport": "TCP", 00:22:14.892 "trtype": "TCP", 00:22:14.892 "adrfam": "IPv4", 00:22:14.892 "traddr": "10.0.0.2", 00:22:14.892 "trsvcid": "4420" 00:22:14.892 } 00:22:14.892 ], 00:22:14.892 "allow_any_host": true, 00:22:14.892 "hosts": [], 00:22:14.892 "serial_number": "SPDK00000000000001", 00:22:14.892 "model_number": "SPDK bdev Controller", 00:22:14.892 "max_namespaces": 1, 00:22:14.892 "min_cntlid": 1, 00:22:14.892 "max_cntlid": 65519, 00:22:14.892 "namespaces": [ 00:22:14.892 { 00:22:14.892 "nsid": 1, 00:22:14.892 "bdev_name": "Nvme0n1", 00:22:14.892 "name": "Nvme0n1", 00:22:14.892 "nguid": "326C1D37713E483CAD4A75B775931333", 00:22:14.892 "uuid": "326c1d37-713e-483c-ad4a-75b775931333" 00:22:14.892 } 00:22:14.892 ] 00:22:14.892 } 00:22:14.892 ] 00:22:14.892 03:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:14.892 03:33:39 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:14.893 03:33:39 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:22:14.893 03:33:39 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:22:14.893 EAL: No free 2048 kB hugepages reported on node 1 00:22:14.893 03:33:39 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=BTLJ72430F4Q1P0FGN 00:22:14.893 03:33:39 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:14.893 03:33:39 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:22:14.893 03:33:39 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:22:14.893 EAL: No free 2048 kB hugepages reported on node 1 00:22:14.893 03:33:39 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:22:14.893 03:33:39 -- target/identify_passthru.sh@63 -- # '[' BTLJ72430F4Q1P0FGN '!=' BTLJ72430F4Q1P0FGN ']' 00:22:14.893 03:33:39 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:22:14.893 03:33:39 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:14.893 03:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:14.893 03:33:39 -- common/autotest_common.sh@10 -- # set +x 00:22:14.893 03:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:14.893 03:33:39 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:22:14.893 03:33:39 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:22:14.893 03:33:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:14.893 03:33:39 -- nvmf/common.sh@117 -- # sync 00:22:14.893 03:33:39 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:22:14.893 03:33:39 -- nvmf/common.sh@120 -- # set +e 00:22:14.893 03:33:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:14.893 03:33:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:22:14.893 rmmod nvme_tcp 00:22:14.893 rmmod nvme_fabrics 00:22:14.893 rmmod nvme_keyring 00:22:14.893 03:33:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:14.893 03:33:39 -- nvmf/common.sh@124 -- # set -e 00:22:14.893 03:33:39 -- nvmf/common.sh@125 -- # return 0 00:22:14.893 03:33:39 -- nvmf/common.sh@478 -- # '[' -n 1538238 ']' 00:22:14.893 03:33:39 -- nvmf/common.sh@479 -- # killprocess 1538238 00:22:14.893 03:33:39 -- common/autotest_common.sh@936 -- # '[' -z 1538238 ']' 00:22:14.893 03:33:39 -- common/autotest_common.sh@940 -- # kill -0 1538238 00:22:14.893 03:33:39 -- common/autotest_common.sh@941 -- # uname 00:22:14.893 03:33:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:14.893 03:33:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1538238 00:22:14.893 03:33:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:14.893 03:33:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:14.893 03:33:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1538238' 00:22:14.893 killing process with pid 1538238 00:22:14.893 03:33:39 -- common/autotest_common.sh@955 -- # kill 1538238 00:22:14.893 [2024-04-27 03:33:39.645371] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:14.893 03:33:39 -- common/autotest_common.sh@960 -- # wait 1538238 00:22:16.271 03:33:41 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:16.271 03:33:41 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:22:16.271 03:33:41 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:22:16.271 03:33:41 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:16.271 03:33:41 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:22:16.271 03:33:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:16.271 03:33:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:22:16.271 03:33:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:18.812 03:33:43 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:22:18.812 00:22:18.812 real 0m17.770s 00:22:18.812 user 0m25.997s 00:22:18.812 sys 0m2.331s 00:22:18.812 03:33:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:18.812 03:33:43 -- common/autotest_common.sh@10 -- # set +x 00:22:18.812 ************************************ 00:22:18.812 END TEST nvmf_identify_passthru 00:22:18.812 ************************************ 00:22:18.812 03:33:43 -- spdk/autotest.sh@290 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:22:18.812 03:33:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:18.812 03:33:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:18.812 03:33:43 -- common/autotest_common.sh@10 -- # set +x 00:22:18.812 ************************************ 00:22:18.812 START TEST nvmf_dif 00:22:18.812 ************************************ 00:22:18.812 03:33:43 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:22:18.812 * Looking for test storage... 00:22:18.812 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:18.812 03:33:43 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:18.812 03:33:43 -- nvmf/common.sh@7 -- # uname -s 00:22:18.812 03:33:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:18.812 03:33:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:18.812 03:33:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:18.812 03:33:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:18.812 03:33:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:18.812 03:33:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:18.812 03:33:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:18.812 03:33:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:18.812 03:33:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:18.812 03:33:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:18.812 03:33:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:22:18.812 03:33:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:22:18.812 03:33:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:18.812 03:33:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:18.812 03:33:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:18.812 03:33:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:18.812 03:33:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:18.812 03:33:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:18.812 03:33:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:18.812 03:33:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:18.812 03:33:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.812 03:33:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.812 03:33:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.812 03:33:43 -- paths/export.sh@5 -- # export PATH 00:22:18.812 03:33:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.812 03:33:43 -- nvmf/common.sh@47 -- # : 0 00:22:18.812 03:33:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:18.812 03:33:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:18.812 03:33:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:18.812 03:33:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:18.812 03:33:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:18.812 03:33:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:18.812 03:33:43 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:18.812 03:33:43 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:18.812 03:33:43 -- target/dif.sh@15 -- # NULL_META=16 00:22:18.812 03:33:43 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:22:18.812 03:33:43 -- target/dif.sh@15 -- # NULL_SIZE=64 00:22:18.812 03:33:43 -- target/dif.sh@15 -- # NULL_DIF=1 00:22:18.812 03:33:43 -- target/dif.sh@135 -- # nvmftestinit 00:22:18.812 03:33:43 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:22:18.812 03:33:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:18.812 03:33:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:18.812 03:33:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:18.812 03:33:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:18.812 03:33:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:18.812 03:33:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:22:18.812 03:33:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:18.812 03:33:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:18.812 03:33:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:18.812 03:33:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:18.812 03:33:43 -- common/autotest_common.sh@10 -- # set +x 00:22:20.712 03:33:45 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:20.712 03:33:45 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:20.712 03:33:45 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:20.712 03:33:45 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:20.712 03:33:45 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:20.712 03:33:45 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:20.712 03:33:45 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:20.712 03:33:45 -- nvmf/common.sh@295 -- # net_devs=() 00:22:20.712 03:33:45 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:20.712 03:33:45 -- nvmf/common.sh@296 -- # e810=() 00:22:20.712 03:33:45 -- nvmf/common.sh@296 -- # local -ga e810 00:22:20.712 03:33:45 -- nvmf/common.sh@297 -- # x722=() 00:22:20.712 03:33:45 -- nvmf/common.sh@297 -- # local -ga x722 00:22:20.712 03:33:45 -- nvmf/common.sh@298 -- # mlx=() 00:22:20.712 03:33:45 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:20.712 03:33:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:20.712 03:33:45 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:20.712 03:33:45 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:22:20.712 03:33:45 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:20.712 03:33:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:20.712 03:33:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:22:20.712 Found 0000:09:00.0 (0x8086 - 0x159b) 00:22:20.712 03:33:45 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:20.712 03:33:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:22:20.712 Found 0000:09:00.1 (0x8086 - 0x159b) 00:22:20.712 03:33:45 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:20.712 03:33:45 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:20.712 03:33:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:20.712 03:33:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:20.712 03:33:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:20.712 03:33:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:22:20.712 Found net devices under 0000:09:00.0: cvl_0_0 00:22:20.712 03:33:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:20.712 03:33:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:20.712 03:33:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:20.712 03:33:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:20.712 03:33:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:20.712 03:33:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:22:20.712 Found net devices under 0000:09:00.1: cvl_0_1 00:22:20.712 03:33:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:20.712 03:33:45 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:20.712 03:33:45 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:20.712 03:33:45 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:22:20.712 03:33:45 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:22:20.712 03:33:45 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:20.712 03:33:45 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:20.712 03:33:45 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:20.712 03:33:45 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:22:20.712 03:33:45 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:20.712 03:33:45 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:20.712 03:33:45 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:22:20.712 03:33:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:20.712 03:33:45 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:20.712 03:33:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:22:20.712 03:33:45 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:22:20.712 03:33:45 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:22:20.712 03:33:45 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:20.712 03:33:45 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:20.712 03:33:45 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:20.712 03:33:45 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:22:20.712 03:33:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:20.712 03:33:45 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:20.712 03:33:45 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:20.712 03:33:45 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:22:20.712 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:20.712 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.142 ms 00:22:20.712 00:22:20.712 --- 10.0.0.2 ping statistics --- 00:22:20.712 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:20.712 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:22:20.712 03:33:45 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:20.712 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:20.712 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.168 ms 00:22:20.712 00:22:20.712 --- 10.0.0.1 ping statistics --- 00:22:20.712 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:20.712 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:22:20.712 03:33:45 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:20.712 03:33:45 -- nvmf/common.sh@411 -- # return 0 00:22:20.712 03:33:45 -- nvmf/common.sh@439 -- # '[' iso == iso ']' 00:22:20.712 03:33:45 -- nvmf/common.sh@440 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:22:21.643 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:22:21.643 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:22:21.643 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:22:21.643 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:22:21.643 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:22:21.643 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:22:21.643 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:22:21.643 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:22:21.643 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:22:21.643 0000:0b:00.0 (8086 0a54): Already using the vfio-pci driver 00:22:21.643 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:22:21.643 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:22:21.644 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:22:21.644 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:22:21.644 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:22:21.644 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:22:21.644 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:22:21.901 03:33:46 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:21.901 03:33:46 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:22:21.901 03:33:46 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:22:21.901 03:33:46 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:21.901 03:33:46 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:22:21.901 03:33:46 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:22:21.901 03:33:46 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:22:21.901 03:33:46 -- target/dif.sh@137 -- # nvmfappstart 00:22:21.901 03:33:46 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:21.901 03:33:46 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:21.901 03:33:46 -- common/autotest_common.sh@10 -- # set +x 00:22:21.901 03:33:46 -- nvmf/common.sh@470 -- # nvmfpid=1541394 00:22:21.901 03:33:46 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:22:21.901 03:33:46 -- nvmf/common.sh@471 -- # waitforlisten 1541394 00:22:21.901 03:33:46 -- common/autotest_common.sh@817 -- # '[' -z 1541394 ']' 00:22:21.901 03:33:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:21.901 03:33:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:21.901 03:33:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:21.901 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:21.901 03:33:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:21.901 03:33:46 -- common/autotest_common.sh@10 -- # set +x 00:22:21.901 [2024-04-27 03:33:46.772104] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:22:21.901 [2024-04-27 03:33:46.772202] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:21.901 EAL: No free 2048 kB hugepages reported on node 1 00:22:21.901 [2024-04-27 03:33:46.840302] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:22.158 [2024-04-27 03:33:46.953757] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:22.158 [2024-04-27 03:33:46.953826] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:22.158 [2024-04-27 03:33:46.953851] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:22.158 [2024-04-27 03:33:46.953864] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:22.158 [2024-04-27 03:33:46.953876] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:22.158 [2024-04-27 03:33:46.953907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:23.094 03:33:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:23.094 03:33:47 -- common/autotest_common.sh@850 -- # return 0 00:22:23.094 03:33:47 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:23.094 03:33:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:23.094 03:33:47 -- common/autotest_common.sh@10 -- # set +x 00:22:23.094 03:33:47 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:23.094 03:33:47 -- target/dif.sh@139 -- # create_transport 00:22:23.094 03:33:47 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:22:23.094 03:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:23.094 03:33:47 -- common/autotest_common.sh@10 -- # set +x 00:22:23.094 [2024-04-27 03:33:47.757671] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:23.094 03:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:23.094 03:33:47 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:22:23.094 03:33:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:23.094 03:33:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:23.094 03:33:47 -- common/autotest_common.sh@10 -- # set +x 00:22:23.094 ************************************ 00:22:23.094 START TEST fio_dif_1_default 00:22:23.094 ************************************ 00:22:23.094 03:33:47 -- common/autotest_common.sh@1111 -- # fio_dif_1 00:22:23.094 03:33:47 -- target/dif.sh@86 -- # create_subsystems 0 00:22:23.094 03:33:47 -- target/dif.sh@28 -- # local sub 00:22:23.094 03:33:47 -- target/dif.sh@30 -- # for sub in "$@" 00:22:23.094 03:33:47 -- target/dif.sh@31 -- # create_subsystem 0 00:22:23.094 03:33:47 -- target/dif.sh@18 -- # local sub_id=0 00:22:23.094 03:33:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:22:23.094 03:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:23.094 03:33:47 -- common/autotest_common.sh@10 -- # set +x 00:22:23.094 bdev_null0 00:22:23.094 03:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:23.094 03:33:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:22:23.094 03:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:23.094 03:33:47 -- common/autotest_common.sh@10 -- # set +x 00:22:23.094 03:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:23.094 03:33:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:22:23.094 03:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:23.094 03:33:47 -- common/autotest_common.sh@10 -- # set +x 00:22:23.094 03:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:23.094 03:33:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:23.094 03:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:23.094 03:33:47 -- common/autotest_common.sh@10 -- # set +x 00:22:23.094 [2024-04-27 03:33:47.894194] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:23.094 03:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:23.094 03:33:47 -- target/dif.sh@87 -- # fio /dev/fd/62 00:22:23.094 03:33:47 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:22:23.094 03:33:47 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:22:23.094 03:33:47 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:23.094 03:33:47 -- nvmf/common.sh@521 -- # config=() 00:22:23.094 03:33:47 -- nvmf/common.sh@521 -- # local subsystem config 00:22:23.094 03:33:47 -- target/dif.sh@82 -- # gen_fio_conf 00:22:23.094 03:33:47 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:23.094 03:33:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:23.094 03:33:47 -- target/dif.sh@54 -- # local file 00:22:23.094 03:33:47 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:22:23.094 03:33:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:23.094 { 00:22:23.094 "params": { 00:22:23.094 "name": "Nvme$subsystem", 00:22:23.094 "trtype": "$TEST_TRANSPORT", 00:22:23.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.094 "adrfam": "ipv4", 00:22:23.094 "trsvcid": "$NVMF_PORT", 00:22:23.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.094 "hdgst": ${hdgst:-false}, 00:22:23.094 "ddgst": ${ddgst:-false} 00:22:23.094 }, 00:22:23.094 "method": "bdev_nvme_attach_controller" 00:22:23.094 } 00:22:23.094 EOF 00:22:23.094 )") 00:22:23.094 03:33:47 -- target/dif.sh@56 -- # cat 00:22:23.094 03:33:47 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:22:23.094 03:33:47 -- common/autotest_common.sh@1325 -- # local sanitizers 00:22:23.094 03:33:47 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:23.094 03:33:47 -- common/autotest_common.sh@1327 -- # shift 00:22:23.094 03:33:47 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:22:23.094 03:33:47 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:23.094 03:33:47 -- nvmf/common.sh@543 -- # cat 00:22:23.094 03:33:47 -- target/dif.sh@72 -- # (( file = 1 )) 00:22:23.094 03:33:47 -- target/dif.sh@72 -- # (( file <= files )) 00:22:23.094 03:33:47 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:23.094 03:33:47 -- common/autotest_common.sh@1331 -- # grep libasan 00:22:23.094 03:33:47 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:23.094 03:33:47 -- nvmf/common.sh@545 -- # jq . 00:22:23.094 03:33:47 -- nvmf/common.sh@546 -- # IFS=, 00:22:23.094 03:33:47 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:22:23.094 "params": { 00:22:23.094 "name": "Nvme0", 00:22:23.094 "trtype": "tcp", 00:22:23.094 "traddr": "10.0.0.2", 00:22:23.094 "adrfam": "ipv4", 00:22:23.094 "trsvcid": "4420", 00:22:23.094 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:23.094 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:22:23.094 "hdgst": false, 00:22:23.094 "ddgst": false 00:22:23.094 }, 00:22:23.094 "method": "bdev_nvme_attach_controller" 00:22:23.094 }' 00:22:23.094 03:33:47 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:23.094 03:33:47 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:23.094 03:33:47 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:23.094 03:33:47 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:23.094 03:33:47 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:22:23.094 03:33:47 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:23.094 03:33:47 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:23.094 03:33:47 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:23.095 03:33:47 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:22:23.095 03:33:47 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:23.353 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:22:23.353 fio-3.35 00:22:23.353 Starting 1 thread 00:22:23.353 EAL: No free 2048 kB hugepages reported on node 1 00:22:35.549 00:22:35.549 filename0: (groupid=0, jobs=1): err= 0: pid=1541757: Sat Apr 27 03:33:58 2024 00:22:35.549 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10007msec) 00:22:35.549 slat (nsec): min=6728, max=46090, avg=8554.04, stdev=2985.22 00:22:35.549 clat (usec): min=40856, max=43394, avg=40983.23, stdev=155.73 00:22:35.549 lat (usec): min=40872, max=43433, avg=40991.78, stdev=156.32 00:22:35.549 clat percentiles (usec): 00:22:35.549 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:22:35.549 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:22:35.549 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:22:35.549 | 99.00th=[41157], 99.50th=[41157], 99.90th=[43254], 99.95th=[43254], 00:22:35.549 | 99.99th=[43254] 00:22:35.549 bw ( KiB/s): min= 384, max= 416, per=99.46%, avg=388.80, stdev=11.72, samples=20 00:22:35.549 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:22:35.549 lat (msec) : 50=100.00% 00:22:35.549 cpu : usr=90.05%, sys=9.67%, ctx=18, majf=0, minf=147 00:22:35.549 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:22:35.549 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.549 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.549 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.549 latency : target=0, window=0, percentile=100.00%, depth=4 00:22:35.549 00:22:35.549 Run status group 0 (all jobs): 00:22:35.549 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10007-10007msec 00:22:35.549 03:33:58 -- target/dif.sh@88 -- # destroy_subsystems 0 00:22:35.549 03:33:58 -- target/dif.sh@43 -- # local sub 00:22:35.549 03:33:58 -- target/dif.sh@45 -- # for sub in "$@" 00:22:35.549 03:33:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:22:35.549 03:33:58 -- target/dif.sh@36 -- # local sub_id=0 00:22:35.549 03:33:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:22:35.549 03:33:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.549 03:33:58 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 03:33:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.549 03:33:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:22:35.549 03:33:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.549 03:33:58 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 03:33:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.549 00:22:35.549 real 0m11.142s 00:22:35.549 user 0m10.186s 00:22:35.549 sys 0m1.259s 00:22:35.549 03:33:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:35.549 03:33:59 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 ************************************ 00:22:35.549 END TEST fio_dif_1_default 00:22:35.549 ************************************ 00:22:35.549 03:33:59 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:22:35.549 03:33:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:35.549 03:33:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:35.549 03:33:59 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 ************************************ 00:22:35.549 START TEST fio_dif_1_multi_subsystems 00:22:35.549 ************************************ 00:22:35.549 03:33:59 -- common/autotest_common.sh@1111 -- # fio_dif_1_multi_subsystems 00:22:35.549 03:33:59 -- target/dif.sh@92 -- # local files=1 00:22:35.549 03:33:59 -- target/dif.sh@94 -- # create_subsystems 0 1 00:22:35.549 03:33:59 -- target/dif.sh@28 -- # local sub 00:22:35.549 03:33:59 -- target/dif.sh@30 -- # for sub in "$@" 00:22:35.549 03:33:59 -- target/dif.sh@31 -- # create_subsystem 0 00:22:35.549 03:33:59 -- target/dif.sh@18 -- # local sub_id=0 00:22:35.549 03:33:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:22:35.549 03:33:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.549 03:33:59 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 bdev_null0 00:22:35.549 03:33:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.549 03:33:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:22:35.549 03:33:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.549 03:33:59 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 03:33:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.549 03:33:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:22:35.549 03:33:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.549 03:33:59 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 03:33:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.549 03:33:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:35.549 03:33:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.549 03:33:59 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 [2024-04-27 03:33:59.150958] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:35.549 03:33:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.549 03:33:59 -- target/dif.sh@30 -- # for sub in "$@" 00:22:35.549 03:33:59 -- target/dif.sh@31 -- # create_subsystem 1 00:22:35.549 03:33:59 -- target/dif.sh@18 -- # local sub_id=1 00:22:35.549 03:33:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:22:35.549 03:33:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.549 03:33:59 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 bdev_null1 00:22:35.549 03:33:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.549 03:33:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:22:35.549 03:33:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.549 03:33:59 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 03:33:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.549 03:33:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:22:35.549 03:33:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.549 03:33:59 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 03:33:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.549 03:33:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:35.549 03:33:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.549 03:33:59 -- common/autotest_common.sh@10 -- # set +x 00:22:35.549 03:33:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.549 03:33:59 -- target/dif.sh@95 -- # fio /dev/fd/62 00:22:35.549 03:33:59 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:22:35.549 03:33:59 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:22:35.549 03:33:59 -- nvmf/common.sh@521 -- # config=() 00:22:35.549 03:33:59 -- nvmf/common.sh@521 -- # local subsystem config 00:22:35.549 03:33:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:35.549 03:33:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:35.549 { 00:22:35.549 "params": { 00:22:35.549 "name": "Nvme$subsystem", 00:22:35.549 "trtype": "$TEST_TRANSPORT", 00:22:35.549 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.549 "adrfam": "ipv4", 00:22:35.549 "trsvcid": "$NVMF_PORT", 00:22:35.549 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.549 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.549 "hdgst": ${hdgst:-false}, 00:22:35.549 "ddgst": ${ddgst:-false} 00:22:35.549 }, 00:22:35.549 "method": "bdev_nvme_attach_controller" 00:22:35.549 } 00:22:35.549 EOF 00:22:35.549 )") 00:22:35.549 03:33:59 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:35.550 03:33:59 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:35.550 03:33:59 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:22:35.550 03:33:59 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:22:35.550 03:33:59 -- common/autotest_common.sh@1325 -- # local sanitizers 00:22:35.550 03:33:59 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:35.550 03:33:59 -- target/dif.sh@82 -- # gen_fio_conf 00:22:35.550 03:33:59 -- common/autotest_common.sh@1327 -- # shift 00:22:35.550 03:33:59 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:22:35.550 03:33:59 -- target/dif.sh@54 -- # local file 00:22:35.550 03:33:59 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:35.550 03:33:59 -- target/dif.sh@56 -- # cat 00:22:35.550 03:33:59 -- nvmf/common.sh@543 -- # cat 00:22:35.550 03:33:59 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:35.550 03:33:59 -- common/autotest_common.sh@1331 -- # grep libasan 00:22:35.550 03:33:59 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:35.550 03:33:59 -- target/dif.sh@72 -- # (( file = 1 )) 00:22:35.550 03:33:59 -- target/dif.sh@72 -- # (( file <= files )) 00:22:35.550 03:33:59 -- target/dif.sh@73 -- # cat 00:22:35.550 03:33:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:35.550 03:33:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:35.550 { 00:22:35.550 "params": { 00:22:35.550 "name": "Nvme$subsystem", 00:22:35.550 "trtype": "$TEST_TRANSPORT", 00:22:35.550 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.550 "adrfam": "ipv4", 00:22:35.550 "trsvcid": "$NVMF_PORT", 00:22:35.550 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.550 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.550 "hdgst": ${hdgst:-false}, 00:22:35.550 "ddgst": ${ddgst:-false} 00:22:35.550 }, 00:22:35.550 "method": "bdev_nvme_attach_controller" 00:22:35.550 } 00:22:35.550 EOF 00:22:35.550 )") 00:22:35.550 03:33:59 -- nvmf/common.sh@543 -- # cat 00:22:35.550 03:33:59 -- target/dif.sh@72 -- # (( file++ )) 00:22:35.550 03:33:59 -- target/dif.sh@72 -- # (( file <= files )) 00:22:35.550 03:33:59 -- nvmf/common.sh@545 -- # jq . 00:22:35.550 03:33:59 -- nvmf/common.sh@546 -- # IFS=, 00:22:35.550 03:33:59 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:22:35.550 "params": { 00:22:35.550 "name": "Nvme0", 00:22:35.550 "trtype": "tcp", 00:22:35.550 "traddr": "10.0.0.2", 00:22:35.550 "adrfam": "ipv4", 00:22:35.550 "trsvcid": "4420", 00:22:35.550 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:35.550 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:22:35.550 "hdgst": false, 00:22:35.550 "ddgst": false 00:22:35.550 }, 00:22:35.550 "method": "bdev_nvme_attach_controller" 00:22:35.550 },{ 00:22:35.550 "params": { 00:22:35.550 "name": "Nvme1", 00:22:35.550 "trtype": "tcp", 00:22:35.550 "traddr": "10.0.0.2", 00:22:35.550 "adrfam": "ipv4", 00:22:35.550 "trsvcid": "4420", 00:22:35.550 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:35.550 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:35.550 "hdgst": false, 00:22:35.550 "ddgst": false 00:22:35.550 }, 00:22:35.550 "method": "bdev_nvme_attach_controller" 00:22:35.550 }' 00:22:35.550 03:33:59 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:35.550 03:33:59 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:35.550 03:33:59 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:35.550 03:33:59 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:35.550 03:33:59 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:22:35.550 03:33:59 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:35.550 03:33:59 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:35.550 03:33:59 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:35.550 03:33:59 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:22:35.550 03:33:59 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:35.550 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:22:35.550 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:22:35.550 fio-3.35 00:22:35.550 Starting 2 threads 00:22:35.550 EAL: No free 2048 kB hugepages reported on node 1 00:22:45.562 00:22:45.562 filename0: (groupid=0, jobs=1): err= 0: pid=1543171: Sat Apr 27 03:34:10 2024 00:22:45.562 read: IOPS=142, BW=570KiB/s (584kB/s)(5728KiB/10041msec) 00:22:45.562 slat (nsec): min=7039, max=76060, avg=9705.66, stdev=2987.83 00:22:45.562 clat (usec): min=618, max=43247, avg=28015.44, stdev=18815.07 00:22:45.562 lat (usec): min=626, max=43276, avg=28025.14, stdev=18815.05 00:22:45.562 clat percentiles (usec): 00:22:45.562 | 1.00th=[ 635], 5.00th=[ 725], 10.00th=[ 873], 20.00th=[ 889], 00:22:45.562 | 30.00th=[ 906], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:22:45.562 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:22:45.562 | 99.00th=[41157], 99.50th=[41157], 99.90th=[43254], 99.95th=[43254], 00:22:45.562 | 99.99th=[43254] 00:22:45.562 bw ( KiB/s): min= 384, max= 768, per=59.82%, avg=571.20, stdev=181.99, samples=20 00:22:45.562 iops : min= 96, max= 192, avg=142.80, stdev=45.50, samples=20 00:22:45.562 lat (usec) : 750=5.31%, 1000=27.09% 00:22:45.562 lat (msec) : 50=67.60% 00:22:45.562 cpu : usr=94.98%, sys=4.74%, ctx=13, majf=0, minf=161 00:22:45.562 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:22:45.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.562 issued rwts: total=1432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.562 latency : target=0, window=0, percentile=100.00%, depth=4 00:22:45.562 filename1: (groupid=0, jobs=1): err= 0: pid=1543172: Sat Apr 27 03:34:10 2024 00:22:45.562 read: IOPS=96, BW=386KiB/s (395kB/s)(3856KiB/10001msec) 00:22:45.562 slat (nsec): min=7341, max=31888, avg=10625.13, stdev=4613.08 00:22:45.562 clat (usec): min=40708, max=43361, avg=41461.11, stdev=545.47 00:22:45.562 lat (usec): min=40717, max=43385, avg=41471.74, stdev=546.66 00:22:45.562 clat percentiles (usec): 00:22:45.562 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:22:45.562 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:22:45.562 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:22:45.562 | 99.00th=[43254], 99.50th=[43254], 99.90th=[43254], 99.95th=[43254], 00:22:45.562 | 99.99th=[43254] 00:22:45.562 bw ( KiB/s): min= 384, max= 416, per=40.34%, avg=385.68, stdev= 7.34, samples=19 00:22:45.562 iops : min= 96, max= 104, avg=96.42, stdev= 1.84, samples=19 00:22:45.562 lat (msec) : 50=100.00% 00:22:45.562 cpu : usr=94.79%, sys=4.83%, ctx=47, majf=0, minf=100 00:22:45.562 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:22:45.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.562 issued rwts: total=964,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.562 latency : target=0, window=0, percentile=100.00%, depth=4 00:22:45.562 00:22:45.562 Run status group 0 (all jobs): 00:22:45.562 READ: bw=954KiB/s (977kB/s), 386KiB/s-570KiB/s (395kB/s-584kB/s), io=9584KiB (9814kB), run=10001-10041msec 00:22:45.819 03:34:10 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:22:45.819 03:34:10 -- target/dif.sh@43 -- # local sub 00:22:45.819 03:34:10 -- target/dif.sh@45 -- # for sub in "$@" 00:22:45.819 03:34:10 -- target/dif.sh@46 -- # destroy_subsystem 0 00:22:45.819 03:34:10 -- target/dif.sh@36 -- # local sub_id=0 00:22:45.819 03:34:10 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:22:45.819 03:34:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:45.819 03:34:10 -- common/autotest_common.sh@10 -- # set +x 00:22:45.819 03:34:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:45.819 03:34:10 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:22:45.819 03:34:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:45.819 03:34:10 -- common/autotest_common.sh@10 -- # set +x 00:22:45.819 03:34:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:45.819 03:34:10 -- target/dif.sh@45 -- # for sub in "$@" 00:22:45.819 03:34:10 -- target/dif.sh@46 -- # destroy_subsystem 1 00:22:45.819 03:34:10 -- target/dif.sh@36 -- # local sub_id=1 00:22:45.819 03:34:10 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:45.819 03:34:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:45.819 03:34:10 -- common/autotest_common.sh@10 -- # set +x 00:22:45.819 03:34:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:45.819 03:34:10 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:22:45.819 03:34:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:45.819 03:34:10 -- common/autotest_common.sh@10 -- # set +x 00:22:45.819 03:34:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:45.819 00:22:45.819 real 0m11.456s 00:22:45.819 user 0m20.410s 00:22:45.819 sys 0m1.299s 00:22:45.819 03:34:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:45.819 03:34:10 -- common/autotest_common.sh@10 -- # set +x 00:22:45.819 ************************************ 00:22:45.819 END TEST fio_dif_1_multi_subsystems 00:22:45.819 ************************************ 00:22:45.819 03:34:10 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:22:45.819 03:34:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:45.819 03:34:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:45.819 03:34:10 -- common/autotest_common.sh@10 -- # set +x 00:22:45.819 ************************************ 00:22:45.819 START TEST fio_dif_rand_params 00:22:45.819 ************************************ 00:22:45.819 03:34:10 -- common/autotest_common.sh@1111 -- # fio_dif_rand_params 00:22:45.819 03:34:10 -- target/dif.sh@100 -- # local NULL_DIF 00:22:45.819 03:34:10 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:22:45.819 03:34:10 -- target/dif.sh@103 -- # NULL_DIF=3 00:22:45.819 03:34:10 -- target/dif.sh@103 -- # bs=128k 00:22:45.819 03:34:10 -- target/dif.sh@103 -- # numjobs=3 00:22:45.820 03:34:10 -- target/dif.sh@103 -- # iodepth=3 00:22:45.820 03:34:10 -- target/dif.sh@103 -- # runtime=5 00:22:45.820 03:34:10 -- target/dif.sh@105 -- # create_subsystems 0 00:22:45.820 03:34:10 -- target/dif.sh@28 -- # local sub 00:22:45.820 03:34:10 -- target/dif.sh@30 -- # for sub in "$@" 00:22:45.820 03:34:10 -- target/dif.sh@31 -- # create_subsystem 0 00:22:45.820 03:34:10 -- target/dif.sh@18 -- # local sub_id=0 00:22:45.820 03:34:10 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:22:45.820 03:34:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:45.820 03:34:10 -- common/autotest_common.sh@10 -- # set +x 00:22:45.820 bdev_null0 00:22:45.820 03:34:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:45.820 03:34:10 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:22:45.820 03:34:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:45.820 03:34:10 -- common/autotest_common.sh@10 -- # set +x 00:22:45.820 03:34:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:45.820 03:34:10 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:22:45.820 03:34:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:45.820 03:34:10 -- common/autotest_common.sh@10 -- # set +x 00:22:45.820 03:34:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:45.820 03:34:10 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:45.820 03:34:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:45.820 03:34:10 -- common/autotest_common.sh@10 -- # set +x 00:22:45.820 [2024-04-27 03:34:10.743316] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:45.820 03:34:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:45.820 03:34:10 -- target/dif.sh@106 -- # fio /dev/fd/62 00:22:45.820 03:34:10 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:22:45.820 03:34:10 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:22:45.820 03:34:10 -- nvmf/common.sh@521 -- # config=() 00:22:45.820 03:34:10 -- nvmf/common.sh@521 -- # local subsystem config 00:22:45.820 03:34:10 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:45.820 03:34:10 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:45.820 { 00:22:45.820 "params": { 00:22:45.820 "name": "Nvme$subsystem", 00:22:45.820 "trtype": "$TEST_TRANSPORT", 00:22:45.820 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.820 "adrfam": "ipv4", 00:22:45.820 "trsvcid": "$NVMF_PORT", 00:22:45.820 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.820 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.820 "hdgst": ${hdgst:-false}, 00:22:45.820 "ddgst": ${ddgst:-false} 00:22:45.820 }, 00:22:45.820 "method": "bdev_nvme_attach_controller" 00:22:45.820 } 00:22:45.820 EOF 00:22:45.820 )") 00:22:45.820 03:34:10 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:45.820 03:34:10 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:45.820 03:34:10 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:22:45.820 03:34:10 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:22:45.820 03:34:10 -- common/autotest_common.sh@1325 -- # local sanitizers 00:22:45.820 03:34:10 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:45.820 03:34:10 -- target/dif.sh@82 -- # gen_fio_conf 00:22:45.820 03:34:10 -- common/autotest_common.sh@1327 -- # shift 00:22:45.820 03:34:10 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:22:45.820 03:34:10 -- target/dif.sh@54 -- # local file 00:22:45.820 03:34:10 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:45.820 03:34:10 -- target/dif.sh@56 -- # cat 00:22:45.820 03:34:10 -- nvmf/common.sh@543 -- # cat 00:22:45.820 03:34:10 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:45.820 03:34:10 -- common/autotest_common.sh@1331 -- # grep libasan 00:22:45.820 03:34:10 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:45.820 03:34:10 -- target/dif.sh@72 -- # (( file = 1 )) 00:22:45.820 03:34:10 -- target/dif.sh@72 -- # (( file <= files )) 00:22:45.820 03:34:10 -- nvmf/common.sh@545 -- # jq . 00:22:45.820 03:34:10 -- nvmf/common.sh@546 -- # IFS=, 00:22:45.820 03:34:10 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:22:45.820 "params": { 00:22:45.820 "name": "Nvme0", 00:22:45.820 "trtype": "tcp", 00:22:45.820 "traddr": "10.0.0.2", 00:22:45.820 "adrfam": "ipv4", 00:22:45.820 "trsvcid": "4420", 00:22:45.820 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:45.820 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:22:45.820 "hdgst": false, 00:22:45.820 "ddgst": false 00:22:45.820 }, 00:22:45.820 "method": "bdev_nvme_attach_controller" 00:22:45.820 }' 00:22:45.820 03:34:10 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:45.820 03:34:10 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:45.820 03:34:10 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:45.820 03:34:10 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:45.820 03:34:10 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:22:45.820 03:34:10 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:45.820 03:34:10 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:45.820 03:34:10 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:45.820 03:34:10 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:22:45.820 03:34:10 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:46.078 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:22:46.078 ... 00:22:46.078 fio-3.35 00:22:46.078 Starting 3 threads 00:22:46.078 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.634 00:22:52.634 filename0: (groupid=0, jobs=1): err= 0: pid=1544581: Sat Apr 27 03:34:16 2024 00:22:52.634 read: IOPS=203, BW=25.4MiB/s (26.6MB/s)(127MiB/5003msec) 00:22:52.634 slat (nsec): min=4613, max=50246, avg=16605.60, stdev=5159.11 00:22:52.634 clat (usec): min=4898, max=90959, avg=14734.69, stdev=12925.03 00:22:52.634 lat (usec): min=4911, max=90974, avg=14751.30, stdev=12924.83 00:22:52.634 clat percentiles (usec): 00:22:52.634 | 1.00th=[ 5342], 5.00th=[ 6915], 10.00th=[ 7635], 20.00th=[ 8356], 00:22:52.634 | 30.00th=[ 8979], 40.00th=[ 9896], 50.00th=[11207], 60.00th=[11863], 00:22:52.634 | 70.00th=[12649], 80.00th=[13435], 90.00th=[46400], 95.00th=[51119], 00:22:52.634 | 99.00th=[53740], 99.50th=[54789], 99.90th=[90702], 99.95th=[90702], 00:22:52.634 | 99.99th=[90702] 00:22:52.634 bw ( KiB/s): min=19456, max=33536, per=31.64%, avg=25984.00, stdev=4346.56, samples=10 00:22:52.634 iops : min= 152, max= 262, avg=203.00, stdev=33.96, samples=10 00:22:52.634 lat (msec) : 10=40.71%, 20=48.97%, 50=4.82%, 100=5.51% 00:22:52.634 cpu : usr=90.66%, sys=7.08%, ctx=329, majf=0, minf=133 00:22:52.634 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:22:52.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:52.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:52.634 issued rwts: total=1017,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:52.634 latency : target=0, window=0, percentile=100.00%, depth=3 00:22:52.634 filename0: (groupid=0, jobs=1): err= 0: pid=1544582: Sat Apr 27 03:34:16 2024 00:22:52.634 read: IOPS=206, BW=25.8MiB/s (27.1MB/s)(130MiB/5045msec) 00:22:52.634 slat (nsec): min=4449, max=86557, avg=15566.88, stdev=4524.47 00:22:52.634 clat (usec): min=4816, max=88334, avg=14462.41, stdev=12900.63 00:22:52.634 lat (usec): min=4829, max=88352, avg=14477.98, stdev=12900.68 00:22:52.634 clat percentiles (usec): 00:22:52.634 | 1.00th=[ 5080], 5.00th=[ 5735], 10.00th=[ 7177], 20.00th=[ 8225], 00:22:52.634 | 30.00th=[ 8717], 40.00th=[ 9765], 50.00th=[10683], 60.00th=[11469], 00:22:52.634 | 70.00th=[11994], 80.00th=[12911], 90.00th=[46400], 95.00th=[50594], 00:22:52.634 | 99.00th=[54789], 99.50th=[55313], 99.90th=[55837], 99.95th=[88605], 00:22:52.634 | 99.99th=[88605] 00:22:52.634 bw ( KiB/s): min=19200, max=37376, per=32.42%, avg=26624.00, stdev=5000.56, samples=10 00:22:52.634 iops : min= 150, max= 292, avg=208.00, stdev=39.07, samples=10 00:22:52.634 lat (msec) : 10=41.75%, 20=47.22%, 50=5.37%, 100=5.66% 00:22:52.634 cpu : usr=94.77%, sys=4.76%, ctx=17, majf=0, minf=116 00:22:52.634 IO depths : 1=1.1%, 2=98.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:22:52.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:52.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:52.634 issued rwts: total=1042,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:52.634 latency : target=0, window=0, percentile=100.00%, depth=3 00:22:52.634 filename0: (groupid=0, jobs=1): err= 0: pid=1544583: Sat Apr 27 03:34:16 2024 00:22:52.634 read: IOPS=233, BW=29.2MiB/s (30.6MB/s)(147MiB/5043msec) 00:22:52.634 slat (nsec): min=4841, max=52150, avg=15279.31, stdev=4684.25 00:22:52.634 clat (usec): min=4760, max=56330, avg=12787.36, stdev=9795.38 00:22:52.634 lat (usec): min=4776, max=56342, avg=12802.63, stdev=9795.32 00:22:52.634 clat percentiles (usec): 00:22:52.634 | 1.00th=[ 5145], 5.00th=[ 5604], 10.00th=[ 6390], 20.00th=[ 8160], 00:22:52.634 | 30.00th=[ 8717], 40.00th=[ 9372], 50.00th=[10290], 60.00th=[11600], 00:22:52.634 | 70.00th=[12518], 80.00th=[14091], 90.00th=[15795], 95.00th=[47449], 00:22:52.634 | 99.00th=[52167], 99.50th=[52691], 99.90th=[55313], 99.95th=[56361], 00:22:52.634 | 99.99th=[56361] 00:22:52.634 bw ( KiB/s): min=22316, max=35072, per=36.66%, avg=30110.00, stdev=3686.07, samples=10 00:22:52.634 iops : min= 174, max= 274, avg=235.20, stdev=28.88, samples=10 00:22:52.634 lat (msec) : 10=46.77%, 20=47.20%, 50=3.82%, 100=2.21% 00:22:52.634 cpu : usr=94.07%, sys=5.49%, ctx=10, majf=0, minf=60 00:22:52.634 IO depths : 1=0.8%, 2=99.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:22:52.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:52.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:52.634 issued rwts: total=1178,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:52.634 latency : target=0, window=0, percentile=100.00%, depth=3 00:22:52.634 00:22:52.634 Run status group 0 (all jobs): 00:22:52.634 READ: bw=80.2MiB/s (84.1MB/s), 25.4MiB/s-29.2MiB/s (26.6MB/s-30.6MB/s), io=405MiB (424MB), run=5003-5045msec 00:22:52.634 03:34:16 -- target/dif.sh@107 -- # destroy_subsystems 0 00:22:52.634 03:34:16 -- target/dif.sh@43 -- # local sub 00:22:52.634 03:34:16 -- target/dif.sh@45 -- # for sub in "$@" 00:22:52.634 03:34:16 -- target/dif.sh@46 -- # destroy_subsystem 0 00:22:52.634 03:34:16 -- target/dif.sh@36 -- # local sub_id=0 00:22:52.634 03:34:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:22:52.634 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.634 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.634 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.634 03:34:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@109 -- # NULL_DIF=2 00:22:52.635 03:34:16 -- target/dif.sh@109 -- # bs=4k 00:22:52.635 03:34:16 -- target/dif.sh@109 -- # numjobs=8 00:22:52.635 03:34:16 -- target/dif.sh@109 -- # iodepth=16 00:22:52.635 03:34:16 -- target/dif.sh@109 -- # runtime= 00:22:52.635 03:34:16 -- target/dif.sh@109 -- # files=2 00:22:52.635 03:34:16 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:22:52.635 03:34:16 -- target/dif.sh@28 -- # local sub 00:22:52.635 03:34:16 -- target/dif.sh@30 -- # for sub in "$@" 00:22:52.635 03:34:16 -- target/dif.sh@31 -- # create_subsystem 0 00:22:52.635 03:34:16 -- target/dif.sh@18 -- # local sub_id=0 00:22:52.635 03:34:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 bdev_null0 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 [2024-04-27 03:34:16.884290] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@30 -- # for sub in "$@" 00:22:52.635 03:34:16 -- target/dif.sh@31 -- # create_subsystem 1 00:22:52.635 03:34:16 -- target/dif.sh@18 -- # local sub_id=1 00:22:52.635 03:34:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 bdev_null1 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@30 -- # for sub in "$@" 00:22:52.635 03:34:16 -- target/dif.sh@31 -- # create_subsystem 2 00:22:52.635 03:34:16 -- target/dif.sh@18 -- # local sub_id=2 00:22:52.635 03:34:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 bdev_null2 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:52.635 03:34:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.635 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:22:52.635 03:34:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.635 03:34:16 -- target/dif.sh@112 -- # fio /dev/fd/62 00:22:52.635 03:34:16 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:22:52.635 03:34:16 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:52.635 03:34:16 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:22:52.635 03:34:16 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:52.635 03:34:16 -- nvmf/common.sh@521 -- # config=() 00:22:52.635 03:34:16 -- target/dif.sh@82 -- # gen_fio_conf 00:22:52.635 03:34:16 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:22:52.635 03:34:16 -- nvmf/common.sh@521 -- # local subsystem config 00:22:52.635 03:34:16 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:22:52.635 03:34:16 -- target/dif.sh@54 -- # local file 00:22:52.635 03:34:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:52.635 03:34:16 -- common/autotest_common.sh@1325 -- # local sanitizers 00:22:52.635 03:34:16 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:52.635 03:34:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:52.635 { 00:22:52.635 "params": { 00:22:52.635 "name": "Nvme$subsystem", 00:22:52.635 "trtype": "$TEST_TRANSPORT", 00:22:52.635 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.635 "adrfam": "ipv4", 00:22:52.635 "trsvcid": "$NVMF_PORT", 00:22:52.635 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.635 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.635 "hdgst": ${hdgst:-false}, 00:22:52.635 "ddgst": ${ddgst:-false} 00:22:52.635 }, 00:22:52.635 "method": "bdev_nvme_attach_controller" 00:22:52.635 } 00:22:52.635 EOF 00:22:52.635 )") 00:22:52.635 03:34:16 -- target/dif.sh@56 -- # cat 00:22:52.635 03:34:16 -- common/autotest_common.sh@1327 -- # shift 00:22:52.635 03:34:16 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:22:52.635 03:34:16 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:52.635 03:34:16 -- nvmf/common.sh@543 -- # cat 00:22:52.635 03:34:16 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:52.635 03:34:16 -- common/autotest_common.sh@1331 -- # grep libasan 00:22:52.635 03:34:16 -- target/dif.sh@72 -- # (( file = 1 )) 00:22:52.635 03:34:16 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:52.635 03:34:16 -- target/dif.sh@72 -- # (( file <= files )) 00:22:52.635 03:34:16 -- target/dif.sh@73 -- # cat 00:22:52.635 03:34:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:52.635 03:34:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:52.635 { 00:22:52.635 "params": { 00:22:52.636 "name": "Nvme$subsystem", 00:22:52.636 "trtype": "$TEST_TRANSPORT", 00:22:52.636 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.636 "adrfam": "ipv4", 00:22:52.636 "trsvcid": "$NVMF_PORT", 00:22:52.636 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.636 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.636 "hdgst": ${hdgst:-false}, 00:22:52.636 "ddgst": ${ddgst:-false} 00:22:52.636 }, 00:22:52.636 "method": "bdev_nvme_attach_controller" 00:22:52.636 } 00:22:52.636 EOF 00:22:52.636 )") 00:22:52.636 03:34:16 -- target/dif.sh@72 -- # (( file++ )) 00:22:52.636 03:34:16 -- target/dif.sh@72 -- # (( file <= files )) 00:22:52.636 03:34:16 -- target/dif.sh@73 -- # cat 00:22:52.636 03:34:16 -- nvmf/common.sh@543 -- # cat 00:22:52.636 03:34:16 -- target/dif.sh@72 -- # (( file++ )) 00:22:52.636 03:34:16 -- target/dif.sh@72 -- # (( file <= files )) 00:22:52.636 03:34:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:52.636 03:34:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:52.636 { 00:22:52.636 "params": { 00:22:52.636 "name": "Nvme$subsystem", 00:22:52.636 "trtype": "$TEST_TRANSPORT", 00:22:52.636 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.636 "adrfam": "ipv4", 00:22:52.636 "trsvcid": "$NVMF_PORT", 00:22:52.636 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.636 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.636 "hdgst": ${hdgst:-false}, 00:22:52.636 "ddgst": ${ddgst:-false} 00:22:52.636 }, 00:22:52.636 "method": "bdev_nvme_attach_controller" 00:22:52.636 } 00:22:52.636 EOF 00:22:52.636 )") 00:22:52.636 03:34:16 -- nvmf/common.sh@543 -- # cat 00:22:52.636 03:34:16 -- nvmf/common.sh@545 -- # jq . 00:22:52.636 03:34:16 -- nvmf/common.sh@546 -- # IFS=, 00:22:52.636 03:34:16 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:22:52.636 "params": { 00:22:52.636 "name": "Nvme0", 00:22:52.636 "trtype": "tcp", 00:22:52.636 "traddr": "10.0.0.2", 00:22:52.636 "adrfam": "ipv4", 00:22:52.636 "trsvcid": "4420", 00:22:52.636 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:52.636 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:22:52.636 "hdgst": false, 00:22:52.636 "ddgst": false 00:22:52.636 }, 00:22:52.636 "method": "bdev_nvme_attach_controller" 00:22:52.636 },{ 00:22:52.636 "params": { 00:22:52.636 "name": "Nvme1", 00:22:52.636 "trtype": "tcp", 00:22:52.636 "traddr": "10.0.0.2", 00:22:52.636 "adrfam": "ipv4", 00:22:52.636 "trsvcid": "4420", 00:22:52.636 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:52.636 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:52.636 "hdgst": false, 00:22:52.636 "ddgst": false 00:22:52.636 }, 00:22:52.636 "method": "bdev_nvme_attach_controller" 00:22:52.636 },{ 00:22:52.636 "params": { 00:22:52.636 "name": "Nvme2", 00:22:52.636 "trtype": "tcp", 00:22:52.636 "traddr": "10.0.0.2", 00:22:52.636 "adrfam": "ipv4", 00:22:52.636 "trsvcid": "4420", 00:22:52.636 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:52.636 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:52.636 "hdgst": false, 00:22:52.636 "ddgst": false 00:22:52.636 }, 00:22:52.636 "method": "bdev_nvme_attach_controller" 00:22:52.636 }' 00:22:52.636 03:34:16 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:52.636 03:34:16 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:52.636 03:34:16 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:52.636 03:34:16 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:22:52.636 03:34:16 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:22:52.636 03:34:16 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:52.636 03:34:16 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:52.636 03:34:16 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:52.636 03:34:16 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:22:52.636 03:34:16 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:22:52.636 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:22:52.636 ... 00:22:52.636 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:22:52.636 ... 00:22:52.636 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:22:52.636 ... 00:22:52.636 fio-3.35 00:22:52.636 Starting 24 threads 00:22:52.636 EAL: No free 2048 kB hugepages reported on node 1 00:23:04.904 00:23:04.904 filename0: (groupid=0, jobs=1): err= 0: pid=1545447: Sat Apr 27 03:34:28 2024 00:23:04.904 read: IOPS=74, BW=300KiB/s (307kB/s)(3008KiB/10030msec) 00:23:04.904 slat (usec): min=4, max=129, avg=23.46, stdev=23.67 00:23:04.904 clat (msec): min=31, max=316, avg=213.20, stdev=87.27 00:23:04.904 lat (msec): min=31, max=316, avg=213.23, stdev=87.28 00:23:04.904 clat percentiles (msec): 00:23:04.904 | 1.00th=[ 32], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 157], 00:23:04.904 | 30.00th=[ 207], 40.00th=[ 241], 50.00th=[ 251], 60.00th=[ 262], 00:23:04.904 | 70.00th=[ 271], 80.00th=[ 275], 90.00th=[ 279], 95.00th=[ 292], 00:23:04.904 | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 317], 00:23:04.904 | 99.99th=[ 317] 00:23:04.904 bw ( KiB/s): min= 144, max= 1040, per=4.35%, avg=294.40, stdev=179.85, samples=20 00:23:04.904 iops : min= 36, max= 260, avg=73.60, stdev=44.96, samples=20 00:23:04.904 lat (msec) : 50=17.02%, 250=31.12%, 500=51.86% 00:23:04.905 cpu : usr=97.38%, sys=1.76%, ctx=84, majf=0, minf=33 00:23:04.905 IO depths : 1=2.8%, 2=9.0%, 4=25.0%, 8=53.5%, 16=9.7%, 32=0.0%, >=64=0.0% 00:23:04.905 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.905 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.905 issued rwts: total=752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.905 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.905 filename0: (groupid=0, jobs=1): err= 0: pid=1545448: Sat Apr 27 03:34:28 2024 00:23:04.905 read: IOPS=57, BW=230KiB/s (236kB/s)(2304KiB/10001msec) 00:23:04.905 slat (nsec): min=3870, max=47361, avg=16733.09, stdev=8644.54 00:23:04.905 clat (msec): min=31, max=560, avg=277.63, stdev=147.31 00:23:04.905 lat (msec): min=31, max=560, avg=277.65, stdev=147.31 00:23:04.905 clat percentiles (msec): 00:23:04.905 | 1.00th=[ 32], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 42], 00:23:04.905 | 30.00th=[ 218], 40.00th=[ 279], 50.00th=[ 334], 60.00th=[ 363], 00:23:04.905 | 70.00th=[ 388], 80.00th=[ 409], 90.00th=[ 430], 95.00th=[ 451], 00:23:04.905 | 99.00th=[ 527], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], 00:23:04.905 | 99.99th=[ 558] 00:23:04.905 bw ( KiB/s): min= 128, max= 256, per=2.68%, avg=181.89, stdev=63.38, samples=19 00:23:04.905 iops : min= 32, max= 64, avg=45.47, stdev=15.84, samples=19 00:23:04.905 lat (msec) : 50=22.22%, 250=9.38%, 500=66.32%, 750=2.08% 00:23:04.905 cpu : usr=98.34%, sys=1.27%, ctx=13, majf=0, minf=24 00:23:04.905 IO depths : 1=4.0%, 2=10.2%, 4=25.0%, 8=52.3%, 16=8.5%, 32=0.0%, >=64=0.0% 00:23:04.905 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.905 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.905 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.905 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.905 filename0: (groupid=0, jobs=1): err= 0: pid=1545449: Sat Apr 27 03:34:28 2024 00:23:04.905 read: IOPS=72, BW=290KiB/s (297kB/s)(2904KiB/10014msec) 00:23:04.905 slat (usec): min=8, max=108, avg=33.83, stdev=29.62 00:23:04.905 clat (msec): min=15, max=474, avg=220.42, stdev=108.72 00:23:04.905 lat (msec): min=15, max=474, avg=220.46, stdev=108.70 00:23:04.905 clat percentiles (msec): 00:23:04.905 | 1.00th=[ 16], 5.00th=[ 24], 10.00th=[ 31], 20.00th=[ 37], 00:23:04.905 | 30.00th=[ 209], 40.00th=[ 251], 50.00th=[ 262], 60.00th=[ 268], 00:23:04.905 | 70.00th=[ 275], 80.00th=[ 279], 90.00th=[ 334], 95.00th=[ 363], 00:23:04.905 | 99.00th=[ 409], 99.50th=[ 430], 99.90th=[ 477], 99.95th=[ 477], 00:23:04.905 | 99.99th=[ 477] 00:23:04.905 bw ( KiB/s): min= 128, max= 384, per=3.39%, avg=229.05, stdev=63.79, samples=19 00:23:04.905 iops : min= 32, max= 96, avg=57.26, stdev=15.95, samples=19 00:23:04.905 lat (msec) : 20=2.20%, 50=18.46%, 100=1.38%, 250=16.25%, 500=61.71% 00:23:04.905 cpu : usr=97.97%, sys=1.40%, ctx=39, majf=0, minf=17 00:23:04.905 IO depths : 1=2.2%, 2=6.2%, 4=18.2%, 8=63.1%, 16=10.3%, 32=0.0%, >=64=0.0% 00:23:04.905 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.905 complete : 0=0.0%, 4=92.3%, 8=2.1%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.905 issued rwts: total=726,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.905 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.905 filename0: (groupid=0, jobs=1): err= 0: pid=1545450: Sat Apr 27 03:34:28 2024 00:23:04.905 read: IOPS=80, BW=321KiB/s (328kB/s)(3216KiB/10027msec) 00:23:04.905 slat (usec): min=5, max=116, avg=12.52, stdev= 7.00 00:23:04.905 clat (msec): min=20, max=413, avg=199.13, stdev=99.38 00:23:04.905 lat (msec): min=20, max=413, avg=199.14, stdev=99.38 00:23:04.905 clat percentiles (msec): 00:23:04.905 | 1.00th=[ 22], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 32], 00:23:04.905 | 30.00th=[ 190], 40.00th=[ 211], 50.00th=[ 239], 60.00th=[ 255], 00:23:04.905 | 70.00th=[ 264], 80.00th=[ 271], 90.00th=[ 279], 95.00th=[ 292], 00:23:04.905 | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 414], 99.95th=[ 414], 00:23:04.905 | 99.99th=[ 414] 00:23:04.905 bw ( KiB/s): min= 176, max= 1536, per=4.72%, avg=319.20, stdev=289.47, samples=20 00:23:04.905 iops : min= 44, max= 384, avg=79.80, stdev=72.37, samples=20 00:23:04.905 lat (msec) : 50=20.65%, 100=2.74%, 250=33.33%, 500=43.28% 00:23:04.905 cpu : usr=98.50%, sys=1.12%, ctx=24, majf=0, minf=19 00:23:04.905 IO depths : 1=0.5%, 2=1.9%, 4=10.1%, 8=75.4%, 16=12.2%, 32=0.0%, >=64=0.0% 00:23:04.905 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.905 complete : 0=0.0%, 4=89.8%, 8=4.9%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.905 issued rwts: total=804,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.905 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.905 filename0: (groupid=0, jobs=1): err= 0: pid=1545451: Sat Apr 27 03:34:28 2024 00:23:04.905 read: IOPS=60, BW=243KiB/s (249kB/s)(2432KiB/10009msec) 00:23:04.905 slat (usec): min=8, max=105, avg=45.27, stdev=27.27 00:23:04.905 clat (msec): min=10, max=509, avg=262.96, stdev=143.37 00:23:04.905 lat (msec): min=10, max=509, avg=263.01, stdev=143.37 00:23:04.905 clat percentiles (msec): 00:23:04.905 | 1.00th=[ 11], 5.00th=[ 30], 10.00th=[ 36], 20.00th=[ 38], 00:23:04.905 | 30.00th=[ 218], 40.00th=[ 275], 50.00th=[ 292], 60.00th=[ 334], 00:23:04.905 | 70.00th=[ 363], 80.00th=[ 393], 90.00th=[ 422], 95.00th=[ 443], 00:23:04.905 | 99.00th=[ 460], 99.50th=[ 468], 99.90th=[ 510], 99.95th=[ 510], 00:23:04.905 | 99.99th=[ 510] 00:23:04.905 bw ( KiB/s): min= 128, max= 1152, per=3.49%, avg=236.80, stdev=224.70, samples=20 00:23:04.905 iops : min= 32, max= 288, avg=59.20, stdev=56.17, samples=20 00:23:04.905 lat (msec) : 20=2.63%, 50=21.05%, 250=8.55%, 500=67.43%, 750=0.33% 00:23:04.905 cpu : usr=98.17%, sys=1.37%, ctx=17, majf=0, minf=23 00:23:04.905 IO depths : 1=5.6%, 2=11.8%, 4=25.0%, 8=50.7%, 16=6.9%, 32=0.0%, >=64=0.0% 00:23:04.905 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.905 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.905 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.905 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.905 filename0: (groupid=0, jobs=1): err= 0: pid=1545452: Sat Apr 27 03:34:28 2024 00:23:04.905 read: IOPS=75, BW=300KiB/s (308kB/s)(3008KiB/10015msec) 00:23:04.905 slat (usec): min=8, max=109, avg=22.73, stdev=17.26 00:23:04.905 clat (msec): min=27, max=372, avg=212.89, stdev=90.11 00:23:04.905 lat (msec): min=27, max=372, avg=212.91, stdev=90.10 00:23:04.905 clat percentiles (msec): 00:23:04.905 | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 174], 00:23:04.905 | 30.00th=[ 201], 40.00th=[ 215], 50.00th=[ 247], 60.00th=[ 262], 00:23:04.905 | 70.00th=[ 268], 80.00th=[ 275], 90.00th=[ 288], 95.00th=[ 292], 00:23:04.905 | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 372], 99.95th=[ 372], 00:23:04.905 | 99.99th=[ 372] 00:23:04.905 bw ( KiB/s): min= 144, max= 1152, per=4.35%, avg=294.40, stdev=207.15, samples=20 00:23:04.906 iops : min= 36, max= 288, avg=73.60, stdev=51.79, samples=20 00:23:04.906 lat (msec) : 50=17.02%, 100=0.27%, 250=35.11%, 500=47.61% 00:23:04.906 cpu : usr=98.08%, sys=1.32%, ctx=41, majf=0, minf=22 00:23:04.906 IO depths : 1=2.3%, 2=8.5%, 4=25.0%, 8=54.0%, 16=10.2%, 32=0.0%, >=64=0.0% 00:23:04.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.906 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.906 issued rwts: total=752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.906 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.906 filename0: (groupid=0, jobs=1): err= 0: pid=1545453: Sat Apr 27 03:34:28 2024 00:23:04.906 read: IOPS=75, BW=300KiB/s (308kB/s)(3008KiB/10015msec) 00:23:04.906 slat (usec): min=8, max=127, avg=23.74, stdev=16.68 00:23:04.906 clat (msec): min=27, max=381, avg=212.88, stdev=90.46 00:23:04.906 lat (msec): min=27, max=381, avg=212.90, stdev=90.46 00:23:04.906 clat percentiles (msec): 00:23:04.906 | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 174], 00:23:04.906 | 30.00th=[ 201], 40.00th=[ 215], 50.00th=[ 247], 60.00th=[ 262], 00:23:04.906 | 70.00th=[ 268], 80.00th=[ 275], 90.00th=[ 288], 95.00th=[ 292], 00:23:04.906 | 99.00th=[ 355], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], 00:23:04.906 | 99.99th=[ 380] 00:23:04.906 bw ( KiB/s): min= 144, max= 1152, per=4.35%, avg=294.40, stdev=207.15, samples=20 00:23:04.906 iops : min= 36, max= 288, avg=73.60, stdev=51.79, samples=20 00:23:04.906 lat (msec) : 50=17.02%, 100=0.27%, 250=35.64%, 500=47.07% 00:23:04.906 cpu : usr=98.44%, sys=1.11%, ctx=18, majf=0, minf=30 00:23:04.906 IO depths : 1=2.9%, 2=9.2%, 4=25.0%, 8=53.3%, 16=9.6%, 32=0.0%, >=64=0.0% 00:23:04.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.906 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.906 issued rwts: total=752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.906 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.906 filename0: (groupid=0, jobs=1): err= 0: pid=1545454: Sat Apr 27 03:34:28 2024 00:23:04.906 read: IOPS=65, BW=261KiB/s (267kB/s)(2608KiB/10010msec) 00:23:04.906 slat (nsec): min=4102, max=59545, avg=17009.62, stdev=10193.47 00:23:04.906 clat (msec): min=21, max=538, avg=245.49, stdev=131.59 00:23:04.906 lat (msec): min=21, max=538, avg=245.50, stdev=131.59 00:23:04.906 clat percentiles (msec): 00:23:04.906 | 1.00th=[ 27], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 44], 00:23:04.906 | 30.00th=[ 203], 40.00th=[ 253], 50.00th=[ 268], 60.00th=[ 279], 00:23:04.906 | 70.00th=[ 334], 80.00th=[ 363], 90.00th=[ 397], 95.00th=[ 451], 00:23:04.906 | 99.00th=[ 464], 99.50th=[ 498], 99.90th=[ 542], 99.95th=[ 542], 00:23:04.906 | 99.99th=[ 542] 00:23:04.906 bw ( KiB/s): min= 128, max= 368, per=3.02%, avg=204.63, stdev=71.87, samples=19 00:23:04.906 iops : min= 32, max= 92, avg=51.16, stdev=17.97, samples=19 00:23:04.906 lat (msec) : 50=22.09%, 250=17.18%, 500=60.43%, 750=0.31% 00:23:04.906 cpu : usr=98.31%, sys=1.25%, ctx=25, majf=0, minf=26 00:23:04.906 IO depths : 1=3.2%, 2=8.4%, 4=21.8%, 8=57.2%, 16=9.4%, 32=0.0%, >=64=0.0% 00:23:04.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.906 complete : 0=0.0%, 4=93.3%, 8=1.1%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.906 issued rwts: total=652,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.906 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.906 filename1: (groupid=0, jobs=1): err= 0: pid=1545455: Sat Apr 27 03:34:28 2024 00:23:04.906 read: IOPS=67, BW=269KiB/s (275kB/s)(2688KiB/10006msec) 00:23:04.906 slat (usec): min=8, max=117, avg=29.71, stdev=26.20 00:23:04.906 clat (msec): min=12, max=546, avg=238.00, stdev=122.37 00:23:04.906 lat (msec): min=12, max=546, avg=238.03, stdev=122.38 00:23:04.906 clat percentiles (msec): 00:23:04.906 | 1.00th=[ 13], 5.00th=[ 34], 10.00th=[ 36], 20.00th=[ 42], 00:23:04.906 | 30.00th=[ 205], 40.00th=[ 259], 50.00th=[ 268], 60.00th=[ 275], 00:23:04.906 | 70.00th=[ 288], 80.00th=[ 338], 90.00th=[ 368], 95.00th=[ 409], 00:23:04.906 | 99.00th=[ 430], 99.50th=[ 527], 99.90th=[ 550], 99.95th=[ 550], 00:23:04.906 | 99.99th=[ 550] 00:23:04.906 bw ( KiB/s): min= 128, max= 368, per=3.18%, avg=215.58, stdev=69.00, samples=19 00:23:04.906 iops : min= 32, max= 92, avg=53.89, stdev=17.25, samples=19 00:23:04.906 lat (msec) : 20=2.38%, 50=19.05%, 250=14.88%, 500=63.10%, 750=0.60% 00:23:04.906 cpu : usr=98.21%, sys=1.24%, ctx=26, majf=0, minf=28 00:23:04.906 IO depths : 1=3.4%, 2=9.7%, 4=25.0%, 8=52.8%, 16=9.1%, 32=0.0%, >=64=0.0% 00:23:04.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.906 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.906 issued rwts: total=672,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.906 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.906 filename1: (groupid=0, jobs=1): err= 0: pid=1545456: Sat Apr 27 03:34:28 2024 00:23:04.906 read: IOPS=74, BW=296KiB/s (303kB/s)(2968KiB/10015msec) 00:23:04.906 slat (usec): min=8, max=111, avg=25.83, stdev=20.33 00:23:04.906 clat (msec): min=22, max=427, avg=215.74, stdev=99.36 00:23:04.906 lat (msec): min=22, max=427, avg=215.76, stdev=99.36 00:23:04.906 clat percentiles (msec): 00:23:04.906 | 1.00th=[ 28], 5.00th=[ 30], 10.00th=[ 36], 20.00th=[ 131], 00:23:04.906 | 30.00th=[ 203], 40.00th=[ 243], 50.00th=[ 259], 60.00th=[ 264], 00:23:04.906 | 70.00th=[ 275], 80.00th=[ 279], 90.00th=[ 292], 95.00th=[ 351], 00:23:04.906 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 426], 99.95th=[ 426], 00:23:04.906 | 99.99th=[ 426] 00:23:04.906 bw ( KiB/s): min= 128, max= 1200, per=4.29%, avg=290.40, stdev=220.44, samples=20 00:23:04.906 iops : min= 32, max= 300, avg=72.60, stdev=55.11, samples=20 00:23:04.906 lat (msec) : 50=18.06%, 100=1.35%, 250=26.68%, 500=53.91% 00:23:04.906 cpu : usr=98.13%, sys=1.28%, ctx=24, majf=0, minf=23 00:23:04.906 IO depths : 1=3.6%, 2=8.4%, 4=20.4%, 8=58.8%, 16=8.9%, 32=0.0%, >=64=0.0% 00:23:04.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.906 complete : 0=0.0%, 4=92.8%, 8=1.5%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.906 issued rwts: total=742,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.906 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.906 filename1: (groupid=0, jobs=1): err= 0: pid=1545457: Sat Apr 27 03:34:28 2024 00:23:04.906 read: IOPS=60, BW=243KiB/s (249kB/s)(2432KiB/10011msec) 00:23:04.906 slat (nsec): min=7719, max=93352, avg=27673.29, stdev=17196.42 00:23:04.906 clat (msec): min=10, max=542, avg=263.20, stdev=148.25 00:23:04.906 lat (msec): min=10, max=542, avg=263.23, stdev=148.24 00:23:04.906 clat percentiles (msec): 00:23:04.906 | 1.00th=[ 11], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 39], 00:23:04.906 | 30.00th=[ 205], 40.00th=[ 268], 50.00th=[ 292], 60.00th=[ 338], 00:23:04.906 | 70.00th=[ 363], 80.00th=[ 393], 90.00th=[ 435], 95.00th=[ 447], 00:23:04.907 | 99.00th=[ 514], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], 00:23:04.907 | 99.99th=[ 542] 00:23:04.907 bw ( KiB/s): min= 112, max= 1163, per=3.49%, avg=236.55, stdev=227.07, samples=20 00:23:04.907 iops : min= 28, max= 290, avg=59.10, stdev=56.61, samples=20 00:23:04.907 lat (msec) : 20=2.63%, 50=21.05%, 250=11.51%, 500=62.50%, 750=2.30% 00:23:04.907 cpu : usr=98.42%, sys=1.16%, ctx=16, majf=0, minf=26 00:23:04.907 IO depths : 1=3.6%, 2=9.9%, 4=25.0%, 8=52.6%, 16=8.9%, 32=0.0%, >=64=0.0% 00:23:04.907 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.907 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.907 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.907 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.907 filename1: (groupid=0, jobs=1): err= 0: pid=1545458: Sat Apr 27 03:34:28 2024 00:23:04.907 read: IOPS=70, BW=281KiB/s (288kB/s)(2816KiB/10013msec) 00:23:04.907 slat (usec): min=8, max=115, avg=26.83, stdev=21.50 00:23:04.907 clat (msec): min=27, max=454, avg=227.33, stdev=100.77 00:23:04.907 lat (msec): min=27, max=454, avg=227.36, stdev=100.77 00:23:04.907 clat percentiles (msec): 00:23:04.907 | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 182], 00:23:04.907 | 30.00th=[ 207], 40.00th=[ 257], 50.00th=[ 264], 60.00th=[ 268], 00:23:04.907 | 70.00th=[ 275], 80.00th=[ 288], 90.00th=[ 330], 95.00th=[ 363], 00:23:04.907 | 99.00th=[ 376], 99.50th=[ 393], 99.90th=[ 456], 99.95th=[ 456], 00:23:04.907 | 99.99th=[ 456] 00:23:04.907 bw ( KiB/s): min= 128, max= 368, per=3.39%, avg=229.05, stdev=62.44, samples=19 00:23:04.907 iops : min= 32, max= 92, avg=57.26, stdev=15.61, samples=19 00:23:04.907 lat (msec) : 50=18.18%, 100=0.28%, 250=20.17%, 500=61.36% 00:23:04.907 cpu : usr=97.99%, sys=1.31%, ctx=27, majf=0, minf=19 00:23:04.907 IO depths : 1=2.4%, 2=8.5%, 4=24.6%, 8=54.4%, 16=10.1%, 32=0.0%, >=64=0.0% 00:23:04.907 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.907 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.907 issued rwts: total=704,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.907 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.907 filename1: (groupid=0, jobs=1): err= 0: pid=1545459: Sat Apr 27 03:34:28 2024 00:23:04.907 read: IOPS=68, BW=275KiB/s (281kB/s)(2752KiB/10015msec) 00:23:04.907 slat (usec): min=7, max=104, avg=38.10, stdev=28.84 00:23:04.907 clat (msec): min=27, max=441, avg=232.59, stdev=112.21 00:23:04.907 lat (msec): min=27, max=441, avg=232.63, stdev=112.22 00:23:04.907 clat percentiles (msec): 00:23:04.907 | 1.00th=[ 28], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 140], 00:23:04.907 | 30.00th=[ 203], 40.00th=[ 253], 50.00th=[ 264], 60.00th=[ 275], 00:23:04.907 | 70.00th=[ 284], 80.00th=[ 309], 90.00th=[ 355], 95.00th=[ 401], 00:23:04.907 | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], 00:23:04.907 | 99.99th=[ 443] 00:23:04.907 bw ( KiB/s): min= 128, max= 1152, per=3.96%, avg=268.80, stdev=218.49, samples=20 00:23:04.907 iops : min= 32, max= 288, avg=67.20, stdev=54.62, samples=20 00:23:04.907 lat (msec) : 50=18.60%, 100=0.29%, 250=20.93%, 500=60.17% 00:23:04.907 cpu : usr=97.83%, sys=1.44%, ctx=59, majf=0, minf=30 00:23:04.907 IO depths : 1=4.2%, 2=10.3%, 4=24.6%, 8=52.6%, 16=8.3%, 32=0.0%, >=64=0.0% 00:23:04.907 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.907 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.907 issued rwts: total=688,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.907 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.907 filename1: (groupid=0, jobs=1): err= 0: pid=1545460: Sat Apr 27 03:34:28 2024 00:23:04.907 read: IOPS=76, BW=307KiB/s (315kB/s)(3072KiB/10001msec) 00:23:04.907 slat (usec): min=8, max=170, avg=22.55, stdev=18.00 00:23:04.907 clat (msec): min=27, max=318, avg=208.16, stdev=80.34 00:23:04.907 lat (msec): min=27, max=318, avg=208.19, stdev=80.33 00:23:04.907 clat percentiles (msec): 00:23:04.907 | 1.00th=[ 35], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 169], 00:23:04.907 | 30.00th=[ 197], 40.00th=[ 211], 50.00th=[ 243], 60.00th=[ 251], 00:23:04.907 | 70.00th=[ 262], 80.00th=[ 271], 90.00th=[ 284], 95.00th=[ 284], 00:23:04.907 | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 317], 99.95th=[ 317], 00:23:04.907 | 99.99th=[ 317] 00:23:04.907 bw ( KiB/s): min= 144, max= 384, per=3.87%, avg=262.74, stdev=62.27, samples=19 00:23:04.907 iops : min= 36, max= 96, avg=65.68, stdev=15.57, samples=19 00:23:04.907 lat (msec) : 50=14.58%, 100=0.26%, 250=44.79%, 500=40.36% 00:23:04.907 cpu : usr=97.67%, sys=1.59%, ctx=42, majf=0, minf=29 00:23:04.907 IO depths : 1=2.9%, 2=9.1%, 4=25.0%, 8=53.4%, 16=9.6%, 32=0.0%, >=64=0.0% 00:23:04.907 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.907 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.907 issued rwts: total=768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.907 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.907 filename1: (groupid=0, jobs=1): err= 0: pid=1545461: Sat Apr 27 03:34:28 2024 00:23:04.907 read: IOPS=75, BW=300KiB/s (308kB/s)(3008KiB/10015msec) 00:23:04.907 slat (usec): min=8, max=112, avg=23.76, stdev=15.47 00:23:04.907 clat (msec): min=27, max=386, avg=212.89, stdev=91.03 00:23:04.907 lat (msec): min=27, max=386, avg=212.91, stdev=91.03 00:23:04.907 clat percentiles (msec): 00:23:04.907 | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 150], 00:23:04.907 | 30.00th=[ 201], 40.00th=[ 232], 50.00th=[ 247], 60.00th=[ 259], 00:23:04.907 | 70.00th=[ 271], 80.00th=[ 284], 90.00th=[ 288], 95.00th=[ 292], 00:23:04.907 | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 388], 99.95th=[ 388], 00:23:04.907 | 99.99th=[ 388] 00:23:04.907 bw ( KiB/s): min= 128, max= 1152, per=4.35%, avg=294.40, stdev=210.76, samples=20 00:23:04.907 iops : min= 32, max= 288, avg=73.60, stdev=52.69, samples=20 00:23:04.907 lat (msec) : 50=17.02%, 100=0.27%, 250=32.98%, 500=49.73% 00:23:04.907 cpu : usr=98.50%, sys=1.09%, ctx=20, majf=0, minf=28 00:23:04.907 IO depths : 1=2.4%, 2=8.6%, 4=25.0%, 8=53.9%, 16=10.1%, 32=0.0%, >=64=0.0% 00:23:04.907 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.907 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.907 issued rwts: total=752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.907 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.907 filename1: (groupid=0, jobs=1): err= 0: pid=1545462: Sat Apr 27 03:34:28 2024 00:23:04.907 read: IOPS=76, BW=307KiB/s (314kB/s)(3072KiB/10015msec) 00:23:04.907 slat (nsec): min=3706, max=80938, avg=16712.51, stdev=14931.44 00:23:04.907 clat (msec): min=27, max=294, avg=208.35, stdev=80.05 00:23:04.907 lat (msec): min=27, max=294, avg=208.36, stdev=80.04 00:23:04.907 clat percentiles (msec): 00:23:04.907 | 1.00th=[ 35], 5.00th=[ 36], 10.00th=[ 37], 20.00th=[ 169], 00:23:04.908 | 30.00th=[ 197], 40.00th=[ 211], 50.00th=[ 243], 60.00th=[ 251], 00:23:04.908 | 70.00th=[ 262], 80.00th=[ 271], 90.00th=[ 284], 95.00th=[ 284], 00:23:04.908 | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 296], 99.95th=[ 296], 00:23:04.908 | 99.99th=[ 296] 00:23:04.908 bw ( KiB/s): min= 144, max= 1136, per=4.52%, avg=306.40, stdev=204.46, samples=20 00:23:04.908 iops : min= 36, max= 284, avg=76.60, stdev=51.11, samples=20 00:23:04.908 lat (msec) : 50=14.58%, 250=45.05%, 500=40.36% 00:23:04.908 cpu : usr=98.34%, sys=1.26%, ctx=22, majf=0, minf=28 00:23:04.908 IO depths : 1=2.1%, 2=8.3%, 4=25.0%, 8=54.2%, 16=10.4%, 32=0.0%, >=64=0.0% 00:23:04.908 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.908 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.908 issued rwts: total=768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.908 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.908 filename2: (groupid=0, jobs=1): err= 0: pid=1545463: Sat Apr 27 03:34:28 2024 00:23:04.908 read: IOPS=77, BW=309KiB/s (317kB/s)(3096KiB/10015msec) 00:23:04.908 slat (usec): min=8, max=125, avg=36.18, stdev=35.17 00:23:04.908 clat (msec): min=20, max=418, avg=206.78, stdev=96.62 00:23:04.908 lat (msec): min=20, max=418, avg=206.81, stdev=96.60 00:23:04.908 clat percentiles (msec): 00:23:04.908 | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 153], 00:23:04.908 | 30.00th=[ 197], 40.00th=[ 205], 50.00th=[ 236], 60.00th=[ 255], 00:23:04.908 | 70.00th=[ 266], 80.00th=[ 271], 90.00th=[ 284], 95.00th=[ 334], 00:23:04.908 | 99.00th=[ 405], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:23:04.908 | 99.99th=[ 418] 00:23:04.908 bw ( KiB/s): min= 176, max= 1280, per=4.48%, avg=303.20, stdev=234.32, samples=20 00:23:04.908 iops : min= 44, max= 320, avg=75.80, stdev=58.58, samples=20 00:23:04.908 lat (msec) : 50=18.60%, 100=0.78%, 250=37.47%, 500=43.15% 00:23:04.908 cpu : usr=98.26%, sys=1.27%, ctx=22, majf=0, minf=19 00:23:04.908 IO depths : 1=1.2%, 2=3.0%, 4=11.2%, 8=73.0%, 16=11.6%, 32=0.0%, >=64=0.0% 00:23:04.908 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.908 complete : 0=0.0%, 4=90.2%, 8=4.6%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.908 issued rwts: total=774,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.908 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.908 filename2: (groupid=0, jobs=1): err= 0: pid=1545464: Sat Apr 27 03:34:28 2024 00:23:04.908 read: IOPS=70, BW=284KiB/s (290kB/s)(2840KiB/10015msec) 00:23:04.908 slat (usec): min=8, max=113, avg=34.88, stdev=27.01 00:23:04.908 clat (msec): min=27, max=422, avg=225.41, stdev=104.46 00:23:04.908 lat (msec): min=27, max=422, avg=225.44, stdev=104.47 00:23:04.908 clat percentiles (msec): 00:23:04.908 | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 153], 00:23:04.908 | 30.00th=[ 203], 40.00th=[ 241], 50.00th=[ 257], 60.00th=[ 266], 00:23:04.908 | 70.00th=[ 275], 80.00th=[ 284], 90.00th=[ 351], 95.00th=[ 388], 00:23:04.908 | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 422], 99.95th=[ 422], 00:23:04.908 | 99.99th=[ 422] 00:23:04.908 bw ( KiB/s): min= 128, max= 1152, per=4.10%, avg=277.60, stdev=214.74, samples=20 00:23:04.908 iops : min= 32, max= 288, avg=69.40, stdev=53.69, samples=20 00:23:04.908 lat (msec) : 50=18.03%, 250=28.17%, 500=53.80% 00:23:04.908 cpu : usr=98.34%, sys=1.23%, ctx=16, majf=0, minf=29 00:23:04.908 IO depths : 1=4.8%, 2=10.6%, 4=23.5%, 8=53.4%, 16=7.7%, 32=0.0%, >=64=0.0% 00:23:04.908 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.908 complete : 0=0.0%, 4=93.7%, 8=0.5%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.908 issued rwts: total=710,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.908 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.908 filename2: (groupid=0, jobs=1): err= 0: pid=1545465: Sat Apr 27 03:34:28 2024 00:23:04.908 read: IOPS=60, BW=243KiB/s (249kB/s)(2432KiB/10009msec) 00:23:04.908 slat (usec): min=8, max=131, avg=43.41, stdev=31.16 00:23:04.908 clat (msec): min=9, max=536, avg=263.01, stdev=146.04 00:23:04.908 lat (msec): min=9, max=536, avg=263.05, stdev=146.02 00:23:04.908 clat percentiles (msec): 00:23:04.908 | 1.00th=[ 11], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 38], 00:23:04.908 | 30.00th=[ 218], 40.00th=[ 268], 50.00th=[ 296], 60.00th=[ 334], 00:23:04.908 | 70.00th=[ 355], 80.00th=[ 393], 90.00th=[ 435], 95.00th=[ 443], 00:23:04.908 | 99.00th=[ 510], 99.50th=[ 531], 99.90th=[ 535], 99.95th=[ 535], 00:23:04.908 | 99.99th=[ 535] 00:23:04.908 bw ( KiB/s): min= 128, max= 1152, per=3.49%, avg=236.80, stdev=224.28, samples=20 00:23:04.908 iops : min= 32, max= 288, avg=59.20, stdev=56.07, samples=20 00:23:04.908 lat (msec) : 10=0.66%, 20=1.97%, 50=21.05%, 250=11.18%, 500=63.16% 00:23:04.908 lat (msec) : 750=1.97% 00:23:04.908 cpu : usr=97.36%, sys=1.62%, ctx=138, majf=0, minf=17 00:23:04.908 IO depths : 1=4.3%, 2=10.5%, 4=25.0%, 8=52.0%, 16=8.2%, 32=0.0%, >=64=0.0% 00:23:04.908 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.908 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.908 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.908 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.908 filename2: (groupid=0, jobs=1): err= 0: pid=1545466: Sat Apr 27 03:34:28 2024 00:23:04.908 read: IOPS=70, BW=281KiB/s (288kB/s)(2816KiB/10009msec) 00:23:04.908 slat (nsec): min=8226, max=95352, avg=26563.08, stdev=22778.14 00:23:04.908 clat (msec): min=12, max=497, avg=227.20, stdev=105.37 00:23:04.908 lat (msec): min=12, max=497, avg=227.23, stdev=105.37 00:23:04.908 clat percentiles (msec): 00:23:04.908 | 1.00th=[ 14], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 42], 00:23:04.908 | 30.00th=[ 243], 40.00th=[ 259], 50.00th=[ 266], 60.00th=[ 275], 00:23:04.908 | 70.00th=[ 279], 80.00th=[ 288], 90.00th=[ 334], 95.00th=[ 338], 00:23:04.908 | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 498], 99.95th=[ 498], 00:23:04.908 | 99.99th=[ 498] 00:23:04.908 bw ( KiB/s): min= 128, max= 1264, per=4.14%, avg=280.80, stdev=235.75, samples=20 00:23:04.908 iops : min= 32, max= 316, avg=70.20, stdev=58.94, samples=20 00:23:04.908 lat (msec) : 20=2.27%, 50=18.18%, 250=15.91%, 500=63.64% 00:23:04.908 cpu : usr=98.55%, sys=1.05%, ctx=13, majf=0, minf=28 00:23:04.908 IO depths : 1=3.3%, 2=9.4%, 4=24.6%, 8=53.6%, 16=9.2%, 32=0.0%, >=64=0.0% 00:23:04.908 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.908 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.908 issued rwts: total=704,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.908 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.908 filename2: (groupid=0, jobs=1): err= 0: pid=1545467: Sat Apr 27 03:34:28 2024 00:23:04.908 read: IOPS=74, BW=297KiB/s (304kB/s)(2976KiB/10031msec) 00:23:04.909 slat (usec): min=7, max=121, avg=31.84, stdev=24.39 00:23:04.909 clat (msec): min=30, max=399, avg=215.46, stdev=93.68 00:23:04.909 lat (msec): min=30, max=399, avg=215.49, stdev=93.66 00:23:04.909 clat percentiles (msec): 00:23:04.909 | 1.00th=[ 31], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 157], 00:23:04.909 | 30.00th=[ 203], 40.00th=[ 232], 50.00th=[ 251], 60.00th=[ 264], 00:23:04.909 | 70.00th=[ 271], 80.00th=[ 275], 90.00th=[ 292], 95.00th=[ 338], 00:23:04.909 | 99.00th=[ 397], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], 00:23:04.909 | 99.99th=[ 401] 00:23:04.909 bw ( KiB/s): min= 176, max= 1072, per=4.30%, avg=291.20, stdev=187.79, samples=20 00:23:04.909 iops : min= 44, max= 268, avg=72.80, stdev=46.95, samples=20 00:23:04.909 lat (msec) : 50=17.20%, 250=31.45%, 500=51.34% 00:23:04.909 cpu : usr=97.51%, sys=1.67%, ctx=25, majf=0, minf=42 00:23:04.909 IO depths : 1=1.9%, 2=5.5%, 4=16.9%, 8=64.9%, 16=10.8%, 32=0.0%, >=64=0.0% 00:23:04.909 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.909 complete : 0=0.0%, 4=91.9%, 8=2.7%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.909 issued rwts: total=744,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.909 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.909 filename2: (groupid=0, jobs=1): err= 0: pid=1545468: Sat Apr 27 03:34:28 2024 00:23:04.909 read: IOPS=72, BW=289KiB/s (296kB/s)(2896KiB/10009msec) 00:23:04.909 slat (usec): min=6, max=167, avg=26.88, stdev=25.52 00:23:04.909 clat (msec): min=13, max=411, avg=221.00, stdev=104.18 00:23:04.909 lat (msec): min=13, max=411, avg=221.02, stdev=104.19 00:23:04.909 clat percentiles (msec): 00:23:04.909 | 1.00th=[ 16], 5.00th=[ 29], 10.00th=[ 36], 20.00th=[ 131], 00:23:04.909 | 30.00th=[ 203], 40.00th=[ 251], 50.00th=[ 262], 60.00th=[ 268], 00:23:04.909 | 70.00th=[ 275], 80.00th=[ 288], 90.00th=[ 326], 95.00th=[ 351], 00:23:04.909 | 99.00th=[ 401], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:23:04.909 | 99.99th=[ 414] 00:23:04.909 bw ( KiB/s): min= 128, max= 1200, per=4.18%, avg=283.20, stdev=222.32, samples=20 00:23:04.909 iops : min= 32, max= 300, avg=70.80, stdev=55.58, samples=20 00:23:04.909 lat (msec) : 20=2.21%, 50=16.30%, 100=0.83%, 250=19.89%, 500=60.77% 00:23:04.909 cpu : usr=98.01%, sys=1.48%, ctx=17, majf=0, minf=21 00:23:04.909 IO depths : 1=1.5%, 2=5.0%, 4=16.3%, 8=66.0%, 16=11.2%, 32=0.0%, >=64=0.0% 00:23:04.909 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.909 complete : 0=0.0%, 4=91.7%, 8=3.0%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.909 issued rwts: total=724,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.909 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.909 filename2: (groupid=0, jobs=1): err= 0: pid=1545469: Sat Apr 27 03:34:28 2024 00:23:04.909 read: IOPS=59, BW=237KiB/s (242kB/s)(2368KiB/10008msec) 00:23:04.909 slat (usec): min=8, max=126, avg=34.90, stdev=31.15 00:23:04.909 clat (msec): min=24, max=569, avg=270.00, stdev=142.98 00:23:04.909 lat (msec): min=24, max=569, avg=270.03, stdev=142.98 00:23:04.909 clat percentiles (msec): 00:23:04.909 | 1.00th=[ 25], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 38], 00:23:04.909 | 30.00th=[ 205], 40.00th=[ 275], 50.00th=[ 300], 60.00th=[ 338], 00:23:04.909 | 70.00th=[ 368], 80.00th=[ 397], 90.00th=[ 418], 95.00th=[ 443], 00:23:04.909 | 99.00th=[ 550], 99.50th=[ 558], 99.90th=[ 567], 99.95th=[ 567], 00:23:04.909 | 99.99th=[ 567] 00:23:04.909 bw ( KiB/s): min= 112, max= 1264, per=3.49%, avg=236.00, stdev=250.14, samples=20 00:23:04.909 iops : min= 28, max= 316, avg=59.00, stdev=62.53, samples=20 00:23:04.909 lat (msec) : 50=21.62%, 250=12.16%, 500=64.53%, 750=1.69% 00:23:04.909 cpu : usr=97.04%, sys=1.71%, ctx=283, majf=0, minf=31 00:23:04.909 IO depths : 1=5.1%, 2=11.3%, 4=25.0%, 8=51.2%, 16=7.4%, 32=0.0%, >=64=0.0% 00:23:04.909 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.909 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.909 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.909 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.909 filename2: (groupid=0, jobs=1): err= 0: pid=1545470: Sat Apr 27 03:34:28 2024 00:23:04.909 read: IOPS=79, BW=319KiB/s (327kB/s)(3208KiB/10043msec) 00:23:04.909 slat (usec): min=8, max=117, avg=17.58, stdev=13.51 00:23:04.909 clat (msec): min=19, max=420, avg=199.71, stdev=102.03 00:23:04.909 lat (msec): min=19, max=420, avg=199.73, stdev=102.03 00:23:04.909 clat percentiles (msec): 00:23:04.909 | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 22], 20.00th=[ 36], 00:23:04.909 | 30.00th=[ 199], 40.00th=[ 211], 50.00th=[ 247], 60.00th=[ 257], 00:23:04.909 | 70.00th=[ 266], 80.00th=[ 275], 90.00th=[ 284], 95.00th=[ 305], 00:23:04.909 | 99.00th=[ 351], 99.50th=[ 401], 99.90th=[ 422], 99.95th=[ 422], 00:23:04.909 | 99.99th=[ 422] 00:23:04.909 bw ( KiB/s): min= 176, max= 1616, per=4.70%, avg=318.40, stdev=308.42, samples=20 00:23:04.909 iops : min= 44, max= 404, avg=79.60, stdev=77.10, samples=20 00:23:04.909 lat (msec) : 20=1.25%, 50=19.95%, 100=1.50%, 250=31.67%, 500=45.64% 00:23:04.909 cpu : usr=97.84%, sys=1.50%, ctx=47, majf=0, minf=21 00:23:04.909 IO depths : 1=1.7%, 2=4.2%, 4=13.5%, 8=69.6%, 16=11.0%, 32=0.0%, >=64=0.0% 00:23:04.909 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.909 complete : 0=0.0%, 4=90.8%, 8=3.8%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:04.909 issued rwts: total=802,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:04.909 latency : target=0, window=0, percentile=100.00%, depth=16 00:23:04.909 00:23:04.909 Run status group 0 (all jobs): 00:23:04.909 READ: bw=6764KiB/s (6926kB/s), 230KiB/s-321KiB/s (236kB/s-328kB/s), io=66.3MiB (69.6MB), run=10001-10043msec 00:23:04.909 03:34:28 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:23:04.909 03:34:28 -- target/dif.sh@43 -- # local sub 00:23:04.909 03:34:28 -- target/dif.sh@45 -- # for sub in "$@" 00:23:04.909 03:34:28 -- target/dif.sh@46 -- # destroy_subsystem 0 00:23:04.909 03:34:28 -- target/dif.sh@36 -- # local sub_id=0 00:23:04.909 03:34:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:23:04.909 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.909 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.909 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.909 03:34:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:23:04.909 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.909 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.909 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.909 03:34:28 -- target/dif.sh@45 -- # for sub in "$@" 00:23:04.910 03:34:28 -- target/dif.sh@46 -- # destroy_subsystem 1 00:23:04.910 03:34:28 -- target/dif.sh@36 -- # local sub_id=1 00:23:04.910 03:34:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@45 -- # for sub in "$@" 00:23:04.910 03:34:28 -- target/dif.sh@46 -- # destroy_subsystem 2 00:23:04.910 03:34:28 -- target/dif.sh@36 -- # local sub_id=2 00:23:04.910 03:34:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@115 -- # NULL_DIF=1 00:23:04.910 03:34:28 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:23:04.910 03:34:28 -- target/dif.sh@115 -- # numjobs=2 00:23:04.910 03:34:28 -- target/dif.sh@115 -- # iodepth=8 00:23:04.910 03:34:28 -- target/dif.sh@115 -- # runtime=5 00:23:04.910 03:34:28 -- target/dif.sh@115 -- # files=1 00:23:04.910 03:34:28 -- target/dif.sh@117 -- # create_subsystems 0 1 00:23:04.910 03:34:28 -- target/dif.sh@28 -- # local sub 00:23:04.910 03:34:28 -- target/dif.sh@30 -- # for sub in "$@" 00:23:04.910 03:34:28 -- target/dif.sh@31 -- # create_subsystem 0 00:23:04.910 03:34:28 -- target/dif.sh@18 -- # local sub_id=0 00:23:04.910 03:34:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 bdev_null0 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 [2024-04-27 03:34:28.783053] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@30 -- # for sub in "$@" 00:23:04.910 03:34:28 -- target/dif.sh@31 -- # create_subsystem 1 00:23:04.910 03:34:28 -- target/dif.sh@18 -- # local sub_id=1 00:23:04.910 03:34:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 bdev_null1 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:04.910 03:34:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:04.910 03:34:28 -- common/autotest_common.sh@10 -- # set +x 00:23:04.910 03:34:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:04.910 03:34:28 -- target/dif.sh@118 -- # fio /dev/fd/62 00:23:04.910 03:34:28 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:23:04.910 03:34:28 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:23:04.910 03:34:28 -- nvmf/common.sh@521 -- # config=() 00:23:04.910 03:34:28 -- nvmf/common.sh@521 -- # local subsystem config 00:23:04.910 03:34:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:23:04.910 03:34:28 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:23:04.910 03:34:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:23:04.910 { 00:23:04.910 "params": { 00:23:04.910 "name": "Nvme$subsystem", 00:23:04.910 "trtype": "$TEST_TRANSPORT", 00:23:04.910 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:04.910 "adrfam": "ipv4", 00:23:04.910 "trsvcid": "$NVMF_PORT", 00:23:04.910 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:04.910 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:04.910 "hdgst": ${hdgst:-false}, 00:23:04.910 "ddgst": ${ddgst:-false} 00:23:04.910 }, 00:23:04.910 "method": "bdev_nvme_attach_controller" 00:23:04.910 } 00:23:04.910 EOF 00:23:04.910 )") 00:23:04.910 03:34:28 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:23:04.910 03:34:28 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:23:04.910 03:34:28 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:23:04.910 03:34:28 -- common/autotest_common.sh@1325 -- # local sanitizers 00:23:04.910 03:34:28 -- target/dif.sh@82 -- # gen_fio_conf 00:23:04.910 03:34:28 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:23:04.910 03:34:28 -- common/autotest_common.sh@1327 -- # shift 00:23:04.910 03:34:28 -- target/dif.sh@54 -- # local file 00:23:04.910 03:34:28 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:23:04.910 03:34:28 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:23:04.910 03:34:28 -- target/dif.sh@56 -- # cat 00:23:04.910 03:34:28 -- nvmf/common.sh@543 -- # cat 00:23:04.911 03:34:28 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:23:04.911 03:34:28 -- common/autotest_common.sh@1331 -- # grep libasan 00:23:04.911 03:34:28 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:23:04.911 03:34:28 -- target/dif.sh@72 -- # (( file = 1 )) 00:23:04.911 03:34:28 -- target/dif.sh@72 -- # (( file <= files )) 00:23:04.911 03:34:28 -- target/dif.sh@73 -- # cat 00:23:04.911 03:34:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:23:04.911 03:34:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:23:04.911 { 00:23:04.911 "params": { 00:23:04.911 "name": "Nvme$subsystem", 00:23:04.911 "trtype": "$TEST_TRANSPORT", 00:23:04.911 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:04.911 "adrfam": "ipv4", 00:23:04.911 "trsvcid": "$NVMF_PORT", 00:23:04.911 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:04.911 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:04.911 "hdgst": ${hdgst:-false}, 00:23:04.911 "ddgst": ${ddgst:-false} 00:23:04.911 }, 00:23:04.911 "method": "bdev_nvme_attach_controller" 00:23:04.911 } 00:23:04.911 EOF 00:23:04.911 )") 00:23:04.911 03:34:28 -- nvmf/common.sh@543 -- # cat 00:23:04.911 03:34:28 -- target/dif.sh@72 -- # (( file++ )) 00:23:04.911 03:34:28 -- target/dif.sh@72 -- # (( file <= files )) 00:23:04.911 03:34:28 -- nvmf/common.sh@545 -- # jq . 00:23:04.911 03:34:28 -- nvmf/common.sh@546 -- # IFS=, 00:23:04.911 03:34:28 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:23:04.911 "params": { 00:23:04.911 "name": "Nvme0", 00:23:04.911 "trtype": "tcp", 00:23:04.911 "traddr": "10.0.0.2", 00:23:04.911 "adrfam": "ipv4", 00:23:04.911 "trsvcid": "4420", 00:23:04.911 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:04.911 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:23:04.911 "hdgst": false, 00:23:04.911 "ddgst": false 00:23:04.911 }, 00:23:04.911 "method": "bdev_nvme_attach_controller" 00:23:04.911 },{ 00:23:04.911 "params": { 00:23:04.911 "name": "Nvme1", 00:23:04.911 "trtype": "tcp", 00:23:04.911 "traddr": "10.0.0.2", 00:23:04.911 "adrfam": "ipv4", 00:23:04.911 "trsvcid": "4420", 00:23:04.911 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:04.911 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:23:04.911 "hdgst": false, 00:23:04.911 "ddgst": false 00:23:04.911 }, 00:23:04.911 "method": "bdev_nvme_attach_controller" 00:23:04.911 }' 00:23:04.911 03:34:28 -- common/autotest_common.sh@1331 -- # asan_lib= 00:23:04.911 03:34:28 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:23:04.911 03:34:28 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:23:04.911 03:34:28 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:23:04.911 03:34:28 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:23:04.911 03:34:28 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:23:04.911 03:34:28 -- common/autotest_common.sh@1331 -- # asan_lib= 00:23:04.911 03:34:28 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:23:04.911 03:34:28 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:23:04.911 03:34:28 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:23:04.911 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:23:04.911 ... 00:23:04.911 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:23:04.911 ... 00:23:04.911 fio-3.35 00:23:04.911 Starting 4 threads 00:23:04.911 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.172 00:23:10.172 filename0: (groupid=0, jobs=1): err= 0: pid=1546853: Sat Apr 27 03:34:34 2024 00:23:10.172 read: IOPS=1866, BW=14.6MiB/s (15.3MB/s)(73.5MiB/5042msec) 00:23:10.172 slat (nsec): min=3854, max=55583, avg=14397.88, stdev=6859.12 00:23:10.172 clat (usec): min=980, max=43861, avg=4228.45, stdev=1141.36 00:23:10.172 lat (usec): min=1006, max=43886, avg=4242.85, stdev=1141.22 00:23:10.172 clat percentiles (usec): 00:23:10.172 | 1.00th=[ 2540], 5.00th=[ 3163], 10.00th=[ 3425], 20.00th=[ 3785], 00:23:10.172 | 30.00th=[ 3982], 40.00th=[ 4113], 50.00th=[ 4228], 60.00th=[ 4293], 00:23:10.172 | 70.00th=[ 4359], 80.00th=[ 4490], 90.00th=[ 4817], 95.00th=[ 5669], 00:23:10.172 | 99.00th=[ 6587], 99.50th=[ 6980], 99.90th=[ 8717], 99.95th=[42730], 00:23:10.172 | 99.99th=[43779] 00:23:10.172 bw ( KiB/s): min=14224, max=15856, per=25.68%, avg=15046.40, stdev=593.14, samples=10 00:23:10.172 iops : min= 1778, max= 1982, avg=1880.80, stdev=74.14, samples=10 00:23:10.172 lat (usec) : 1000=0.01% 00:23:10.172 lat (msec) : 2=0.27%, 4=30.02%, 10=69.64%, 20=0.01%, 50=0.05% 00:23:10.172 cpu : usr=93.04%, sys=6.35%, ctx=15, majf=0, minf=0 00:23:10.172 IO depths : 1=0.1%, 2=7.4%, 4=64.4%, 8=28.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:10.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:10.172 complete : 0=0.0%, 4=92.9%, 8=7.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:10.172 issued rwts: total=9409,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:10.172 latency : target=0, window=0, percentile=100.00%, depth=8 00:23:10.172 filename0: (groupid=0, jobs=1): err= 0: pid=1546854: Sat Apr 27 03:34:34 2024 00:23:10.172 read: IOPS=1824, BW=14.3MiB/s (14.9MB/s)(71.3MiB/5002msec) 00:23:10.172 slat (nsec): min=4010, max=69326, avg=13153.80, stdev=6602.12 00:23:10.172 clat (usec): min=759, max=7802, avg=4340.65, stdev=699.87 00:23:10.172 lat (usec): min=772, max=7817, avg=4353.80, stdev=699.58 00:23:10.172 clat percentiles (usec): 00:23:10.172 | 1.00th=[ 2835], 5.00th=[ 3458], 10.00th=[ 3720], 20.00th=[ 3949], 00:23:10.172 | 30.00th=[ 4080], 40.00th=[ 4178], 50.00th=[ 4228], 60.00th=[ 4359], 00:23:10.172 | 70.00th=[ 4424], 80.00th=[ 4555], 90.00th=[ 5080], 95.00th=[ 5866], 00:23:10.172 | 99.00th=[ 6915], 99.50th=[ 7111], 99.90th=[ 7439], 99.95th=[ 7701], 00:23:10.172 | 99.99th=[ 7832] 00:23:10.172 bw ( KiB/s): min=13904, max=15264, per=24.86%, avg=14567.11, stdev=361.34, samples=9 00:23:10.172 iops : min= 1738, max= 1908, avg=1820.89, stdev=45.17, samples=9 00:23:10.172 lat (usec) : 1000=0.02% 00:23:10.172 lat (msec) : 2=0.20%, 4=23.21%, 10=76.57% 00:23:10.172 cpu : usr=93.08%, sys=6.38%, ctx=10, majf=0, minf=9 00:23:10.172 IO depths : 1=0.1%, 2=7.9%, 4=64.7%, 8=27.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:10.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:10.172 complete : 0=0.0%, 4=92.3%, 8=7.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:10.172 issued rwts: total=9126,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:10.172 latency : target=0, window=0, percentile=100.00%, depth=8 00:23:10.172 filename1: (groupid=0, jobs=1): err= 0: pid=1546855: Sat Apr 27 03:34:34 2024 00:23:10.172 read: IOPS=1838, BW=14.4MiB/s (15.1MB/s)(71.8MiB/5001msec) 00:23:10.172 slat (nsec): min=4023, max=70573, avg=13542.33, stdev=7020.25 00:23:10.172 clat (usec): min=790, max=8932, avg=4305.98, stdev=739.08 00:23:10.172 lat (usec): min=803, max=8944, avg=4319.52, stdev=738.90 00:23:10.172 clat percentiles (usec): 00:23:10.172 | 1.00th=[ 2671], 5.00th=[ 3261], 10.00th=[ 3589], 20.00th=[ 3916], 00:23:10.172 | 30.00th=[ 4047], 40.00th=[ 4178], 50.00th=[ 4228], 60.00th=[ 4293], 00:23:10.172 | 70.00th=[ 4424], 80.00th=[ 4555], 90.00th=[ 5080], 95.00th=[ 5932], 00:23:10.172 | 99.00th=[ 6849], 99.50th=[ 7111], 99.90th=[ 7635], 99.95th=[ 7701], 00:23:10.172 | 99.99th=[ 8979] 00:23:10.172 bw ( KiB/s): min=14080, max=15088, per=25.07%, avg=14688.00, stdev=360.71, samples=9 00:23:10.172 iops : min= 1760, max= 1886, avg=1836.00, stdev=45.09, samples=9 00:23:10.172 lat (usec) : 1000=0.09% 00:23:10.172 lat (msec) : 2=0.39%, 4=24.87%, 10=74.65% 00:23:10.172 cpu : usr=93.68%, sys=5.70%, ctx=8, majf=0, minf=9 00:23:10.172 IO depths : 1=0.1%, 2=9.7%, 4=62.5%, 8=27.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:10.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:10.172 complete : 0=0.0%, 4=92.5%, 8=7.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:10.172 issued rwts: total=9192,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:10.172 latency : target=0, window=0, percentile=100.00%, depth=8 00:23:10.172 filename1: (groupid=0, jobs=1): err= 0: pid=1546856: Sat Apr 27 03:34:34 2024 00:23:10.172 read: IOPS=1839, BW=14.4MiB/s (15.1MB/s)(71.9MiB/5003msec) 00:23:10.172 slat (nsec): min=4190, max=71194, avg=13122.02, stdev=6475.13 00:23:10.172 clat (usec): min=893, max=7996, avg=4306.61, stdev=710.98 00:23:10.172 lat (usec): min=905, max=8011, avg=4319.73, stdev=710.78 00:23:10.172 clat percentiles (usec): 00:23:10.172 | 1.00th=[ 2737], 5.00th=[ 3261], 10.00th=[ 3556], 20.00th=[ 3884], 00:23:10.172 | 30.00th=[ 4047], 40.00th=[ 4178], 50.00th=[ 4228], 60.00th=[ 4359], 00:23:10.172 | 70.00th=[ 4424], 80.00th=[ 4555], 90.00th=[ 5211], 95.00th=[ 5800], 00:23:10.172 | 99.00th=[ 6587], 99.50th=[ 6849], 99.90th=[ 7701], 99.95th=[ 7701], 00:23:10.172 | 99.99th=[ 8029] 00:23:10.172 bw ( KiB/s): min=14224, max=15392, per=25.11%, avg=14714.90, stdev=363.70, samples=10 00:23:10.173 iops : min= 1778, max= 1924, avg=1839.30, stdev=45.43, samples=10 00:23:10.173 lat (usec) : 1000=0.01% 00:23:10.173 lat (msec) : 2=0.13%, 4=25.61%, 10=74.25% 00:23:10.173 cpu : usr=92.44%, sys=6.94%, ctx=9, majf=0, minf=0 00:23:10.173 IO depths : 1=0.1%, 2=8.3%, 4=63.2%, 8=28.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:10.173 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:10.173 complete : 0=0.0%, 4=93.0%, 8=7.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:10.173 issued rwts: total=9203,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:10.173 latency : target=0, window=0, percentile=100.00%, depth=8 00:23:10.173 00:23:10.173 Run status group 0 (all jobs): 00:23:10.173 READ: bw=57.2MiB/s (60.0MB/s), 14.3MiB/s-14.6MiB/s (14.9MB/s-15.3MB/s), io=289MiB (303MB), run=5001-5042msec 00:23:10.430 03:34:35 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:23:10.430 03:34:35 -- target/dif.sh@43 -- # local sub 00:23:10.430 03:34:35 -- target/dif.sh@45 -- # for sub in "$@" 00:23:10.430 03:34:35 -- target/dif.sh@46 -- # destroy_subsystem 0 00:23:10.430 03:34:35 -- target/dif.sh@36 -- # local sub_id=0 00:23:10.430 03:34:35 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:23:10.430 03:34:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:10.430 03:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.430 03:34:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:10.430 03:34:35 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:23:10.430 03:34:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:10.430 03:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.430 03:34:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:10.430 03:34:35 -- target/dif.sh@45 -- # for sub in "$@" 00:23:10.430 03:34:35 -- target/dif.sh@46 -- # destroy_subsystem 1 00:23:10.430 03:34:35 -- target/dif.sh@36 -- # local sub_id=1 00:23:10.430 03:34:35 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:10.430 03:34:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:10.430 03:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.430 03:34:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:10.430 03:34:35 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:23:10.430 03:34:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:10.430 03:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.430 03:34:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:10.430 00:23:10.430 real 0m24.566s 00:23:10.430 user 4m33.222s 00:23:10.430 sys 0m6.390s 00:23:10.430 03:34:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:10.430 03:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.430 ************************************ 00:23:10.430 END TEST fio_dif_rand_params 00:23:10.430 ************************************ 00:23:10.430 03:34:35 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:23:10.430 03:34:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:23:10.430 03:34:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:10.430 03:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.430 ************************************ 00:23:10.430 START TEST fio_dif_digest 00:23:10.430 ************************************ 00:23:10.430 03:34:35 -- common/autotest_common.sh@1111 -- # fio_dif_digest 00:23:10.430 03:34:35 -- target/dif.sh@123 -- # local NULL_DIF 00:23:10.430 03:34:35 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:23:10.689 03:34:35 -- target/dif.sh@125 -- # local hdgst ddgst 00:23:10.689 03:34:35 -- target/dif.sh@127 -- # NULL_DIF=3 00:23:10.689 03:34:35 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:23:10.689 03:34:35 -- target/dif.sh@127 -- # numjobs=3 00:23:10.689 03:34:35 -- target/dif.sh@127 -- # iodepth=3 00:23:10.689 03:34:35 -- target/dif.sh@127 -- # runtime=10 00:23:10.689 03:34:35 -- target/dif.sh@128 -- # hdgst=true 00:23:10.689 03:34:35 -- target/dif.sh@128 -- # ddgst=true 00:23:10.689 03:34:35 -- target/dif.sh@130 -- # create_subsystems 0 00:23:10.689 03:34:35 -- target/dif.sh@28 -- # local sub 00:23:10.689 03:34:35 -- target/dif.sh@30 -- # for sub in "$@" 00:23:10.689 03:34:35 -- target/dif.sh@31 -- # create_subsystem 0 00:23:10.689 03:34:35 -- target/dif.sh@18 -- # local sub_id=0 00:23:10.689 03:34:35 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:23:10.689 03:34:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:10.689 03:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.689 bdev_null0 00:23:10.689 03:34:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:10.689 03:34:35 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:23:10.689 03:34:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:10.689 03:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.689 03:34:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:10.689 03:34:35 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:23:10.689 03:34:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:10.689 03:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.689 03:34:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:10.689 03:34:35 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:10.689 03:34:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:10.689 03:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:10.689 [2024-04-27 03:34:35.436421] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:10.689 03:34:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:10.689 03:34:35 -- target/dif.sh@131 -- # fio /dev/fd/62 00:23:10.689 03:34:35 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:23:10.689 03:34:35 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:23:10.689 03:34:35 -- nvmf/common.sh@521 -- # config=() 00:23:10.689 03:34:35 -- nvmf/common.sh@521 -- # local subsystem config 00:23:10.689 03:34:35 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:23:10.689 03:34:35 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:23:10.689 { 00:23:10.689 "params": { 00:23:10.689 "name": "Nvme$subsystem", 00:23:10.689 "trtype": "$TEST_TRANSPORT", 00:23:10.689 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:10.689 "adrfam": "ipv4", 00:23:10.689 "trsvcid": "$NVMF_PORT", 00:23:10.689 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:10.689 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:10.689 "hdgst": ${hdgst:-false}, 00:23:10.689 "ddgst": ${ddgst:-false} 00:23:10.689 }, 00:23:10.689 "method": "bdev_nvme_attach_controller" 00:23:10.689 } 00:23:10.689 EOF 00:23:10.689 )") 00:23:10.689 03:34:35 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:23:10.689 03:34:35 -- common/autotest_common.sh@1342 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:23:10.689 03:34:35 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:23:10.689 03:34:35 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:23:10.689 03:34:35 -- target/dif.sh@82 -- # gen_fio_conf 00:23:10.689 03:34:35 -- common/autotest_common.sh@1325 -- # local sanitizers 00:23:10.689 03:34:35 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:23:10.689 03:34:35 -- target/dif.sh@54 -- # local file 00:23:10.689 03:34:35 -- common/autotest_common.sh@1327 -- # shift 00:23:10.689 03:34:35 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:23:10.689 03:34:35 -- target/dif.sh@56 -- # cat 00:23:10.689 03:34:35 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:23:10.689 03:34:35 -- nvmf/common.sh@543 -- # cat 00:23:10.689 03:34:35 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:23:10.689 03:34:35 -- common/autotest_common.sh@1331 -- # grep libasan 00:23:10.689 03:34:35 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:23:10.689 03:34:35 -- target/dif.sh@72 -- # (( file = 1 )) 00:23:10.689 03:34:35 -- target/dif.sh@72 -- # (( file <= files )) 00:23:10.689 03:34:35 -- nvmf/common.sh@545 -- # jq . 00:23:10.689 03:34:35 -- nvmf/common.sh@546 -- # IFS=, 00:23:10.689 03:34:35 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:23:10.689 "params": { 00:23:10.689 "name": "Nvme0", 00:23:10.689 "trtype": "tcp", 00:23:10.689 "traddr": "10.0.0.2", 00:23:10.689 "adrfam": "ipv4", 00:23:10.689 "trsvcid": "4420", 00:23:10.689 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:10.689 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:23:10.689 "hdgst": true, 00:23:10.689 "ddgst": true 00:23:10.689 }, 00:23:10.689 "method": "bdev_nvme_attach_controller" 00:23:10.689 }' 00:23:10.689 03:34:35 -- common/autotest_common.sh@1331 -- # asan_lib= 00:23:10.689 03:34:35 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:23:10.689 03:34:35 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:23:10.689 03:34:35 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:23:10.689 03:34:35 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:23:10.689 03:34:35 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:23:10.689 03:34:35 -- common/autotest_common.sh@1331 -- # asan_lib= 00:23:10.689 03:34:35 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:23:10.689 03:34:35 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:23:10.689 03:34:35 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:23:10.948 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:23:10.948 ... 00:23:10.948 fio-3.35 00:23:10.948 Starting 3 threads 00:23:10.948 EAL: No free 2048 kB hugepages reported on node 1 00:23:23.146 00:23:23.146 filename0: (groupid=0, jobs=1): err= 0: pid=1547744: Sat Apr 27 03:34:46 2024 00:23:23.146 read: IOPS=193, BW=24.2MiB/s (25.4MB/s)(243MiB/10046msec) 00:23:23.146 slat (nsec): min=7613, max=53318, avg=14659.79, stdev=4920.37 00:23:23.146 clat (usec): min=11070, max=53721, avg=15446.42, stdev=1574.07 00:23:23.147 lat (usec): min=11083, max=53742, avg=15461.08, stdev=1574.42 00:23:23.147 clat percentiles (usec): 00:23:23.147 | 1.00th=[13173], 5.00th=[13698], 10.00th=[14091], 20.00th=[14484], 00:23:23.147 | 30.00th=[14746], 40.00th=[15139], 50.00th=[15401], 60.00th=[15664], 00:23:23.147 | 70.00th=[15926], 80.00th=[16319], 90.00th=[16909], 95.00th=[17433], 00:23:23.147 | 99.00th=[18220], 99.50th=[18744], 99.90th=[46924], 99.95th=[53740], 00:23:23.147 | 99.99th=[53740] 00:23:23.147 bw ( KiB/s): min=23296, max=26112, per=33.18%, avg=24883.20, stdev=889.14, samples=20 00:23:23.147 iops : min= 182, max= 204, avg=194.40, stdev= 6.95, samples=20 00:23:23.147 lat (msec) : 20=99.90%, 50=0.05%, 100=0.05% 00:23:23.147 cpu : usr=92.33%, sys=7.20%, ctx=32, majf=0, minf=169 00:23:23.147 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:23.147 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.147 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.147 issued rwts: total=1946,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.147 latency : target=0, window=0, percentile=100.00%, depth=3 00:23:23.147 filename0: (groupid=0, jobs=1): err= 0: pid=1547745: Sat Apr 27 03:34:46 2024 00:23:23.147 read: IOPS=186, BW=23.4MiB/s (24.5MB/s)(235MiB/10047msec) 00:23:23.147 slat (nsec): min=7639, max=40737, avg=13363.75, stdev=2920.77 00:23:23.147 clat (usec): min=12270, max=55750, avg=16018.63, stdev=1699.51 00:23:23.147 lat (usec): min=12282, max=55767, avg=16032.00, stdev=1699.65 00:23:23.147 clat percentiles (usec): 00:23:23.147 | 1.00th=[13304], 5.00th=[14091], 10.00th=[14484], 20.00th=[15008], 00:23:23.147 | 30.00th=[15270], 40.00th=[15664], 50.00th=[15926], 60.00th=[16319], 00:23:23.147 | 70.00th=[16581], 80.00th=[16909], 90.00th=[17433], 95.00th=[17957], 00:23:23.147 | 99.00th=[18744], 99.50th=[19268], 99.90th=[49546], 99.95th=[55837], 00:23:23.147 | 99.99th=[55837] 00:23:23.147 bw ( KiB/s): min=22528, max=25600, per=31.99%, avg=23989.65, stdev=811.92, samples=20 00:23:23.147 iops : min= 176, max= 200, avg=187.40, stdev= 6.33, samples=20 00:23:23.147 lat (msec) : 20=99.89%, 50=0.05%, 100=0.05% 00:23:23.147 cpu : usr=92.52%, sys=7.03%, ctx=21, majf=0, minf=158 00:23:23.147 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:23.147 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.147 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.147 issued rwts: total=1877,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.147 latency : target=0, window=0, percentile=100.00%, depth=3 00:23:23.147 filename0: (groupid=0, jobs=1): err= 0: pid=1547746: Sat Apr 27 03:34:46 2024 00:23:23.147 read: IOPS=205, BW=25.7MiB/s (26.9MB/s)(258MiB/10048msec) 00:23:23.147 slat (nsec): min=7515, max=82166, avg=13191.81, stdev=3257.24 00:23:23.147 clat (usec): min=10761, max=53296, avg=14566.00, stdev=1569.82 00:23:23.147 lat (usec): min=10773, max=53314, avg=14579.19, stdev=1569.85 00:23:23.147 clat percentiles (usec): 00:23:23.147 | 1.00th=[12125], 5.00th=[12780], 10.00th=[13042], 20.00th=[13566], 00:23:23.147 | 30.00th=[13960], 40.00th=[14353], 50.00th=[14615], 60.00th=[14877], 00:23:23.147 | 70.00th=[15008], 80.00th=[15401], 90.00th=[15926], 95.00th=[16319], 00:23:23.147 | 99.00th=[17171], 99.50th=[17695], 99.90th=[18482], 99.95th=[48497], 00:23:23.147 | 99.99th=[53216] 00:23:23.147 bw ( KiB/s): min=25344, max=27648, per=35.19%, avg=26393.60, stdev=699.36, samples=20 00:23:23.147 iops : min= 198, max= 216, avg=206.20, stdev= 5.46, samples=20 00:23:23.147 lat (msec) : 20=99.90%, 50=0.05%, 100=0.05% 00:23:23.147 cpu : usr=92.13%, sys=7.42%, ctx=33, majf=0, minf=194 00:23:23.147 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:23.147 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.147 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.147 issued rwts: total=2064,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.147 latency : target=0, window=0, percentile=100.00%, depth=3 00:23:23.147 00:23:23.147 Run status group 0 (all jobs): 00:23:23.147 READ: bw=73.2MiB/s (76.8MB/s), 23.4MiB/s-25.7MiB/s (24.5MB/s-26.9MB/s), io=736MiB (772MB), run=10046-10048msec 00:23:23.147 03:34:46 -- target/dif.sh@132 -- # destroy_subsystems 0 00:23:23.147 03:34:46 -- target/dif.sh@43 -- # local sub 00:23:23.147 03:34:46 -- target/dif.sh@45 -- # for sub in "$@" 00:23:23.147 03:34:46 -- target/dif.sh@46 -- # destroy_subsystem 0 00:23:23.147 03:34:46 -- target/dif.sh@36 -- # local sub_id=0 00:23:23.147 03:34:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:23:23.147 03:34:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:23.147 03:34:46 -- common/autotest_common.sh@10 -- # set +x 00:23:23.147 03:34:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:23.147 03:34:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:23:23.147 03:34:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:23.147 03:34:46 -- common/autotest_common.sh@10 -- # set +x 00:23:23.147 03:34:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:23.147 00:23:23.147 real 0m11.150s 00:23:23.147 user 0m29.020s 00:23:23.147 sys 0m2.417s 00:23:23.147 03:34:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:23.147 03:34:46 -- common/autotest_common.sh@10 -- # set +x 00:23:23.147 ************************************ 00:23:23.147 END TEST fio_dif_digest 00:23:23.147 ************************************ 00:23:23.147 03:34:46 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:23:23.147 03:34:46 -- target/dif.sh@147 -- # nvmftestfini 00:23:23.147 03:34:46 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:23.147 03:34:46 -- nvmf/common.sh@117 -- # sync 00:23:23.147 03:34:46 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:23:23.147 03:34:46 -- nvmf/common.sh@120 -- # set +e 00:23:23.147 03:34:46 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:23.147 03:34:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:23:23.147 rmmod nvme_tcp 00:23:23.147 rmmod nvme_fabrics 00:23:23.147 rmmod nvme_keyring 00:23:23.147 03:34:46 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:23.147 03:34:46 -- nvmf/common.sh@124 -- # set -e 00:23:23.147 03:34:46 -- nvmf/common.sh@125 -- # return 0 00:23:23.147 03:34:46 -- nvmf/common.sh@478 -- # '[' -n 1541394 ']' 00:23:23.147 03:34:46 -- nvmf/common.sh@479 -- # killprocess 1541394 00:23:23.147 03:34:46 -- common/autotest_common.sh@936 -- # '[' -z 1541394 ']' 00:23:23.147 03:34:46 -- common/autotest_common.sh@940 -- # kill -0 1541394 00:23:23.147 03:34:46 -- common/autotest_common.sh@941 -- # uname 00:23:23.147 03:34:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:23.147 03:34:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1541394 00:23:23.147 03:34:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:23.147 03:34:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:23.147 03:34:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1541394' 00:23:23.147 killing process with pid 1541394 00:23:23.147 03:34:46 -- common/autotest_common.sh@955 -- # kill 1541394 00:23:23.147 03:34:46 -- common/autotest_common.sh@960 -- # wait 1541394 00:23:23.147 03:34:46 -- nvmf/common.sh@481 -- # '[' iso == iso ']' 00:23:23.147 03:34:46 -- nvmf/common.sh@482 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:23:23.147 Waiting for block devices as requested 00:23:23.147 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:23:23.406 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:23:23.406 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:23:23.406 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:23:23.406 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:23:23.664 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:23:23.664 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:23:23.664 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:23:23.664 0000:0b:00.0 (8086 0a54): vfio-pci -> nvme 00:23:23.922 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:23:23.922 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:23:24.180 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:23:24.180 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:23:24.180 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:23:24.180 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:23:24.438 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:23:24.438 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:23:24.438 03:34:49 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:23:24.438 03:34:49 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:23:24.438 03:34:49 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:24.438 03:34:49 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:23:24.438 03:34:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:24.438 03:34:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:23:24.438 03:34:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:27.005 03:34:51 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:23:27.005 00:23:27.005 real 1m8.006s 00:23:27.005 user 6m31.620s 00:23:27.005 sys 0m18.009s 00:23:27.005 03:34:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:27.005 03:34:51 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 ************************************ 00:23:27.005 END TEST nvmf_dif 00:23:27.005 ************************************ 00:23:27.005 03:34:51 -- spdk/autotest.sh@291 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:23:27.005 03:34:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:23:27.005 03:34:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:27.005 03:34:51 -- common/autotest_common.sh@10 -- # set +x 00:23:27.005 ************************************ 00:23:27.005 START TEST nvmf_abort_qd_sizes 00:23:27.005 ************************************ 00:23:27.005 03:34:51 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:23:27.005 * Looking for test storage... 00:23:27.005 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:27.005 03:34:51 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:27.005 03:34:51 -- nvmf/common.sh@7 -- # uname -s 00:23:27.005 03:34:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:27.005 03:34:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:27.005 03:34:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:27.005 03:34:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:27.005 03:34:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:27.005 03:34:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:27.005 03:34:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:27.005 03:34:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:27.005 03:34:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:27.005 03:34:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:27.005 03:34:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:23:27.005 03:34:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:23:27.005 03:34:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:27.005 03:34:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:27.005 03:34:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:27.005 03:34:51 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:27.005 03:34:51 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:27.005 03:34:51 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:27.005 03:34:51 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:27.005 03:34:51 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:27.005 03:34:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.005 03:34:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.005 03:34:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.005 03:34:51 -- paths/export.sh@5 -- # export PATH 00:23:27.005 03:34:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.005 03:34:51 -- nvmf/common.sh@47 -- # : 0 00:23:27.005 03:34:51 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:27.005 03:34:51 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:27.005 03:34:51 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:27.005 03:34:51 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:27.005 03:34:51 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:27.005 03:34:51 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:27.005 03:34:51 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:27.005 03:34:51 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:27.005 03:34:51 -- target/abort_qd_sizes.sh@70 -- # nvmftestinit 00:23:27.005 03:34:51 -- nvmf/common.sh@430 -- # '[' -z tcp ']' 00:23:27.005 03:34:51 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:27.005 03:34:51 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:27.005 03:34:51 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:27.005 03:34:51 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:27.005 03:34:51 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:27.005 03:34:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:23:27.005 03:34:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:27.005 03:34:51 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:27.005 03:34:51 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:27.005 03:34:51 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:27.005 03:34:51 -- common/autotest_common.sh@10 -- # set +x 00:23:28.907 03:34:53 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:28.907 03:34:53 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:28.907 03:34:53 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:28.907 03:34:53 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:28.907 03:34:53 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:28.907 03:34:53 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:28.907 03:34:53 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:28.907 03:34:53 -- nvmf/common.sh@295 -- # net_devs=() 00:23:28.907 03:34:53 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:28.907 03:34:53 -- nvmf/common.sh@296 -- # e810=() 00:23:28.907 03:34:53 -- nvmf/common.sh@296 -- # local -ga e810 00:23:28.907 03:34:53 -- nvmf/common.sh@297 -- # x722=() 00:23:28.907 03:34:53 -- nvmf/common.sh@297 -- # local -ga x722 00:23:28.907 03:34:53 -- nvmf/common.sh@298 -- # mlx=() 00:23:28.908 03:34:53 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:28.908 03:34:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:28.908 03:34:53 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:28.908 03:34:53 -- nvmf/common.sh@321 -- # [[ tcp == rdma ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:23:28.908 03:34:53 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:28.908 03:34:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:28.908 03:34:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.0 (0x8086 - 0x159b)' 00:23:28.908 Found 0000:09:00.0 (0x8086 - 0x159b) 00:23:28.908 03:34:53 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:28.908 03:34:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:09:00.1 (0x8086 - 0x159b)' 00:23:28.908 Found 0000:09:00.1 (0x8086 - 0x159b) 00:23:28.908 03:34:53 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@352 -- # [[ tcp == rdma ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:28.908 03:34:53 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@372 -- # [[ tcp == rdma ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:28.908 03:34:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:28.908 03:34:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:28.908 03:34:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:28.908 03:34:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.0: cvl_0_0' 00:23:28.908 Found net devices under 0000:09:00.0: cvl_0_0 00:23:28.908 03:34:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:28.908 03:34:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:28.908 03:34:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:28.908 03:34:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:28.908 03:34:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:28.908 03:34:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:09:00.1: cvl_0_1' 00:23:28.908 Found net devices under 0000:09:00.1: cvl_0_1 00:23:28.908 03:34:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:28.908 03:34:53 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:28.908 03:34:53 -- nvmf/common.sh@403 -- # is_hw=yes 00:23:28.908 03:34:53 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@406 -- # [[ tcp == tcp ]] 00:23:28.908 03:34:53 -- nvmf/common.sh@407 -- # nvmf_tcp_init 00:23:28.908 03:34:53 -- nvmf/common.sh@229 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:28.908 03:34:53 -- nvmf/common.sh@230 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:28.908 03:34:53 -- nvmf/common.sh@231 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:28.908 03:34:53 -- nvmf/common.sh@234 -- # (( 2 > 1 )) 00:23:28.908 03:34:53 -- nvmf/common.sh@236 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:28.908 03:34:53 -- nvmf/common.sh@237 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:28.908 03:34:53 -- nvmf/common.sh@240 -- # NVMF_SECOND_TARGET_IP= 00:23:28.908 03:34:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:28.908 03:34:53 -- nvmf/common.sh@243 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:28.908 03:34:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_0 00:23:28.908 03:34:53 -- nvmf/common.sh@245 -- # ip -4 addr flush cvl_0_1 00:23:28.908 03:34:53 -- nvmf/common.sh@248 -- # ip netns add cvl_0_0_ns_spdk 00:23:28.908 03:34:53 -- nvmf/common.sh@251 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:28.908 03:34:53 -- nvmf/common.sh@254 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:28.908 03:34:53 -- nvmf/common.sh@255 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:28.908 03:34:53 -- nvmf/common.sh@258 -- # ip link set cvl_0_1 up 00:23:28.908 03:34:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:28.908 03:34:53 -- nvmf/common.sh@261 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:28.908 03:34:53 -- nvmf/common.sh@264 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:28.908 03:34:53 -- nvmf/common.sh@267 -- # ping -c 1 10.0.0.2 00:23:28.908 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:28.908 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:23:28.908 00:23:28.908 --- 10.0.0.2 ping statistics --- 00:23:28.908 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:28.908 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:23:28.908 03:34:53 -- nvmf/common.sh@268 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:28.908 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:28.908 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.065 ms 00:23:28.908 00:23:28.908 --- 10.0.0.1 ping statistics --- 00:23:28.908 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:28.908 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:23:28.908 03:34:53 -- nvmf/common.sh@270 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:28.908 03:34:53 -- nvmf/common.sh@411 -- # return 0 00:23:28.908 03:34:53 -- nvmf/common.sh@439 -- # '[' iso == iso ']' 00:23:28.908 03:34:53 -- nvmf/common.sh@440 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:23:29.842 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:23:29.842 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:23:29.842 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:23:29.842 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:23:29.842 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:23:30.100 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:23:30.100 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:23:30.100 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:23:30.100 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:23:30.100 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:23:30.100 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:23:30.100 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:23:30.100 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:23:30.100 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:23:30.100 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:23:30.100 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:23:31.034 0000:0b:00.0 (8086 0a54): nvme -> vfio-pci 00:23:31.034 03:34:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:31.034 03:34:55 -- nvmf/common.sh@444 -- # [[ tcp == \r\d\m\a ]] 00:23:31.034 03:34:55 -- nvmf/common.sh@453 -- # [[ tcp == \t\c\p ]] 00:23:31.034 03:34:55 -- nvmf/common.sh@454 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:31.034 03:34:55 -- nvmf/common.sh@457 -- # '[' tcp == tcp ']' 00:23:31.034 03:34:55 -- nvmf/common.sh@463 -- # modprobe nvme-tcp 00:23:31.293 03:34:56 -- target/abort_qd_sizes.sh@71 -- # nvmfappstart -m 0xf 00:23:31.293 03:34:56 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:23:31.293 03:34:56 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:31.293 03:34:56 -- common/autotest_common.sh@10 -- # set +x 00:23:31.293 03:34:56 -- nvmf/common.sh@470 -- # nvmfpid=1552539 00:23:31.293 03:34:56 -- nvmf/common.sh@469 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:23:31.293 03:34:56 -- nvmf/common.sh@471 -- # waitforlisten 1552539 00:23:31.293 03:34:56 -- common/autotest_common.sh@817 -- # '[' -z 1552539 ']' 00:23:31.293 03:34:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:31.293 03:34:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:23:31.293 03:34:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:31.293 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:31.293 03:34:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:23:31.293 03:34:56 -- common/autotest_common.sh@10 -- # set +x 00:23:31.293 [2024-04-27 03:34:56.063721] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:23:31.293 [2024-04-27 03:34:56.063790] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:31.293 EAL: No free 2048 kB hugepages reported on node 1 00:23:31.293 [2024-04-27 03:34:56.128690] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:31.293 [2024-04-27 03:34:56.242874] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:31.293 [2024-04-27 03:34:56.242934] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:31.293 [2024-04-27 03:34:56.242948] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:31.293 [2024-04-27 03:34:56.242960] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:31.293 [2024-04-27 03:34:56.242970] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:31.293 [2024-04-27 03:34:56.243048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:31.293 [2024-04-27 03:34:56.243112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:31.293 [2024-04-27 03:34:56.243206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:31.293 [2024-04-27 03:34:56.243209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:32.224 03:34:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:23:32.224 03:34:56 -- common/autotest_common.sh@850 -- # return 0 00:23:32.224 03:34:56 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:23:32.224 03:34:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:32.224 03:34:56 -- common/autotest_common.sh@10 -- # set +x 00:23:32.224 03:34:56 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:32.224 03:34:56 -- target/abort_qd_sizes.sh@73 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:23:32.224 03:34:56 -- target/abort_qd_sizes.sh@75 -- # mapfile -t nvmes 00:23:32.224 03:34:56 -- target/abort_qd_sizes.sh@75 -- # nvme_in_userspace 00:23:32.224 03:34:56 -- scripts/common.sh@309 -- # local bdf bdfs 00:23:32.224 03:34:56 -- scripts/common.sh@310 -- # local nvmes 00:23:32.224 03:34:56 -- scripts/common.sh@312 -- # [[ -n 0000:0b:00.0 ]] 00:23:32.224 03:34:56 -- scripts/common.sh@313 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:23:32.224 03:34:56 -- scripts/common.sh@318 -- # for bdf in "${nvmes[@]}" 00:23:32.224 03:34:56 -- scripts/common.sh@319 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:0b:00.0 ]] 00:23:32.224 03:34:56 -- scripts/common.sh@320 -- # uname -s 00:23:32.224 03:34:57 -- scripts/common.sh@320 -- # [[ Linux == FreeBSD ]] 00:23:32.225 03:34:57 -- scripts/common.sh@323 -- # bdfs+=("$bdf") 00:23:32.225 03:34:57 -- scripts/common.sh@325 -- # (( 1 )) 00:23:32.225 03:34:57 -- scripts/common.sh@326 -- # printf '%s\n' 0000:0b:00.0 00:23:32.225 03:34:57 -- target/abort_qd_sizes.sh@76 -- # (( 1 > 0 )) 00:23:32.225 03:34:57 -- target/abort_qd_sizes.sh@78 -- # nvme=0000:0b:00.0 00:23:32.225 03:34:57 -- target/abort_qd_sizes.sh@80 -- # run_test spdk_target_abort spdk_target 00:23:32.225 03:34:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:23:32.225 03:34:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:32.225 03:34:57 -- common/autotest_common.sh@10 -- # set +x 00:23:32.225 ************************************ 00:23:32.225 START TEST spdk_target_abort 00:23:32.225 ************************************ 00:23:32.225 03:34:57 -- common/autotest_common.sh@1111 -- # spdk_target 00:23:32.225 03:34:57 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:23:32.225 03:34:57 -- target/abort_qd_sizes.sh@45 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:0b:00.0 -b spdk_target 00:23:32.225 03:34:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.225 03:34:57 -- common/autotest_common.sh@10 -- # set +x 00:23:35.503 spdk_targetn1 00:23:35.503 03:34:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@47 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:35.503 03:34:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:35.503 03:34:59 -- common/autotest_common.sh@10 -- # set +x 00:23:35.503 [2024-04-27 03:34:59.927380] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:35.503 03:34:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:testnqn -a -s SPDKISFASTANDAWESOME 00:23:35.503 03:34:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:35.503 03:34:59 -- common/autotest_common.sh@10 -- # set +x 00:23:35.503 03:34:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:testnqn spdk_targetn1 00:23:35.503 03:34:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:35.503 03:34:59 -- common/autotest_common.sh@10 -- # set +x 00:23:35.503 03:34:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:testnqn -t tcp -a 10.0.0.2 -s 4420 00:23:35.503 03:34:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:35.503 03:34:59 -- common/autotest_common.sh@10 -- # set +x 00:23:35.503 [2024-04-27 03:34:59.959630] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:35.503 03:34:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@52 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:testnqn 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:testnqn 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@24 -- # local target r 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:23:35.503 03:34:59 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:23:35.503 EAL: No free 2048 kB hugepages reported on node 1 00:23:38.781 Initializing NVMe Controllers 00:23:38.781 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:testnqn 00:23:38.781 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:23:38.781 Initialization complete. Launching workers. 00:23:38.781 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 11594, failed: 0 00:23:38.781 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 1263, failed to submit 10331 00:23:38.781 success 757, unsuccess 506, failed 0 00:23:38.781 03:35:03 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:23:38.781 03:35:03 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:23:38.781 EAL: No free 2048 kB hugepages reported on node 1 00:23:42.059 Initializing NVMe Controllers 00:23:42.059 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:testnqn 00:23:42.059 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:23:42.059 Initialization complete. Launching workers. 00:23:42.059 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 9184, failed: 0 00:23:42.059 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 1278, failed to submit 7906 00:23:42.059 success 283, unsuccess 995, failed 0 00:23:42.059 03:35:06 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:23:42.059 03:35:06 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:23:42.059 EAL: No free 2048 kB hugepages reported on node 1 00:23:45.337 Initializing NVMe Controllers 00:23:45.337 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:testnqn 00:23:45.337 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:23:45.337 Initialization complete. Launching workers. 00:23:45.337 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 31117, failed: 0 00:23:45.337 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 2755, failed to submit 28362 00:23:45.337 success 532, unsuccess 2223, failed 0 00:23:45.337 03:35:09 -- target/abort_qd_sizes.sh@54 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:testnqn 00:23:45.337 03:35:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:45.337 03:35:09 -- common/autotest_common.sh@10 -- # set +x 00:23:45.337 03:35:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:45.337 03:35:09 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:23:45.337 03:35:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:45.337 03:35:09 -- common/autotest_common.sh@10 -- # set +x 00:23:46.270 03:35:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:46.270 03:35:10 -- target/abort_qd_sizes.sh@61 -- # killprocess 1552539 00:23:46.270 03:35:10 -- common/autotest_common.sh@936 -- # '[' -z 1552539 ']' 00:23:46.270 03:35:10 -- common/autotest_common.sh@940 -- # kill -0 1552539 00:23:46.270 03:35:10 -- common/autotest_common.sh@941 -- # uname 00:23:46.270 03:35:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:46.270 03:35:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1552539 00:23:46.270 03:35:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:46.270 03:35:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:46.270 03:35:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1552539' 00:23:46.270 killing process with pid 1552539 00:23:46.270 03:35:10 -- common/autotest_common.sh@955 -- # kill 1552539 00:23:46.270 03:35:10 -- common/autotest_common.sh@960 -- # wait 1552539 00:23:46.270 00:23:46.270 real 0m14.153s 00:23:46.270 user 0m55.849s 00:23:46.270 sys 0m2.749s 00:23:46.270 03:35:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:46.270 03:35:11 -- common/autotest_common.sh@10 -- # set +x 00:23:46.270 ************************************ 00:23:46.270 END TEST spdk_target_abort 00:23:46.270 ************************************ 00:23:46.528 03:35:11 -- target/abort_qd_sizes.sh@81 -- # run_test kernel_target_abort kernel_target 00:23:46.528 03:35:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:23:46.528 03:35:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:46.528 03:35:11 -- common/autotest_common.sh@10 -- # set +x 00:23:46.528 ************************************ 00:23:46.528 START TEST kernel_target_abort 00:23:46.528 ************************************ 00:23:46.528 03:35:11 -- common/autotest_common.sh@1111 -- # kernel_target 00:23:46.528 03:35:11 -- target/abort_qd_sizes.sh@65 -- # get_main_ns_ip 00:23:46.528 03:35:11 -- nvmf/common.sh@717 -- # local ip 00:23:46.528 03:35:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:46.528 03:35:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:46.528 03:35:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:46.528 03:35:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:46.528 03:35:11 -- nvmf/common.sh@723 -- # [[ -z tcp ]] 00:23:46.528 03:35:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_INITIATOR_IP ]] 00:23:46.528 03:35:11 -- nvmf/common.sh@724 -- # ip=NVMF_INITIATOR_IP 00:23:46.528 03:35:11 -- nvmf/common.sh@726 -- # [[ -z 10.0.0.1 ]] 00:23:46.528 03:35:11 -- nvmf/common.sh@731 -- # echo 10.0.0.1 00:23:46.528 03:35:11 -- target/abort_qd_sizes.sh@65 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 10.0.0.1 00:23:46.528 03:35:11 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=10.0.0.1 00:23:46.528 03:35:11 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:23:46.528 03:35:11 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:23:46.528 03:35:11 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:23:46.528 03:35:11 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:23:46.528 03:35:11 -- nvmf/common.sh@628 -- # local block nvme 00:23:46.528 03:35:11 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:23:46.528 03:35:11 -- nvmf/common.sh@631 -- # modprobe nvmet 00:23:46.528 03:35:11 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:23:46.528 03:35:11 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:23:47.903 Waiting for block devices as requested 00:23:47.903 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:23:47.903 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:23:47.903 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:23:47.903 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:23:47.904 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:23:48.162 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:23:48.162 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:23:48.162 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:23:48.162 0000:0b:00.0 (8086 0a54): vfio-pci -> nvme 00:23:48.423 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:23:48.423 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:23:48.423 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:23:48.707 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:23:48.707 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:23:48.707 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:23:48.707 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:23:48.969 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:23:48.969 03:35:13 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:23:48.969 03:35:13 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:23:48.969 03:35:13 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:23:48.969 03:35:13 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:23:48.969 03:35:13 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:23:48.969 03:35:13 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:23:48.969 03:35:13 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:23:48.969 03:35:13 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:23:48.969 03:35:13 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:23:48.969 No valid GPT data, bailing 00:23:48.969 03:35:13 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:23:48.969 03:35:13 -- scripts/common.sh@391 -- # pt= 00:23:48.969 03:35:13 -- scripts/common.sh@392 -- # return 1 00:23:48.969 03:35:13 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:23:48.969 03:35:13 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:23:48.969 03:35:13 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:23:48.969 03:35:13 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:23:48.969 03:35:13 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:23:48.969 03:35:13 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:23:48.969 03:35:13 -- nvmf/common.sh@656 -- # echo 1 00:23:48.969 03:35:13 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:23:48.969 03:35:13 -- nvmf/common.sh@658 -- # echo 1 00:23:48.969 03:35:13 -- nvmf/common.sh@660 -- # echo 10.0.0.1 00:23:48.969 03:35:13 -- nvmf/common.sh@661 -- # echo tcp 00:23:48.969 03:35:13 -- nvmf/common.sh@662 -- # echo 4420 00:23:48.969 03:35:13 -- nvmf/common.sh@663 -- # echo ipv4 00:23:48.969 03:35:13 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:23:48.969 03:35:13 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a --hostid=29f67375-a902-e411-ace9-001e67bc3c9a -a 10.0.0.1 -t tcp -s 4420 00:23:49.229 00:23:49.229 Discovery Log Number of Records 2, Generation counter 2 00:23:49.229 =====Discovery Log Entry 0====== 00:23:49.229 trtype: tcp 00:23:49.229 adrfam: ipv4 00:23:49.229 subtype: current discovery subsystem 00:23:49.229 treq: not specified, sq flow control disable supported 00:23:49.229 portid: 1 00:23:49.229 trsvcid: 4420 00:23:49.229 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:23:49.229 traddr: 10.0.0.1 00:23:49.229 eflags: none 00:23:49.229 sectype: none 00:23:49.229 =====Discovery Log Entry 1====== 00:23:49.229 trtype: tcp 00:23:49.229 adrfam: ipv4 00:23:49.229 subtype: nvme subsystem 00:23:49.229 treq: not specified, sq flow control disable supported 00:23:49.229 portid: 1 00:23:49.229 trsvcid: 4420 00:23:49.229 subnqn: nqn.2016-06.io.spdk:testnqn 00:23:49.229 traddr: 10.0.0.1 00:23:49.229 eflags: none 00:23:49.229 sectype: none 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@66 -- # rabort tcp IPv4 10.0.0.1 4420 nqn.2016-06.io.spdk:testnqn 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:testnqn 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@24 -- # local target r 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:23:49.229 03:35:14 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:23:49.229 EAL: No free 2048 kB hugepages reported on node 1 00:23:52.551 Initializing NVMe Controllers 00:23:52.551 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: nqn.2016-06.io.spdk:testnqn 00:23:52.551 Associating TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:23:52.551 Initialization complete. Launching workers. 00:23:52.551 NS: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 40135, failed: 0 00:23:52.551 CTRLR: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 40135, failed to submit 0 00:23:52.551 success 0, unsuccess 40135, failed 0 00:23:52.551 03:35:17 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:23:52.551 03:35:17 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:23:52.551 EAL: No free 2048 kB hugepages reported on node 1 00:23:55.868 Initializing NVMe Controllers 00:23:55.868 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: nqn.2016-06.io.spdk:testnqn 00:23:55.868 Associating TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:23:55.868 Initialization complete. Launching workers. 00:23:55.868 NS: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 76360, failed: 0 00:23:55.868 CTRLR: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 19210, failed to submit 57150 00:23:55.868 success 0, unsuccess 19210, failed 0 00:23:55.868 03:35:20 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:23:55.868 03:35:20 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:23:55.868 EAL: No free 2048 kB hugepages reported on node 1 00:23:58.403 Initializing NVMe Controllers 00:23:58.403 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: nqn.2016-06.io.spdk:testnqn 00:23:58.403 Associating TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 with lcore 0 00:23:58.403 Initialization complete. Launching workers. 00:23:58.403 NS: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) NSID 1 I/O completed: 71300, failed: 0 00:23:58.403 CTRLR: TCP (addr:10.0.0.1 subnqn:nqn.2016-06.io.spdk:testnqn) abort submitted 17810, failed to submit 53490 00:23:58.403 success 0, unsuccess 17810, failed 0 00:23:58.403 03:35:23 -- target/abort_qd_sizes.sh@67 -- # clean_kernel_target 00:23:58.403 03:35:23 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:23:58.403 03:35:23 -- nvmf/common.sh@675 -- # echo 0 00:23:58.403 03:35:23 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:23:58.403 03:35:23 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:23:58.403 03:35:23 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:23:58.403 03:35:23 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:23:58.403 03:35:23 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:23:58.403 03:35:23 -- nvmf/common.sh@684 -- # modprobe -r nvmet_tcp nvmet 00:23:58.662 03:35:23 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:23:59.600 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:23:59.600 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:23:59.600 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:23:59.600 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:23:59.600 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:23:59.600 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:23:59.600 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:23:59.860 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:23:59.860 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:23:59.860 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:23:59.860 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:23:59.860 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:23:59.860 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:23:59.860 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:23:59.860 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:23:59.860 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:24:00.796 0000:0b:00.0 (8086 0a54): nvme -> vfio-pci 00:24:00.796 00:24:00.796 real 0m14.382s 00:24:00.796 user 0m5.805s 00:24:00.796 sys 0m3.363s 00:24:00.796 03:35:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:00.796 03:35:25 -- common/autotest_common.sh@10 -- # set +x 00:24:00.796 ************************************ 00:24:00.796 END TEST kernel_target_abort 00:24:00.796 ************************************ 00:24:00.796 03:35:25 -- target/abort_qd_sizes.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:24:00.796 03:35:25 -- target/abort_qd_sizes.sh@84 -- # nvmftestfini 00:24:00.796 03:35:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:00.796 03:35:25 -- nvmf/common.sh@117 -- # sync 00:24:00.796 03:35:25 -- nvmf/common.sh@119 -- # '[' tcp == tcp ']' 00:24:00.796 03:35:25 -- nvmf/common.sh@120 -- # set +e 00:24:00.796 03:35:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:00.796 03:35:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-tcp 00:24:00.796 rmmod nvme_tcp 00:24:01.054 rmmod nvme_fabrics 00:24:01.054 rmmod nvme_keyring 00:24:01.054 03:35:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:01.054 03:35:25 -- nvmf/common.sh@124 -- # set -e 00:24:01.054 03:35:25 -- nvmf/common.sh@125 -- # return 0 00:24:01.054 03:35:25 -- nvmf/common.sh@478 -- # '[' -n 1552539 ']' 00:24:01.055 03:35:25 -- nvmf/common.sh@479 -- # killprocess 1552539 00:24:01.055 03:35:25 -- common/autotest_common.sh@936 -- # '[' -z 1552539 ']' 00:24:01.055 03:35:25 -- common/autotest_common.sh@940 -- # kill -0 1552539 00:24:01.055 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1552539) - No such process 00:24:01.055 03:35:25 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1552539 is not found' 00:24:01.055 Process with pid 1552539 is not found 00:24:01.055 03:35:25 -- nvmf/common.sh@481 -- # '[' iso == iso ']' 00:24:01.055 03:35:25 -- nvmf/common.sh@482 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:24:01.995 Waiting for block devices as requested 00:24:01.996 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:24:02.254 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:24:02.254 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:24:02.254 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:24:02.254 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:24:02.513 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:24:02.513 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:24:02.513 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:24:02.513 0000:0b:00.0 (8086 0a54): vfio-pci -> nvme 00:24:02.772 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:24:02.772 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:24:02.772 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:24:03.030 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:24:03.030 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:24:03.030 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:24:03.030 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:24:03.288 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:24:03.288 03:35:28 -- nvmf/common.sh@484 -- # [[ tcp == \t\c\p ]] 00:24:03.289 03:35:28 -- nvmf/common.sh@485 -- # nvmf_tcp_fini 00:24:03.289 03:35:28 -- nvmf/common.sh@274 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:03.289 03:35:28 -- nvmf/common.sh@278 -- # remove_spdk_ns 00:24:03.289 03:35:28 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:03.289 03:35:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:24:03.289 03:35:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:05.825 03:35:30 -- nvmf/common.sh@279 -- # ip -4 addr flush cvl_0_1 00:24:05.825 00:24:05.825 real 0m38.716s 00:24:05.825 user 1m3.952s 00:24:05.825 sys 0m9.612s 00:24:05.825 03:35:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:05.825 03:35:30 -- common/autotest_common.sh@10 -- # set +x 00:24:05.825 ************************************ 00:24:05.825 END TEST nvmf_abort_qd_sizes 00:24:05.825 ************************************ 00:24:05.825 03:35:30 -- spdk/autotest.sh@293 -- # run_test keyring_file /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/keyring/file.sh 00:24:05.825 03:35:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:05.825 03:35:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:05.825 03:35:30 -- common/autotest_common.sh@10 -- # set +x 00:24:05.825 ************************************ 00:24:05.825 START TEST keyring_file 00:24:05.825 ************************************ 00:24:05.825 03:35:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/keyring/file.sh 00:24:05.825 * Looking for test storage... 00:24:05.825 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/keyring 00:24:05.825 03:35:30 -- keyring/file.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/keyring/common.sh 00:24:05.825 03:35:30 -- keyring/common.sh@4 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:05.825 03:35:30 -- nvmf/common.sh@7 -- # uname -s 00:24:05.825 03:35:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:05.825 03:35:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:05.825 03:35:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:05.825 03:35:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:05.825 03:35:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:05.825 03:35:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:05.825 03:35:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:05.825 03:35:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:05.825 03:35:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:05.825 03:35:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:05.825 03:35:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:29f67375-a902-e411-ace9-001e67bc3c9a 00:24:05.825 03:35:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=29f67375-a902-e411-ace9-001e67bc3c9a 00:24:05.826 03:35:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:05.826 03:35:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:05.826 03:35:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:05.826 03:35:30 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:05.826 03:35:30 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:05.826 03:35:30 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:05.826 03:35:30 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:05.826 03:35:30 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:05.826 03:35:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:05.826 03:35:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:05.826 03:35:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:05.826 03:35:30 -- paths/export.sh@5 -- # export PATH 00:24:05.826 03:35:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:05.826 03:35:30 -- nvmf/common.sh@47 -- # : 0 00:24:05.826 03:35:30 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:05.826 03:35:30 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:05.826 03:35:30 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:05.826 03:35:30 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:05.826 03:35:30 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:05.826 03:35:30 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:05.826 03:35:30 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:05.826 03:35:30 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:05.826 03:35:30 -- keyring/common.sh@6 -- # bperfsock=/var/tmp/bperf.sock 00:24:05.826 03:35:30 -- keyring/file.sh@13 -- # subnqn=nqn.2016-06.io.spdk:cnode0 00:24:05.826 03:35:30 -- keyring/file.sh@14 -- # hostnqn=nqn.2016-06.io.spdk:host0 00:24:05.826 03:35:30 -- keyring/file.sh@15 -- # key0=00112233445566778899aabbccddeeff 00:24:05.826 03:35:30 -- keyring/file.sh@16 -- # key1=112233445566778899aabbccddeeff00 00:24:05.826 03:35:30 -- keyring/file.sh@24 -- # trap cleanup EXIT 00:24:05.826 03:35:30 -- keyring/file.sh@26 -- # prep_key key0 00112233445566778899aabbccddeeff 0 00:24:05.826 03:35:30 -- keyring/common.sh@15 -- # local name key digest path 00:24:05.826 03:35:30 -- keyring/common.sh@17 -- # name=key0 00:24:05.826 03:35:30 -- keyring/common.sh@17 -- # key=00112233445566778899aabbccddeeff 00:24:05.826 03:35:30 -- keyring/common.sh@17 -- # digest=0 00:24:05.826 03:35:30 -- keyring/common.sh@18 -- # mktemp 00:24:05.826 03:35:30 -- keyring/common.sh@18 -- # path=/tmp/tmp.zCVe5YMXsf 00:24:05.826 03:35:30 -- keyring/common.sh@20 -- # format_interchange_psk 00112233445566778899aabbccddeeff 0 00:24:05.826 03:35:30 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff 0 00:24:05.826 03:35:30 -- nvmf/common.sh@691 -- # local prefix key digest 00:24:05.826 03:35:30 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:24:05.826 03:35:30 -- nvmf/common.sh@693 -- # key=00112233445566778899aabbccddeeff 00:24:05.826 03:35:30 -- nvmf/common.sh@693 -- # digest=0 00:24:05.826 03:35:30 -- nvmf/common.sh@694 -- # python - 00:24:05.826 03:35:30 -- keyring/common.sh@21 -- # chmod 0600 /tmp/tmp.zCVe5YMXsf 00:24:05.826 03:35:30 -- keyring/common.sh@23 -- # echo /tmp/tmp.zCVe5YMXsf 00:24:05.826 03:35:30 -- keyring/file.sh@26 -- # key0path=/tmp/tmp.zCVe5YMXsf 00:24:05.826 03:35:30 -- keyring/file.sh@27 -- # prep_key key1 112233445566778899aabbccddeeff00 0 00:24:05.826 03:35:30 -- keyring/common.sh@15 -- # local name key digest path 00:24:05.826 03:35:30 -- keyring/common.sh@17 -- # name=key1 00:24:05.826 03:35:30 -- keyring/common.sh@17 -- # key=112233445566778899aabbccddeeff00 00:24:05.826 03:35:30 -- keyring/common.sh@17 -- # digest=0 00:24:05.826 03:35:30 -- keyring/common.sh@18 -- # mktemp 00:24:05.826 03:35:30 -- keyring/common.sh@18 -- # path=/tmp/tmp.xR3dCjO1Zi 00:24:05.826 03:35:30 -- keyring/common.sh@20 -- # format_interchange_psk 112233445566778899aabbccddeeff00 0 00:24:05.826 03:35:30 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 112233445566778899aabbccddeeff00 0 00:24:05.826 03:35:30 -- nvmf/common.sh@691 -- # local prefix key digest 00:24:05.826 03:35:30 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:24:05.826 03:35:30 -- nvmf/common.sh@693 -- # key=112233445566778899aabbccddeeff00 00:24:05.826 03:35:30 -- nvmf/common.sh@693 -- # digest=0 00:24:05.826 03:35:30 -- nvmf/common.sh@694 -- # python - 00:24:05.826 03:35:30 -- keyring/common.sh@21 -- # chmod 0600 /tmp/tmp.xR3dCjO1Zi 00:24:05.826 03:35:30 -- keyring/common.sh@23 -- # echo /tmp/tmp.xR3dCjO1Zi 00:24:05.826 03:35:30 -- keyring/file.sh@27 -- # key1path=/tmp/tmp.xR3dCjO1Zi 00:24:05.826 03:35:30 -- keyring/file.sh@30 -- # tgtpid=1558454 00:24:05.826 03:35:30 -- keyring/file.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:24:05.826 03:35:30 -- keyring/file.sh@32 -- # waitforlisten 1558454 00:24:05.826 03:35:30 -- common/autotest_common.sh@817 -- # '[' -z 1558454 ']' 00:24:05.826 03:35:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:05.826 03:35:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:05.826 03:35:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:05.826 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:05.826 03:35:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:05.826 03:35:30 -- common/autotest_common.sh@10 -- # set +x 00:24:05.826 [2024-04-27 03:35:30.562960] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:24:05.826 [2024-04-27 03:35:30.563046] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1558454 ] 00:24:05.826 EAL: No free 2048 kB hugepages reported on node 1 00:24:05.826 [2024-04-27 03:35:30.624107] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:05.826 [2024-04-27 03:35:30.734887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:06.085 03:35:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:06.085 03:35:30 -- common/autotest_common.sh@850 -- # return 0 00:24:06.085 03:35:30 -- keyring/file.sh@33 -- # rpc_cmd 00:24:06.085 03:35:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:06.085 03:35:30 -- common/autotest_common.sh@10 -- # set +x 00:24:06.085 [2024-04-27 03:35:31.000495] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:06.085 null0 00:24:06.085 [2024-04-27 03:35:31.032561] tcp.c: 925:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:24:06.085 [2024-04-27 03:35:31.033063] tcp.c: 964:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:24:06.085 [2024-04-27 03:35:31.040578] tcp.c:3652:nvmf_tcp_subsystem_add_host: *WARNING*: nvmf_tcp_psk_path: deprecated feature PSK path to be removed in v24.09 00:24:06.085 03:35:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:06.085 03:35:31 -- keyring/file.sh@43 -- # NOT rpc_cmd nvmf_subsystem_add_listener -t tcp -a 127.0.0.1 -s 4420 nqn.2016-06.io.spdk:cnode0 00:24:06.085 03:35:31 -- common/autotest_common.sh@638 -- # local es=0 00:24:06.085 03:35:31 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd nvmf_subsystem_add_listener -t tcp -a 127.0.0.1 -s 4420 nqn.2016-06.io.spdk:cnode0 00:24:06.085 03:35:31 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:24:06.085 03:35:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:06.085 03:35:31 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:24:06.085 03:35:31 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:06.085 03:35:31 -- common/autotest_common.sh@641 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 127.0.0.1 -s 4420 nqn.2016-06.io.spdk:cnode0 00:24:06.085 03:35:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:06.085 03:35:31 -- common/autotest_common.sh@10 -- # set +x 00:24:06.085 [2024-04-27 03:35:31.048586] nvmf_rpc.c: 769:nvmf_rpc_listen_paused: *ERROR*: A listener already exists with different secure channel option.request: 00:24:06.085 { 00:24:06.085 "nqn": "nqn.2016-06.io.spdk:cnode0", 00:24:06.085 "secure_channel": false, 00:24:06.085 "listen_address": { 00:24:06.085 "trtype": "tcp", 00:24:06.085 "traddr": "127.0.0.1", 00:24:06.085 "trsvcid": "4420" 00:24:06.085 }, 00:24:06.085 "method": "nvmf_subsystem_add_listener", 00:24:06.085 "req_id": 1 00:24:06.085 } 00:24:06.085 Got JSON-RPC error response 00:24:06.085 response: 00:24:06.085 { 00:24:06.085 "code": -32602, 00:24:06.085 "message": "Invalid parameters" 00:24:06.085 } 00:24:06.085 03:35:31 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:24:06.085 03:35:31 -- common/autotest_common.sh@641 -- # es=1 00:24:06.085 03:35:31 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:24:06.085 03:35:31 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:24:06.085 03:35:31 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:24:06.085 03:35:31 -- keyring/file.sh@46 -- # bperfpid=1558471 00:24:06.085 03:35:31 -- keyring/file.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -q 128 -o 4k -w randrw -M 50 -t 1 -m 2 -r /var/tmp/bperf.sock -z 00:24:06.085 03:35:31 -- keyring/file.sh@48 -- # waitforlisten 1558471 /var/tmp/bperf.sock 00:24:06.085 03:35:31 -- common/autotest_common.sh@817 -- # '[' -z 1558471 ']' 00:24:06.085 03:35:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:24:06.085 03:35:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:06.085 03:35:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:24:06.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:24:06.085 03:35:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:06.085 03:35:31 -- common/autotest_common.sh@10 -- # set +x 00:24:06.344 [2024-04-27 03:35:31.095909] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:24:06.344 [2024-04-27 03:35:31.095988] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1558471 ] 00:24:06.344 EAL: No free 2048 kB hugepages reported on node 1 00:24:06.344 [2024-04-27 03:35:31.156359] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:06.344 [2024-04-27 03:35:31.271823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:06.602 03:35:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:06.602 03:35:31 -- common/autotest_common.sh@850 -- # return 0 00:24:06.602 03:35:31 -- keyring/file.sh@49 -- # bperf_cmd keyring_file_add_key key0 /tmp/tmp.zCVe5YMXsf 00:24:06.602 03:35:31 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key0 /tmp/tmp.zCVe5YMXsf 00:24:06.860 03:35:31 -- keyring/file.sh@50 -- # bperf_cmd keyring_file_add_key key1 /tmp/tmp.xR3dCjO1Zi 00:24:06.860 03:35:31 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key1 /tmp/tmp.xR3dCjO1Zi 00:24:07.118 03:35:31 -- keyring/file.sh@51 -- # get_key key0 00:24:07.118 03:35:31 -- keyring/file.sh@51 -- # jq -r .path 00:24:07.118 03:35:31 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:07.118 03:35:31 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:07.118 03:35:31 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:24:07.375 03:35:32 -- keyring/file.sh@51 -- # [[ /tmp/tmp.zCVe5YMXsf == \/\t\m\p\/\t\m\p\.\z\C\V\e\5\Y\M\X\s\f ]] 00:24:07.375 03:35:32 -- keyring/file.sh@52 -- # get_key key1 00:24:07.375 03:35:32 -- keyring/file.sh@52 -- # jq -r .path 00:24:07.375 03:35:32 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:07.375 03:35:32 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:07.375 03:35:32 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:24:07.375 03:35:32 -- keyring/file.sh@52 -- # [[ /tmp/tmp.xR3dCjO1Zi == \/\t\m\p\/\t\m\p\.\x\R\3\d\C\j\O\1\Z\i ]] 00:24:07.375 03:35:32 -- keyring/file.sh@53 -- # get_refcnt key0 00:24:07.375 03:35:32 -- keyring/common.sh@12 -- # get_key key0 00:24:07.375 03:35:32 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:07.375 03:35:32 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:07.632 03:35:32 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:07.632 03:35:32 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:24:07.632 03:35:32 -- keyring/file.sh@53 -- # (( 1 == 1 )) 00:24:07.632 03:35:32 -- keyring/file.sh@54 -- # get_refcnt key1 00:24:07.632 03:35:32 -- keyring/common.sh@12 -- # get_key key1 00:24:07.632 03:35:32 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:07.889 03:35:32 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:07.889 03:35:32 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:07.889 03:35:32 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:24:07.889 03:35:32 -- keyring/file.sh@54 -- # (( 1 == 1 )) 00:24:07.889 03:35:32 -- keyring/file.sh@57 -- # bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:24:07.890 03:35:32 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:24:08.155 [2024-04-27 03:35:33.083127] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:24:08.414 nvme0n1 00:24:08.414 03:35:33 -- keyring/file.sh@59 -- # get_refcnt key0 00:24:08.414 03:35:33 -- keyring/common.sh@12 -- # get_key key0 00:24:08.414 03:35:33 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:08.414 03:35:33 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:08.414 03:35:33 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:24:08.414 03:35:33 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:08.671 03:35:33 -- keyring/file.sh@59 -- # (( 2 == 2 )) 00:24:08.671 03:35:33 -- keyring/file.sh@60 -- # get_refcnt key1 00:24:08.671 03:35:33 -- keyring/common.sh@12 -- # get_key key1 00:24:08.671 03:35:33 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:08.671 03:35:33 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:08.671 03:35:33 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:08.671 03:35:33 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:24:08.929 03:35:33 -- keyring/file.sh@60 -- # (( 1 == 1 )) 00:24:08.929 03:35:33 -- keyring/file.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:24:08.929 Running I/O for 1 seconds... 00:24:09.899 00:24:09.899 Latency(us) 00:24:09.899 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:09.900 Job: nvme0n1 (Core Mask 0x2, workload: randrw, percentage: 50, depth: 128, IO size: 4096) 00:24:09.900 nvme0n1 : 1.01 6926.11 27.06 0.00 0.00 18395.61 8301.23 29903.83 00:24:09.900 =================================================================================================================== 00:24:09.900 Total : 6926.11 27.06 0.00 0.00 18395.61 8301.23 29903.83 00:24:09.900 0 00:24:09.900 03:35:34 -- keyring/file.sh@64 -- # bperf_cmd bdev_nvme_detach_controller nvme0 00:24:09.900 03:35:34 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_detach_controller nvme0 00:24:10.158 03:35:35 -- keyring/file.sh@65 -- # get_refcnt key0 00:24:10.158 03:35:35 -- keyring/common.sh@12 -- # get_key key0 00:24:10.158 03:35:35 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:10.158 03:35:35 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:10.158 03:35:35 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:10.158 03:35:35 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:24:10.416 03:35:35 -- keyring/file.sh@65 -- # (( 1 == 1 )) 00:24:10.416 03:35:35 -- keyring/file.sh@66 -- # get_refcnt key1 00:24:10.416 03:35:35 -- keyring/common.sh@12 -- # get_key key1 00:24:10.416 03:35:35 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:10.416 03:35:35 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:10.416 03:35:35 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:10.416 03:35:35 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:24:10.675 03:35:35 -- keyring/file.sh@66 -- # (( 1 == 1 )) 00:24:10.675 03:35:35 -- keyring/file.sh@69 -- # NOT bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key1 00:24:10.675 03:35:35 -- common/autotest_common.sh@638 -- # local es=0 00:24:10.675 03:35:35 -- common/autotest_common.sh@640 -- # valid_exec_arg bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key1 00:24:10.675 03:35:35 -- common/autotest_common.sh@626 -- # local arg=bperf_cmd 00:24:10.675 03:35:35 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:10.675 03:35:35 -- common/autotest_common.sh@630 -- # type -t bperf_cmd 00:24:10.675 03:35:35 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:10.675 03:35:35 -- common/autotest_common.sh@641 -- # bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key1 00:24:10.675 03:35:35 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key1 00:24:10.933 [2024-04-27 03:35:35.754935] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:24:10.933 [2024-04-27 03:35:35.755442] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1101910 (107): Transport endpoint is not connected 00:24:10.933 [2024-04-27 03:35:35.756435] nvme_tcp.c:2173:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1101910 (9): Bad file descriptor 00:24:10.933 [2024-04-27 03:35:35.757434] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:24:10.933 [2024-04-27 03:35:35.757455] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 127.0.0.1 00:24:10.933 [2024-04-27 03:35:35.757469] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:24:10.933 request: 00:24:10.933 { 00:24:10.933 "name": "nvme0", 00:24:10.933 "trtype": "tcp", 00:24:10.933 "traddr": "127.0.0.1", 00:24:10.933 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:24:10.933 "adrfam": "ipv4", 00:24:10.933 "trsvcid": "4420", 00:24:10.933 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:10.933 "psk": "key1", 00:24:10.933 "method": "bdev_nvme_attach_controller", 00:24:10.933 "req_id": 1 00:24:10.933 } 00:24:10.933 Got JSON-RPC error response 00:24:10.933 response: 00:24:10.933 { 00:24:10.933 "code": -32602, 00:24:10.933 "message": "Invalid parameters" 00:24:10.933 } 00:24:10.933 03:35:35 -- common/autotest_common.sh@641 -- # es=1 00:24:10.933 03:35:35 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:24:10.933 03:35:35 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:24:10.933 03:35:35 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:24:10.933 03:35:35 -- keyring/file.sh@71 -- # get_refcnt key0 00:24:10.933 03:35:35 -- keyring/common.sh@12 -- # get_key key0 00:24:10.933 03:35:35 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:10.933 03:35:35 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:10.933 03:35:35 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:10.933 03:35:35 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:24:11.192 03:35:36 -- keyring/file.sh@71 -- # (( 1 == 1 )) 00:24:11.192 03:35:36 -- keyring/file.sh@72 -- # get_refcnt key1 00:24:11.192 03:35:36 -- keyring/common.sh@12 -- # get_key key1 00:24:11.192 03:35:36 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:11.192 03:35:36 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:11.192 03:35:36 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:11.192 03:35:36 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:24:11.450 03:35:36 -- keyring/file.sh@72 -- # (( 1 == 1 )) 00:24:11.450 03:35:36 -- keyring/file.sh@75 -- # bperf_cmd keyring_file_remove_key key0 00:24:11.450 03:35:36 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_remove_key key0 00:24:11.707 03:35:36 -- keyring/file.sh@76 -- # bperf_cmd keyring_file_remove_key key1 00:24:11.707 03:35:36 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_remove_key key1 00:24:11.965 03:35:36 -- keyring/file.sh@77 -- # bperf_cmd keyring_get_keys 00:24:11.966 03:35:36 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:11.966 03:35:36 -- keyring/file.sh@77 -- # jq length 00:24:12.223 03:35:37 -- keyring/file.sh@77 -- # (( 0 == 0 )) 00:24:12.223 03:35:37 -- keyring/file.sh@80 -- # chmod 0660 /tmp/tmp.zCVe5YMXsf 00:24:12.223 03:35:37 -- keyring/file.sh@81 -- # NOT bperf_cmd keyring_file_add_key key0 /tmp/tmp.zCVe5YMXsf 00:24:12.223 03:35:37 -- common/autotest_common.sh@638 -- # local es=0 00:24:12.223 03:35:37 -- common/autotest_common.sh@640 -- # valid_exec_arg bperf_cmd keyring_file_add_key key0 /tmp/tmp.zCVe5YMXsf 00:24:12.223 03:35:37 -- common/autotest_common.sh@626 -- # local arg=bperf_cmd 00:24:12.223 03:35:37 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:12.223 03:35:37 -- common/autotest_common.sh@630 -- # type -t bperf_cmd 00:24:12.223 03:35:37 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:12.223 03:35:37 -- common/autotest_common.sh@641 -- # bperf_cmd keyring_file_add_key key0 /tmp/tmp.zCVe5YMXsf 00:24:12.223 03:35:37 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key0 /tmp/tmp.zCVe5YMXsf 00:24:12.481 [2024-04-27 03:35:37.232333] keyring.c: 34:keyring_file_check_path: *ERROR*: Invalid permissions for key file '/tmp/tmp.zCVe5YMXsf': 0100660 00:24:12.481 [2024-04-27 03:35:37.232366] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:24:12.481 request: 00:24:12.481 { 00:24:12.481 "name": "key0", 00:24:12.481 "path": "/tmp/tmp.zCVe5YMXsf", 00:24:12.481 "method": "keyring_file_add_key", 00:24:12.481 "req_id": 1 00:24:12.481 } 00:24:12.481 Got JSON-RPC error response 00:24:12.481 response: 00:24:12.481 { 00:24:12.481 "code": -1, 00:24:12.481 "message": "Operation not permitted" 00:24:12.481 } 00:24:12.481 03:35:37 -- common/autotest_common.sh@641 -- # es=1 00:24:12.481 03:35:37 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:24:12.481 03:35:37 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:24:12.481 03:35:37 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:24:12.481 03:35:37 -- keyring/file.sh@84 -- # chmod 0600 /tmp/tmp.zCVe5YMXsf 00:24:12.481 03:35:37 -- keyring/file.sh@85 -- # bperf_cmd keyring_file_add_key key0 /tmp/tmp.zCVe5YMXsf 00:24:12.482 03:35:37 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key0 /tmp/tmp.zCVe5YMXsf 00:24:12.740 03:35:37 -- keyring/file.sh@86 -- # rm -f /tmp/tmp.zCVe5YMXsf 00:24:12.740 03:35:37 -- keyring/file.sh@88 -- # get_refcnt key0 00:24:12.740 03:35:37 -- keyring/common.sh@12 -- # get_key key0 00:24:12.740 03:35:37 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:12.740 03:35:37 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:12.740 03:35:37 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:12.740 03:35:37 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:24:12.998 03:35:37 -- keyring/file.sh@88 -- # (( 1 == 1 )) 00:24:12.998 03:35:37 -- keyring/file.sh@90 -- # NOT bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:24:12.998 03:35:37 -- common/autotest_common.sh@638 -- # local es=0 00:24:12.998 03:35:37 -- common/autotest_common.sh@640 -- # valid_exec_arg bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:24:12.998 03:35:37 -- common/autotest_common.sh@626 -- # local arg=bperf_cmd 00:24:12.998 03:35:37 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:12.998 03:35:37 -- common/autotest_common.sh@630 -- # type -t bperf_cmd 00:24:12.998 03:35:37 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:24:12.998 03:35:37 -- common/autotest_common.sh@641 -- # bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:24:12.998 03:35:37 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:24:12.998 [2024-04-27 03:35:37.950318] keyring.c: 29:keyring_file_check_path: *ERROR*: Could not stat key file '/tmp/tmp.zCVe5YMXsf': No such file or directory 00:24:12.998 [2024-04-27 03:35:37.950351] nvme_tcp.c:2570:nvme_tcp_generate_tls_credentials: *ERROR*: Failed to obtain key 'key0': No such file or directory 00:24:12.998 [2024-04-27 03:35:37.950377] nvme.c: 683:nvme_ctrlr_probe: *ERROR*: Failed to construct NVMe controller for SSD: 127.0.0.1 00:24:12.998 [2024-04-27 03:35:37.950388] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:24:12.998 [2024-04-27 03:35:37.950399] bdev_nvme.c:6208:bdev_nvme_create: *ERROR*: No controller was found with provided trid (traddr: 127.0.0.1) 00:24:12.998 request: 00:24:12.998 { 00:24:12.998 "name": "nvme0", 00:24:12.998 "trtype": "tcp", 00:24:12.998 "traddr": "127.0.0.1", 00:24:12.998 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:24:12.998 "adrfam": "ipv4", 00:24:12.998 "trsvcid": "4420", 00:24:12.998 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:12.998 "psk": "key0", 00:24:12.998 "method": "bdev_nvme_attach_controller", 00:24:12.998 "req_id": 1 00:24:12.998 } 00:24:12.998 Got JSON-RPC error response 00:24:12.998 response: 00:24:12.998 { 00:24:12.998 "code": -19, 00:24:12.998 "message": "No such device" 00:24:12.998 } 00:24:12.998 03:35:37 -- common/autotest_common.sh@641 -- # es=1 00:24:12.998 03:35:37 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:24:12.998 03:35:37 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:24:12.998 03:35:37 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:24:12.998 03:35:37 -- keyring/file.sh@92 -- # bperf_cmd keyring_file_remove_key key0 00:24:12.998 03:35:37 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_remove_key key0 00:24:13.256 03:35:38 -- keyring/file.sh@95 -- # prep_key key0 00112233445566778899aabbccddeeff 0 00:24:13.256 03:35:38 -- keyring/common.sh@15 -- # local name key digest path 00:24:13.256 03:35:38 -- keyring/common.sh@17 -- # name=key0 00:24:13.256 03:35:38 -- keyring/common.sh@17 -- # key=00112233445566778899aabbccddeeff 00:24:13.256 03:35:38 -- keyring/common.sh@17 -- # digest=0 00:24:13.256 03:35:38 -- keyring/common.sh@18 -- # mktemp 00:24:13.256 03:35:38 -- keyring/common.sh@18 -- # path=/tmp/tmp.lzVveEXAeX 00:24:13.256 03:35:38 -- keyring/common.sh@20 -- # format_interchange_psk 00112233445566778899aabbccddeeff 0 00:24:13.256 03:35:38 -- nvmf/common.sh@704 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff 0 00:24:13.256 03:35:38 -- nvmf/common.sh@691 -- # local prefix key digest 00:24:13.256 03:35:38 -- nvmf/common.sh@693 -- # prefix=NVMeTLSkey-1 00:24:13.256 03:35:38 -- nvmf/common.sh@693 -- # key=00112233445566778899aabbccddeeff 00:24:13.256 03:35:38 -- nvmf/common.sh@693 -- # digest=0 00:24:13.256 03:35:38 -- nvmf/common.sh@694 -- # python - 00:24:13.513 03:35:38 -- keyring/common.sh@21 -- # chmod 0600 /tmp/tmp.lzVveEXAeX 00:24:13.513 03:35:38 -- keyring/common.sh@23 -- # echo /tmp/tmp.lzVveEXAeX 00:24:13.513 03:35:38 -- keyring/file.sh@95 -- # key0path=/tmp/tmp.lzVveEXAeX 00:24:13.513 03:35:38 -- keyring/file.sh@96 -- # bperf_cmd keyring_file_add_key key0 /tmp/tmp.lzVveEXAeX 00:24:13.513 03:35:38 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key0 /tmp/tmp.lzVveEXAeX 00:24:13.771 03:35:38 -- keyring/file.sh@97 -- # bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:24:13.771 03:35:38 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:24:14.028 nvme0n1 00:24:14.028 03:35:38 -- keyring/file.sh@99 -- # get_refcnt key0 00:24:14.028 03:35:38 -- keyring/common.sh@12 -- # get_key key0 00:24:14.028 03:35:38 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:14.028 03:35:38 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:14.028 03:35:38 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:14.028 03:35:38 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:24:14.285 03:35:39 -- keyring/file.sh@99 -- # (( 2 == 2 )) 00:24:14.285 03:35:39 -- keyring/file.sh@100 -- # bperf_cmd keyring_file_remove_key key0 00:24:14.285 03:35:39 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_remove_key key0 00:24:14.543 03:35:39 -- keyring/file.sh@101 -- # get_key key0 00:24:14.543 03:35:39 -- keyring/file.sh@101 -- # jq -r .removed 00:24:14.543 03:35:39 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:14.543 03:35:39 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:14.543 03:35:39 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:24:14.802 03:35:39 -- keyring/file.sh@101 -- # [[ true == \t\r\u\e ]] 00:24:14.802 03:35:39 -- keyring/file.sh@102 -- # get_refcnt key0 00:24:14.802 03:35:39 -- keyring/common.sh@12 -- # get_key key0 00:24:14.802 03:35:39 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:14.802 03:35:39 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:14.802 03:35:39 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:14.802 03:35:39 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:24:15.060 03:35:39 -- keyring/file.sh@102 -- # (( 1 == 1 )) 00:24:15.060 03:35:39 -- keyring/file.sh@103 -- # bperf_cmd bdev_nvme_detach_controller nvme0 00:24:15.060 03:35:39 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_detach_controller nvme0 00:24:15.319 03:35:40 -- keyring/file.sh@104 -- # bperf_cmd keyring_get_keys 00:24:15.319 03:35:40 -- keyring/file.sh@104 -- # jq length 00:24:15.319 03:35:40 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:15.319 03:35:40 -- keyring/file.sh@104 -- # (( 0 == 0 )) 00:24:15.319 03:35:40 -- keyring/file.sh@107 -- # bperf_cmd keyring_file_add_key key0 /tmp/tmp.lzVveEXAeX 00:24:15.319 03:35:40 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key0 /tmp/tmp.lzVveEXAeX 00:24:15.576 03:35:40 -- keyring/file.sh@108 -- # bperf_cmd keyring_file_add_key key1 /tmp/tmp.xR3dCjO1Zi 00:24:15.576 03:35:40 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_file_add_key key1 /tmp/tmp.xR3dCjO1Zi 00:24:15.834 03:35:40 -- keyring/file.sh@109 -- # bperf_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:24:15.835 03:35:40 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 127.0.0.1 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host0 --psk key0 00:24:16.400 nvme0n1 00:24:16.400 03:35:41 -- keyring/file.sh@112 -- # bperf_cmd save_config 00:24:16.401 03:35:41 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock save_config 00:24:16.659 03:35:41 -- keyring/file.sh@112 -- # config='{ 00:24:16.659 "subsystems": [ 00:24:16.659 { 00:24:16.659 "subsystem": "keyring", 00:24:16.659 "config": [ 00:24:16.659 { 00:24:16.659 "method": "keyring_file_add_key", 00:24:16.659 "params": { 00:24:16.659 "name": "key0", 00:24:16.659 "path": "/tmp/tmp.lzVveEXAeX" 00:24:16.659 } 00:24:16.659 }, 00:24:16.659 { 00:24:16.659 "method": "keyring_file_add_key", 00:24:16.659 "params": { 00:24:16.659 "name": "key1", 00:24:16.659 "path": "/tmp/tmp.xR3dCjO1Zi" 00:24:16.659 } 00:24:16.659 } 00:24:16.659 ] 00:24:16.659 }, 00:24:16.659 { 00:24:16.659 "subsystem": "iobuf", 00:24:16.659 "config": [ 00:24:16.659 { 00:24:16.659 "method": "iobuf_set_options", 00:24:16.659 "params": { 00:24:16.659 "small_pool_count": 8192, 00:24:16.659 "large_pool_count": 1024, 00:24:16.659 "small_bufsize": 8192, 00:24:16.659 "large_bufsize": 135168 00:24:16.659 } 00:24:16.659 } 00:24:16.659 ] 00:24:16.659 }, 00:24:16.659 { 00:24:16.659 "subsystem": "sock", 00:24:16.659 "config": [ 00:24:16.659 { 00:24:16.659 "method": "sock_impl_set_options", 00:24:16.659 "params": { 00:24:16.659 "impl_name": "posix", 00:24:16.660 "recv_buf_size": 2097152, 00:24:16.660 "send_buf_size": 2097152, 00:24:16.660 "enable_recv_pipe": true, 00:24:16.660 "enable_quickack": false, 00:24:16.660 "enable_placement_id": 0, 00:24:16.660 "enable_zerocopy_send_server": true, 00:24:16.660 "enable_zerocopy_send_client": false, 00:24:16.660 "zerocopy_threshold": 0, 00:24:16.660 "tls_version": 0, 00:24:16.660 "enable_ktls": false 00:24:16.660 } 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "method": "sock_impl_set_options", 00:24:16.660 "params": { 00:24:16.660 "impl_name": "ssl", 00:24:16.660 "recv_buf_size": 4096, 00:24:16.660 "send_buf_size": 4096, 00:24:16.660 "enable_recv_pipe": true, 00:24:16.660 "enable_quickack": false, 00:24:16.660 "enable_placement_id": 0, 00:24:16.660 "enable_zerocopy_send_server": true, 00:24:16.660 "enable_zerocopy_send_client": false, 00:24:16.660 "zerocopy_threshold": 0, 00:24:16.660 "tls_version": 0, 00:24:16.660 "enable_ktls": false 00:24:16.660 } 00:24:16.660 } 00:24:16.660 ] 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "subsystem": "vmd", 00:24:16.660 "config": [] 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "subsystem": "accel", 00:24:16.660 "config": [ 00:24:16.660 { 00:24:16.660 "method": "accel_set_options", 00:24:16.660 "params": { 00:24:16.660 "small_cache_size": 128, 00:24:16.660 "large_cache_size": 16, 00:24:16.660 "task_count": 2048, 00:24:16.660 "sequence_count": 2048, 00:24:16.660 "buf_count": 2048 00:24:16.660 } 00:24:16.660 } 00:24:16.660 ] 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "subsystem": "bdev", 00:24:16.660 "config": [ 00:24:16.660 { 00:24:16.660 "method": "bdev_set_options", 00:24:16.660 "params": { 00:24:16.660 "bdev_io_pool_size": 65535, 00:24:16.660 "bdev_io_cache_size": 256, 00:24:16.660 "bdev_auto_examine": true, 00:24:16.660 "iobuf_small_cache_size": 128, 00:24:16.660 "iobuf_large_cache_size": 16 00:24:16.660 } 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "method": "bdev_raid_set_options", 00:24:16.660 "params": { 00:24:16.660 "process_window_size_kb": 1024 00:24:16.660 } 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "method": "bdev_iscsi_set_options", 00:24:16.660 "params": { 00:24:16.660 "timeout_sec": 30 00:24:16.660 } 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "method": "bdev_nvme_set_options", 00:24:16.660 "params": { 00:24:16.660 "action_on_timeout": "none", 00:24:16.660 "timeout_us": 0, 00:24:16.660 "timeout_admin_us": 0, 00:24:16.660 "keep_alive_timeout_ms": 10000, 00:24:16.660 "arbitration_burst": 0, 00:24:16.660 "low_priority_weight": 0, 00:24:16.660 "medium_priority_weight": 0, 00:24:16.660 "high_priority_weight": 0, 00:24:16.660 "nvme_adminq_poll_period_us": 10000, 00:24:16.660 "nvme_ioq_poll_period_us": 0, 00:24:16.660 "io_queue_requests": 512, 00:24:16.660 "delay_cmd_submit": true, 00:24:16.660 "transport_retry_count": 4, 00:24:16.660 "bdev_retry_count": 3, 00:24:16.660 "transport_ack_timeout": 0, 00:24:16.660 "ctrlr_loss_timeout_sec": 0, 00:24:16.660 "reconnect_delay_sec": 0, 00:24:16.660 "fast_io_fail_timeout_sec": 0, 00:24:16.660 "disable_auto_failback": false, 00:24:16.660 "generate_uuids": false, 00:24:16.660 "transport_tos": 0, 00:24:16.660 "nvme_error_stat": false, 00:24:16.660 "rdma_srq_size": 0, 00:24:16.660 "io_path_stat": false, 00:24:16.660 "allow_accel_sequence": false, 00:24:16.660 "rdma_max_cq_size": 0, 00:24:16.660 "rdma_cm_event_timeout_ms": 0, 00:24:16.660 "dhchap_digests": [ 00:24:16.660 "sha256", 00:24:16.660 "sha384", 00:24:16.660 "sha512" 00:24:16.660 ], 00:24:16.660 "dhchap_dhgroups": [ 00:24:16.660 "null", 00:24:16.660 "ffdhe2048", 00:24:16.660 "ffdhe3072", 00:24:16.660 "ffdhe4096", 00:24:16.660 "ffdhe6144", 00:24:16.660 "ffdhe8192" 00:24:16.660 ] 00:24:16.660 } 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "method": "bdev_nvme_attach_controller", 00:24:16.660 "params": { 00:24:16.660 "name": "nvme0", 00:24:16.660 "trtype": "TCP", 00:24:16.660 "adrfam": "IPv4", 00:24:16.660 "traddr": "127.0.0.1", 00:24:16.660 "trsvcid": "4420", 00:24:16.660 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:16.660 "prchk_reftag": false, 00:24:16.660 "prchk_guard": false, 00:24:16.660 "ctrlr_loss_timeout_sec": 0, 00:24:16.660 "reconnect_delay_sec": 0, 00:24:16.660 "fast_io_fail_timeout_sec": 0, 00:24:16.660 "psk": "key0", 00:24:16.660 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:24:16.660 "hdgst": false, 00:24:16.660 "ddgst": false 00:24:16.660 } 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "method": "bdev_nvme_set_hotplug", 00:24:16.660 "params": { 00:24:16.660 "period_us": 100000, 00:24:16.660 "enable": false 00:24:16.660 } 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "method": "bdev_wait_for_examine" 00:24:16.660 } 00:24:16.660 ] 00:24:16.660 }, 00:24:16.660 { 00:24:16.660 "subsystem": "nbd", 00:24:16.660 "config": [] 00:24:16.660 } 00:24:16.660 ] 00:24:16.660 }' 00:24:16.660 03:35:41 -- keyring/file.sh@114 -- # killprocess 1558471 00:24:16.660 03:35:41 -- common/autotest_common.sh@936 -- # '[' -z 1558471 ']' 00:24:16.660 03:35:41 -- common/autotest_common.sh@940 -- # kill -0 1558471 00:24:16.660 03:35:41 -- common/autotest_common.sh@941 -- # uname 00:24:16.660 03:35:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:16.660 03:35:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1558471 00:24:16.660 03:35:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:16.660 03:35:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:16.660 03:35:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1558471' 00:24:16.660 killing process with pid 1558471 00:24:16.660 03:35:41 -- common/autotest_common.sh@955 -- # kill 1558471 00:24:16.660 Received shutdown signal, test time was about 1.000000 seconds 00:24:16.660 00:24:16.660 Latency(us) 00:24:16.660 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:16.660 =================================================================================================================== 00:24:16.660 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:24:16.660 03:35:41 -- common/autotest_common.sh@960 -- # wait 1558471 00:24:16.919 03:35:41 -- keyring/file.sh@117 -- # bperfpid=1559924 00:24:16.919 03:35:41 -- keyring/file.sh@119 -- # waitforlisten 1559924 /var/tmp/bperf.sock 00:24:16.919 03:35:41 -- common/autotest_common.sh@817 -- # '[' -z 1559924 ']' 00:24:16.919 03:35:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bperf.sock 00:24:16.919 03:35:41 -- keyring/file.sh@115 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -q 128 -o 4k -w randrw -M 50 -t 1 -m 2 -r /var/tmp/bperf.sock -z -c /dev/fd/63 00:24:16.919 03:35:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:16.919 03:35:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:24:16.919 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:24:16.919 03:35:41 -- keyring/file.sh@115 -- # echo '{ 00:24:16.919 "subsystems": [ 00:24:16.919 { 00:24:16.919 "subsystem": "keyring", 00:24:16.919 "config": [ 00:24:16.919 { 00:24:16.919 "method": "keyring_file_add_key", 00:24:16.919 "params": { 00:24:16.919 "name": "key0", 00:24:16.919 "path": "/tmp/tmp.lzVveEXAeX" 00:24:16.919 } 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "method": "keyring_file_add_key", 00:24:16.919 "params": { 00:24:16.919 "name": "key1", 00:24:16.919 "path": "/tmp/tmp.xR3dCjO1Zi" 00:24:16.919 } 00:24:16.919 } 00:24:16.919 ] 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "subsystem": "iobuf", 00:24:16.919 "config": [ 00:24:16.919 { 00:24:16.919 "method": "iobuf_set_options", 00:24:16.919 "params": { 00:24:16.919 "small_pool_count": 8192, 00:24:16.919 "large_pool_count": 1024, 00:24:16.919 "small_bufsize": 8192, 00:24:16.919 "large_bufsize": 135168 00:24:16.919 } 00:24:16.919 } 00:24:16.919 ] 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "subsystem": "sock", 00:24:16.919 "config": [ 00:24:16.919 { 00:24:16.919 "method": "sock_impl_set_options", 00:24:16.919 "params": { 00:24:16.919 "impl_name": "posix", 00:24:16.919 "recv_buf_size": 2097152, 00:24:16.919 "send_buf_size": 2097152, 00:24:16.919 "enable_recv_pipe": true, 00:24:16.919 "enable_quickack": false, 00:24:16.919 "enable_placement_id": 0, 00:24:16.919 "enable_zerocopy_send_server": true, 00:24:16.919 "enable_zerocopy_send_client": false, 00:24:16.919 "zerocopy_threshold": 0, 00:24:16.919 "tls_version": 0, 00:24:16.919 "enable_ktls": false 00:24:16.919 } 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "method": "sock_impl_set_options", 00:24:16.919 "params": { 00:24:16.919 "impl_name": "ssl", 00:24:16.919 "recv_buf_size": 4096, 00:24:16.919 "send_buf_size": 4096, 00:24:16.919 "enable_recv_pipe": true, 00:24:16.919 "enable_quickack": false, 00:24:16.919 "enable_placement_id": 0, 00:24:16.919 "enable_zerocopy_send_server": true, 00:24:16.919 "enable_zerocopy_send_client": false, 00:24:16.919 "zerocopy_threshold": 0, 00:24:16.919 "tls_version": 0, 00:24:16.919 "enable_ktls": false 00:24:16.919 } 00:24:16.919 } 00:24:16.919 ] 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "subsystem": "vmd", 00:24:16.919 "config": [] 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "subsystem": "accel", 00:24:16.919 "config": [ 00:24:16.919 { 00:24:16.919 "method": "accel_set_options", 00:24:16.919 "params": { 00:24:16.919 "small_cache_size": 128, 00:24:16.919 "large_cache_size": 16, 00:24:16.919 "task_count": 2048, 00:24:16.919 "sequence_count": 2048, 00:24:16.919 "buf_count": 2048 00:24:16.919 } 00:24:16.919 } 00:24:16.919 ] 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "subsystem": "bdev", 00:24:16.919 "config": [ 00:24:16.919 { 00:24:16.919 "method": "bdev_set_options", 00:24:16.919 "params": { 00:24:16.919 "bdev_io_pool_size": 65535, 00:24:16.919 "bdev_io_cache_size": 256, 00:24:16.919 "bdev_auto_examine": true, 00:24:16.919 "iobuf_small_cache_size": 128, 00:24:16.919 "iobuf_large_cache_size": 16 00:24:16.919 } 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "method": "bdev_raid_set_options", 00:24:16.919 "params": { 00:24:16.919 "process_window_size_kb": 1024 00:24:16.919 } 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "method": "bdev_iscsi_set_options", 00:24:16.919 "params": { 00:24:16.919 "timeout_sec": 30 00:24:16.919 } 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "method": "bdev_nvme_set_options", 00:24:16.919 "params": { 00:24:16.919 "action_on_timeout": "none", 00:24:16.919 "timeout_us": 0, 00:24:16.919 "timeout_admin_us": 0, 00:24:16.919 "keep_alive_timeout_ms": 10000, 00:24:16.919 "arbitration_burst": 0, 00:24:16.919 "low_priority_weight": 0, 00:24:16.919 "medium_priority_weight": 0, 00:24:16.919 "high_priority_weight": 0, 00:24:16.919 "nvme_adminq_poll_period_us": 10000, 00:24:16.919 "nvme_ioq_poll_period_us": 0, 00:24:16.919 "io_queue_requests": 512, 00:24:16.919 "delay_cmd_submit": true, 00:24:16.919 "transport_retry_count": 4, 00:24:16.919 "bdev_retry_count": 3, 00:24:16.919 "transport_ack_timeout": 0, 00:24:16.919 "ctrlr_loss_timeout_sec": 0, 00:24:16.919 "reconnect_delay_sec": 0, 00:24:16.919 "fast_io_fail_timeout_sec": 0, 00:24:16.919 "disable_auto_failback": false, 00:24:16.919 "generate_uuids": false, 00:24:16.919 "transport_tos": 0, 00:24:16.919 "nvme_error_stat": false, 00:24:16.919 "rdma_srq_size": 0, 00:24:16.919 "io_path_stat": false, 00:24:16.919 "allow_accel_sequence": false, 00:24:16.919 "rdma_max_cq_size": 0, 00:24:16.919 "rdma_cm_event_timeout_ms": 0, 00:24:16.919 "dhchap_digests": [ 00:24:16.919 "sha256", 00:24:16.919 "sha384", 00:24:16.919 "sha512" 00:24:16.919 ], 00:24:16.919 "dhchap_dhgroups": [ 00:24:16.919 "null", 00:24:16.919 "ffdhe2048", 00:24:16.919 "ffdhe3072", 00:24:16.919 "ffdhe4096", 00:24:16.919 "ffdhe6144", 00:24:16.919 "ffdhe8192" 00:24:16.919 ] 00:24:16.919 } 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "method": "bdev_nvme_attach_controller", 00:24:16.919 "params": { 00:24:16.919 "name": "nvme0", 00:24:16.919 "trtype": "TCP", 00:24:16.919 "adrfam": "IPv4", 00:24:16.919 "traddr": "127.0.0.1", 00:24:16.919 "trsvcid": "4420", 00:24:16.919 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:16.919 "prchk_reftag": false, 00:24:16.919 "prchk_guard": false, 00:24:16.919 "ctrlr_loss_timeout_sec": 0, 00:24:16.919 "reconnect_delay_sec": 0, 00:24:16.919 "fast_io_fail_timeout_sec": 0, 00:24:16.919 "psk": "key0", 00:24:16.919 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:24:16.919 "hdgst": false, 00:24:16.919 "ddgst": false 00:24:16.919 } 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "method": "bdev_nvme_set_hotplug", 00:24:16.919 "params": { 00:24:16.919 "period_us": 100000, 00:24:16.919 "enable": false 00:24:16.919 } 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "method": "bdev_wait_for_examine" 00:24:16.919 } 00:24:16.919 ] 00:24:16.919 }, 00:24:16.919 { 00:24:16.919 "subsystem": "nbd", 00:24:16.919 "config": [] 00:24:16.919 } 00:24:16.919 ] 00:24:16.919 }' 00:24:16.919 03:35:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:16.919 03:35:41 -- common/autotest_common.sh@10 -- # set +x 00:24:16.919 [2024-04-27 03:35:41.735513] Starting SPDK v24.05-pre git sha1 33914772a / DPDK 23.11.0 initialization... 00:24:16.919 [2024-04-27 03:35:41.735603] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1559924 ] 00:24:16.919 EAL: No free 2048 kB hugepages reported on node 1 00:24:16.919 [2024-04-27 03:35:41.797538] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:17.178 [2024-04-27 03:35:41.906421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:17.178 [2024-04-27 03:35:42.088180] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:24:17.743 03:35:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:17.743 03:35:42 -- common/autotest_common.sh@850 -- # return 0 00:24:17.743 03:35:42 -- keyring/file.sh@120 -- # bperf_cmd keyring_get_keys 00:24:17.743 03:35:42 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:17.743 03:35:42 -- keyring/file.sh@120 -- # jq length 00:24:18.001 03:35:42 -- keyring/file.sh@120 -- # (( 2 == 2 )) 00:24:18.001 03:35:42 -- keyring/file.sh@121 -- # get_refcnt key0 00:24:18.001 03:35:42 -- keyring/common.sh@12 -- # get_key key0 00:24:18.001 03:35:42 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:18.001 03:35:42 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:18.001 03:35:42 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:18.001 03:35:42 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key0")' 00:24:18.258 03:35:43 -- keyring/file.sh@121 -- # (( 2 == 2 )) 00:24:18.258 03:35:43 -- keyring/file.sh@122 -- # get_refcnt key1 00:24:18.258 03:35:43 -- keyring/common.sh@12 -- # get_key key1 00:24:18.258 03:35:43 -- keyring/common.sh@12 -- # jq -r .refcnt 00:24:18.258 03:35:43 -- keyring/common.sh@10 -- # bperf_cmd keyring_get_keys 00:24:18.258 03:35:43 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock keyring_get_keys 00:24:18.258 03:35:43 -- keyring/common.sh@10 -- # jq '.[] | select(.name == "key1")' 00:24:18.516 03:35:43 -- keyring/file.sh@122 -- # (( 1 == 1 )) 00:24:18.516 03:35:43 -- keyring/file.sh@123 -- # bperf_cmd bdev_nvme_get_controllers 00:24:18.516 03:35:43 -- keyring/file.sh@123 -- # jq -r '.[].name' 00:24:18.516 03:35:43 -- keyring/common.sh@8 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_get_controllers 00:24:18.775 03:35:43 -- keyring/file.sh@123 -- # [[ nvme0 == nvme0 ]] 00:24:18.775 03:35:43 -- keyring/file.sh@1 -- # cleanup 00:24:18.775 03:35:43 -- keyring/file.sh@19 -- # rm -f /tmp/tmp.lzVveEXAeX /tmp/tmp.xR3dCjO1Zi 00:24:18.775 03:35:43 -- keyring/file.sh@20 -- # killprocess 1559924 00:24:18.775 03:35:43 -- common/autotest_common.sh@936 -- # '[' -z 1559924 ']' 00:24:18.775 03:35:43 -- common/autotest_common.sh@940 -- # kill -0 1559924 00:24:18.775 03:35:43 -- common/autotest_common.sh@941 -- # uname 00:24:18.775 03:35:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:18.775 03:35:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1559924 00:24:18.775 03:35:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:18.775 03:35:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:18.775 03:35:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1559924' 00:24:18.775 killing process with pid 1559924 00:24:18.775 03:35:43 -- common/autotest_common.sh@955 -- # kill 1559924 00:24:18.775 Received shutdown signal, test time was about 1.000000 seconds 00:24:18.775 00:24:18.775 Latency(us) 00:24:18.775 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:18.775 =================================================================================================================== 00:24:18.775 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:24:18.775 03:35:43 -- common/autotest_common.sh@960 -- # wait 1559924 00:24:19.033 03:35:43 -- keyring/file.sh@21 -- # killprocess 1558454 00:24:19.033 03:35:43 -- common/autotest_common.sh@936 -- # '[' -z 1558454 ']' 00:24:19.033 03:35:43 -- common/autotest_common.sh@940 -- # kill -0 1558454 00:24:19.033 03:35:43 -- common/autotest_common.sh@941 -- # uname 00:24:19.033 03:35:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:19.033 03:35:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1558454 00:24:19.033 03:35:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:19.033 03:35:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:19.033 03:35:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1558454' 00:24:19.033 killing process with pid 1558454 00:24:19.033 03:35:43 -- common/autotest_common.sh@955 -- # kill 1558454 00:24:19.033 [2024-04-27 03:35:43.972083] app.c: 937:log_deprecation_hits: *WARNING*: nvmf_tcp_psk_path: deprecation 'PSK path' scheduled for removal in v24.09 hit 1 times 00:24:19.033 03:35:43 -- common/autotest_common.sh@960 -- # wait 1558454 00:24:19.599 00:24:19.599 real 0m14.080s 00:24:19.599 user 0m34.812s 00:24:19.599 sys 0m3.278s 00:24:19.599 03:35:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:19.599 03:35:44 -- common/autotest_common.sh@10 -- # set +x 00:24:19.599 ************************************ 00:24:19.599 END TEST keyring_file 00:24:19.599 ************************************ 00:24:19.599 03:35:44 -- spdk/autotest.sh@294 -- # [[ n == y ]] 00:24:19.599 03:35:44 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:24:19.599 03:35:44 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:24:19.599 03:35:44 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:24:19.599 03:35:44 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:24:19.599 03:35:44 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:24:19.599 03:35:44 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:24:19.599 03:35:44 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:24:19.599 03:35:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:19.599 03:35:44 -- common/autotest_common.sh@10 -- # set +x 00:24:19.599 03:35:44 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:24:19.599 03:35:44 -- common/autotest_common.sh@1378 -- # local autotest_es=0 00:24:19.599 03:35:44 -- common/autotest_common.sh@1379 -- # xtrace_disable 00:24:19.599 03:35:44 -- common/autotest_common.sh@10 -- # set +x 00:24:21.501 INFO: APP EXITING 00:24:21.501 INFO: killing all VMs 00:24:21.501 INFO: killing vhost app 00:24:21.501 INFO: EXIT DONE 00:24:22.435 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:24:22.435 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:24:22.435 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:24:22.435 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:24:22.435 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:24:22.435 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:24:22.435 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:24:22.435 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:24:22.435 0000:0b:00.0 (8086 0a54): Already using the nvme driver 00:24:22.435 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:24:22.435 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:24:22.435 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:24:22.435 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:24:22.435 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:24:22.435 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:24:22.693 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:24:22.693 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:24:24.068 Cleaning 00:24:24.068 Removing: /var/run/dpdk/spdk0/config 00:24:24.068 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:24:24.068 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:24:24.068 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:24:24.068 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:24:24.068 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:24:24.068 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:24:24.068 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:24:24.068 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:24:24.068 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:24:24.068 Removing: /var/run/dpdk/spdk0/hugepage_info 00:24:24.068 Removing: /var/run/dpdk/spdk1/config 00:24:24.068 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:24:24.068 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:24:24.068 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:24:24.068 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:24:24.068 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:24:24.068 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:24:24.068 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:24:24.068 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:24:24.068 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:24:24.069 Removing: /var/run/dpdk/spdk1/hugepage_info 00:24:24.069 Removing: /var/run/dpdk/spdk1/mp_socket 00:24:24.069 Removing: /var/run/dpdk/spdk2/config 00:24:24.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:24:24.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:24:24.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:24:24.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:24:24.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:24:24.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:24:24.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:24:24.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:24:24.069 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:24:24.069 Removing: /var/run/dpdk/spdk2/hugepage_info 00:24:24.069 Removing: /var/run/dpdk/spdk3/config 00:24:24.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:24:24.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:24:24.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:24:24.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:24:24.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:24:24.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:24:24.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:24:24.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:24:24.069 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:24:24.069 Removing: /var/run/dpdk/spdk3/hugepage_info 00:24:24.069 Removing: /var/run/dpdk/spdk4/config 00:24:24.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:24:24.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:24:24.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:24:24.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:24:24.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:24:24.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:24:24.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:24:24.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:24:24.069 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:24:24.069 Removing: /var/run/dpdk/spdk4/hugepage_info 00:24:24.069 Removing: /dev/shm/bdev_svc_trace.1 00:24:24.069 Removing: /dev/shm/nvmf_trace.0 00:24:24.069 Removing: /dev/shm/spdk_tgt_trace.pid1331298 00:24:24.069 Removing: /var/run/dpdk/spdk0 00:24:24.069 Removing: /var/run/dpdk/spdk1 00:24:24.069 Removing: /var/run/dpdk/spdk2 00:24:24.069 Removing: /var/run/dpdk/spdk3 00:24:24.069 Removing: /var/run/dpdk/spdk4 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1329572 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1330456 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1331298 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1331905 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1332605 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1332745 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1333475 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1333612 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1333878 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1335067 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1336112 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1336312 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1336632 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1336848 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1337049 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1337340 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1337502 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1337698 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1338278 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1340647 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1340922 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1341123 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1341126 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1341563 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1341701 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1342015 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1342143 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1342318 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1342452 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1342625 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1342630 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1343136 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1343296 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1343503 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1343819 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1343864 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1344057 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1344338 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1344505 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1344671 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1344945 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1345119 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1345398 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1345566 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1345735 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1346007 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1346178 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1346460 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1346622 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1346861 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1347071 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1347241 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1347524 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1347689 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1347977 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1348139 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1348382 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1348505 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1348724 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1350935 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1378072 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1380594 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1386337 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1389642 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1391991 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1392400 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1400409 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1400413 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1400955 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1401618 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1402272 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1402671 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1402677 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1402819 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1402956 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1402960 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1403609 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1404272 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1404818 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1405336 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1405342 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1405605 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1406505 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1407353 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1412737 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1413007 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1415541 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1419374 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1421434 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1428328 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1433670 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1434911 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1435648 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1446135 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1448370 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1451169 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1452354 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1453672 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1453807 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1453834 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1453974 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1454409 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1455724 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1456463 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1456888 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1458614 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1459283 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1459989 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1462513 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1468556 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1471322 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1475114 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1476187 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1477281 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1479873 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1482234 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1486487 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1486604 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1489394 00:24:24.069 Removing: /var/run/dpdk/spdk_pid1489530 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1489779 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1490048 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1490053 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1492560 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1492898 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1495556 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1498001 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1501462 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1504646 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1509121 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1509126 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1521333 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1521804 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1522267 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1522677 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1523387 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1523795 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1524210 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1524623 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1527138 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1527394 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1531199 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1531375 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1533601 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1538650 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1538660 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1541581 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1542989 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1544419 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1545266 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1546678 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1547559 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1552984 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1553369 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1553765 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1555249 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1555610 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1556005 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1558454 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1558471 00:24:24.328 Removing: /var/run/dpdk/spdk_pid1559924 00:24:24.328 Clean 00:24:24.328 03:35:49 -- common/autotest_common.sh@1437 -- # return 0 00:24:24.328 03:35:49 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:24:24.328 03:35:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:24.328 03:35:49 -- common/autotest_common.sh@10 -- # set +x 00:24:24.328 03:35:49 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:24:24.328 03:35:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:24.328 03:35:49 -- common/autotest_common.sh@10 -- # set +x 00:24:24.586 03:35:49 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:24:24.586 03:35:49 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:24:24.586 03:35:49 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:24:24.586 03:35:49 -- spdk/autotest.sh@389 -- # hash lcov 00:24:24.586 03:35:49 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:24:24.586 03:35:49 -- spdk/autotest.sh@391 -- # hostname 00:24:24.586 03:35:49 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-06 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:24:24.586 geninfo: WARNING: invalid characters removed from testname! 00:24:56.677 03:36:16 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:24:56.677 03:36:20 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:24:59.206 03:36:23 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:25:01.735 03:36:26 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:25:05.016 03:36:29 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:25:07.545 03:36:32 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:25:10.846 03:36:35 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:25:11.105 03:36:35 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:11.105 03:36:35 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:25:11.105 03:36:35 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:11.105 03:36:35 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:11.105 03:36:35 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:11.105 03:36:35 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:11.105 03:36:35 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:11.105 03:36:35 -- paths/export.sh@5 -- $ export PATH 00:25:11.105 03:36:35 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:11.105 03:36:35 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:25:11.105 03:36:35 -- common/autobuild_common.sh@435 -- $ date +%s 00:25:11.105 03:36:35 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714181795.XXXXXX 00:25:11.105 03:36:35 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714181795.EU9ekr 00:25:11.105 03:36:35 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:25:11.105 03:36:35 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:25:11.105 03:36:35 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:25:11.105 03:36:35 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:25:11.105 03:36:35 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:25:11.105 03:36:35 -- common/autobuild_common.sh@451 -- $ get_config_params 00:25:11.105 03:36:35 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:25:11.105 03:36:35 -- common/autotest_common.sh@10 -- $ set +x 00:25:11.105 03:36:35 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user' 00:25:11.105 03:36:35 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:25:11.105 03:36:35 -- pm/common@17 -- $ local monitor 00:25:11.105 03:36:35 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:25:11.105 03:36:35 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1569123 00:25:11.105 03:36:35 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:25:11.105 03:36:35 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1569125 00:25:11.106 03:36:35 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:25:11.106 03:36:35 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1569127 00:25:11.106 03:36:35 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:25:11.106 03:36:35 -- pm/common@21 -- $ date +%s 00:25:11.106 03:36:35 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1569129 00:25:11.106 03:36:35 -- pm/common@26 -- $ sleep 1 00:25:11.106 03:36:35 -- pm/common@21 -- $ date +%s 00:25:11.106 03:36:35 -- pm/common@21 -- $ date +%s 00:25:11.106 03:36:35 -- pm/common@21 -- $ date +%s 00:25:11.106 03:36:35 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714181795 00:25:11.106 03:36:35 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714181795 00:25:11.106 03:36:35 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714181795 00:25:11.106 03:36:35 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714181795 00:25:11.106 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714181795_collect-bmc-pm.bmc.pm.log 00:25:11.106 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714181795_collect-vmstat.pm.log 00:25:11.106 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714181795_collect-cpu-load.pm.log 00:25:11.106 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714181795_collect-cpu-temp.pm.log 00:25:12.042 03:36:36 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:25:12.042 03:36:36 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:25:12.042 03:36:36 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:25:12.042 03:36:36 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:25:12.042 03:36:36 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:25:12.042 03:36:36 -- spdk/autopackage.sh@19 -- $ timing_finish 00:25:12.042 03:36:36 -- common/autotest_common.sh@722 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:25:12.042 03:36:36 -- common/autotest_common.sh@723 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:25:12.042 03:36:36 -- common/autotest_common.sh@725 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:25:12.042 03:36:36 -- spdk/autopackage.sh@20 -- $ exit 0 00:25:12.042 03:36:36 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:25:12.042 03:36:36 -- pm/common@30 -- $ signal_monitor_resources TERM 00:25:12.042 03:36:36 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:25:12.042 03:36:36 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:25:12.042 03:36:36 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:25:12.042 03:36:36 -- pm/common@45 -- $ pid=1569141 00:25:12.042 03:36:36 -- pm/common@52 -- $ sudo kill -TERM 1569141 00:25:12.042 03:36:36 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:25:12.042 03:36:36 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:25:12.042 03:36:36 -- pm/common@45 -- $ pid=1569145 00:25:12.042 03:36:36 -- pm/common@52 -- $ sudo kill -TERM 1569145 00:25:12.042 03:36:36 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:25:12.042 03:36:36 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:25:12.042 03:36:36 -- pm/common@45 -- $ pid=1569142 00:25:12.042 03:36:36 -- pm/common@52 -- $ sudo kill -TERM 1569142 00:25:12.042 03:36:37 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:25:12.042 03:36:37 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:25:12.042 03:36:37 -- pm/common@45 -- $ pid=1569139 00:25:12.042 03:36:37 -- pm/common@52 -- $ sudo kill -TERM 1569139 00:25:12.301 + [[ -n 1246688 ]] 00:25:12.301 + sudo kill 1246688 00:25:12.312 [Pipeline] } 00:25:12.329 [Pipeline] // stage 00:25:12.334 [Pipeline] } 00:25:12.352 [Pipeline] // timeout 00:25:12.357 [Pipeline] } 00:25:12.373 [Pipeline] // catchError 00:25:12.378 [Pipeline] } 00:25:12.395 [Pipeline] // wrap 00:25:12.401 [Pipeline] } 00:25:12.416 [Pipeline] // catchError 00:25:12.425 [Pipeline] stage 00:25:12.427 [Pipeline] { (Epilogue) 00:25:12.440 [Pipeline] catchError 00:25:12.442 [Pipeline] { 00:25:12.455 [Pipeline] echo 00:25:12.457 Cleanup processes 00:25:12.462 [Pipeline] sh 00:25:12.748 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:25:12.748 1569267 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/sdr.cache 00:25:12.748 1569405 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:25:12.763 [Pipeline] sh 00:25:13.082 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:25:13.082 ++ grep -v 'sudo pgrep' 00:25:13.082 ++ awk '{print $1}' 00:25:13.082 + sudo kill -9 1569267 00:25:13.094 [Pipeline] sh 00:25:13.377 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:25:21.497 [Pipeline] sh 00:25:21.783 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:25:21.783 Artifacts sizes are good 00:25:21.799 [Pipeline] archiveArtifacts 00:25:21.807 Archiving artifacts 00:25:21.995 [Pipeline] sh 00:25:22.307 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:25:22.326 [Pipeline] cleanWs 00:25:22.338 [WS-CLEANUP] Deleting project workspace... 00:25:22.338 [WS-CLEANUP] Deferred wipeout is used... 00:25:22.345 [WS-CLEANUP] done 00:25:22.348 [Pipeline] } 00:25:22.368 [Pipeline] // catchError 00:25:22.380 [Pipeline] sh 00:25:22.659 + logger -p user.info -t JENKINS-CI 00:25:22.668 [Pipeline] } 00:25:22.689 [Pipeline] // stage 00:25:22.696 [Pipeline] } 00:25:22.718 [Pipeline] // node 00:25:22.724 [Pipeline] End of Pipeline 00:25:22.777 Finished: SUCCESS